How a Mammoth pipeline works: add and preview tasks
A pipeline is an ordered list of tasks inside a View that clean, reshape, calculate and combine your data. You build it in the Pipeline panel on the left of every View, adding tasks from the Transform menu (Describe your transformation or the blue + button). It re-runs every time the dataset refreshes: on a schedule, on a file upload event, or on a manual refresh.
What a pipeline is and how tasks run
Tasks run top to bottom: the output of task N is the input to task N+1. The first card is always Source, the raw data coming in. It appears as soon as you add your first task to a fresh View.
RAW DATA
↓
[Task 1: Remove Duplicate Rows]
↓
[Task 2: Conditional Filter: keep rows where Status = "Active"]
↓
[Task 3: Edit Cells: standardize Region column values]
↓
[Task 4: Join: merge with budget data from another dataset]
↓
CLEAN OUTPUT
Tasks are stored as instructions, not copies of the data, so you can reorder, edit or delete any task without losing your source data (Edit, reorder and copy pipeline tasks). Pipeline tasks:
- apply to all the data, not only the rows you can see;
- run every time new data flows through the View, including scheduled runs;
- keep a complete history in the Activity Log.
All 30+ transformation functions, plus Data Check and Checkpoint, are pipeline tasks.
Pipeline tasks versus Display Changes
| Display Changes | Pipeline tasks | |
|---|---|---|
| What they change | How data looks: column names, order, visibility, sorting, number and date formats | The data itself: filtering rows, calculating values, joining tables, cleaning text |
| Where you make them | A column's 3-dot menu, or by dragging columns | The Transform menu |
| When they run | Once, when you make them | Every time new data flows through the View |
There is no "Rename Column" pipeline task. Double-click the header or choose Rename Column in its 3-dot menu: that Display Change's new name appears in task dropdowns and exports. See Rename, format and sort columns.
Open the Transform menu
- Open any View.
- Click the Describe your transformation box in the action bar, or the blue + next to it (tooltip "Add a task").
- The menu opens on AI Powered, which lists five functions. The left panel lists the seven categories.
Typing filters the functions to your keywords. The Ask in plain words result always appears and carries your text into its prompt.
Once the pipeline has tasks, a + below the last card, or between two cards, opens the same menu and inserts the task at that position. Cards in an error state have no insert button.
The seven categories are AI Powered, Filter, Label & Replace, Date, Numeric & Text, Reshape, Group & Pivot, Column Management, Unify and Controls. For every function in each, and the page that covers it, see Every function in the Transform menu.
Describe a transformation in plain English
| Function | What AI does |
|---|---|
| Generative AI | Writes new column values with a large language model: classification, enrichment, translation, summaries (Use AI on your columns) |
| Ask in plain words | Turns a request into a SQL query and runs it (Write SQL with AI) |
| Conditional Filter, Extract Text | An AI generation bar builds the rule you describe |
| Bulk Replace | Suggests groups of similar values |
For example: "Remove all rows where the customer name contains a test email address" (Conditional Filter), "Extract the numeric dollar value from the Notes column" (Extract Text), or "Classify this product description as Electronics, Apparel, Home, or Food" (Generative AI). The result is an ordinary task you can inspect, edit or override before applying.
Add a task to the pipeline
- Open the Transform menu.
- Click a category, or type in the search bar, and click the function.
- Fill in the configuration panel at the bottom of the View: columns, operators, values, and where to write the result. A "New task will be inserted here" card marks where the task will land.
- Click Apply. The task runs and the grid updates. In Draft mode, choose Add to Pipeline instead; the task runs when you click Apply now.
The new card shows the function name, its key settings and the row count after it runs. Before you apply, most functions show a live result: see Preview a task before you apply it.
Put tasks in the best order for speed
Filter early to cut rows before costly steps like joins and pivots:
- Validate early: Data Check tasks near the top.
- Filter early: Conditional Filter to reduce row volume.
- Clean columns: Remove or Convert Column Type.
- Standardize: Bulk Replace, Text Formatting.
- Enrich: Join, Lookup, Add Column.
- Calculate: Math Function, Window Function.
- Format: Label & Insert Values, Combine Columns.
- Govern: Checkpoint before export.
For large datasets, batch-test changes in Draft mode. Use an automation to keep source datasets current rather than re-uploading by hand. See Speed up pipelines and connectors and What you can automate.
Related
- Edit, reorder and copy pipeline tasks: suspend, copy, search and restore earlier versions.
- Apply several tasks at once with Draft mode: queue changes and run them together.
- Use a parameter as a value in a task: one value shared across steps.
- Quick start: from a file to a shared dashboard: build a first pipeline end to end.
Something wrong? support@mammoth.io