Skip to content
Learn › Clean and shape data: open the docs menu

How a Mammoth pipeline works: add and preview tasks

A pipeline is an ordered list of tasks inside a View that clean, reshape, calculate and combine your data. You build it in the Pipeline panel on the left of every View, adding tasks from the Transform menu (Describe your transformation or the blue + button). It re-runs every time the dataset refreshes: on a schedule, on a file upload event, or on a manual refresh.

What a pipeline is and how tasks run

Tasks run top to bottom: the output of task N is the input to task N+1. The first card is always Source, the raw data coming in. It appears as soon as you add your first task to a fresh View.

Pipeline panel with a Source card followed by numbered task cards, to the left of the data grid
RAW DATA
   ↓
[Task 1: Remove Duplicate Rows]
   ↓
[Task 2: Conditional Filter: keep rows where Status = "Active"]
   ↓
[Task 3: Edit Cells: standardize Region column values]
   ↓
[Task 4: Join: merge with budget data from another dataset]
   ↓
CLEAN OUTPUT

Tasks are stored as instructions, not copies of the data, so you can reorder, edit or delete any task without losing your source data (Edit, reorder and copy pipeline tasks). Pipeline tasks:

  • apply to all the data, not only the rows you can see;
  • run every time new data flows through the View, including scheduled runs;
  • keep a complete history in the Activity Log.

All 30+ transformation functions, plus Data Check and Checkpoint, are pipeline tasks.

Pipeline tasks versus Display Changes

Display ChangesPipeline tasks
What they changeHow data looks: column names, order, visibility, sorting, number and date formatsThe data itself: filtering rows, calculating values, joining tables, cleaning text
Where you make themA column's 3-dot menu, or by dragging columnsThe Transform menu
When they runOnce, when you make themEvery time new data flows through the View

There is no "Rename Column" pipeline task. Double-click the header or choose Rename Column in its 3-dot menu: that Display Change's new name appears in task dropdowns and exports. See Rename, format and sort columns.

Open the Transform menu

  1. Open any View.
  2. Click the Describe your transformation box in the action bar, or the blue + next to it (tooltip "Add a task").
  3. The menu opens on AI Powered, which lists five functions. The left panel lists the seven categories.
Task picker open on AI Powered: Ask in plain words, Generative AI, Extract Text, Bulk Replace and Conditional Filter, with the category list and the Describe your transformation box

Typing filters the functions to your keywords. The Ask in plain words result always appears and carries your text into its prompt.

Once the pipeline has tasks, a + below the last card, or between two cards, opens the same menu and inserts the task at that position. Cards in an error state have no insert button.

Convert Column Type task card, a New task will be inserted here marker, and a blue plus button with an Add a task tooltip

The seven categories are AI Powered, Filter, Label & Replace, Date, Numeric & Text, Reshape, Group & Pivot, Column Management, Unify and Controls. For every function in each, and the page that covers it, see Every function in the Transform menu.

Describe a transformation in plain English

FunctionWhat AI does
Generative AIWrites new column values with a large language model: classification, enrichment, translation, summaries (Use AI on your columns)
Ask in plain wordsTurns a request into a SQL query and runs it (Write SQL with AI)
Conditional Filter, Extract TextAn AI generation bar builds the rule you describe
Bulk ReplaceSuggests groups of similar values

For example: "Remove all rows where the customer name contains a test email address" (Conditional Filter), "Extract the numeric dollar value from the Notes column" (Extract Text), or "Classify this product description as Electronics, Apparel, Home, or Food" (Generative AI). The result is an ordinary task you can inspect, edit or override before applying.

Add a task to the pipeline

Full View with the Pipeline panel on the left, the Describe your transformation bar on top, and Add Column panel below
  1. Open the Transform menu.
  2. Click a category, or type in the search bar, and click the function.
  3. Fill in the configuration panel at the bottom of the View: columns, operators, values, and where to write the result. A "New task will be inserted here" card marks where the task will land.
  4. Click Apply. The task runs and the grid updates. In Draft mode, choose Add to Pipeline instead; the task runs when you click Apply now.
Pipeline panel with the new-task marker below Convert Column Type, and the Bulk Replace panel open with a column selector

The new card shows the function name, its key settings and the row count after it runs. Before you apply, most functions show a live result: see Preview a task before you apply it.

Put tasks in the best order for speed

Filter early to cut rows before costly steps like joins and pivots:

  1. Validate early: Data Check tasks near the top.
  2. Filter early: Conditional Filter to reduce row volume.
  3. Clean columns: Remove or Convert Column Type.
  4. Standardize: Bulk Replace, Text Formatting.
  5. Enrich: Join, Lookup, Add Column.
  6. Calculate: Math Function, Window Function.
  7. Format: Label & Insert Values, Combine Columns.
  8. Govern: Checkpoint before export.

For large datasets, batch-test changes in Draft mode. Use an automation to keep source datasets current rather than re-uploading by hand. See Speed up pipelines and connectors and What you can automate.

Was this page helpful?

Something wrong? support@mammoth.io