Combine two or more datasets into one

Open the Combine dialog

1. In the Data Library, tick two or more datasets in the list.
2. In the selection bar, click Combine. You can also right-click one of the selected rows and choose Combine.
3. The Combine 2 datasets dialog opens (it counts your datasets): "Put their rows together in one place. Two ways, and they leave you with different libraries."

Combine is available only when the selection holds datasets that are ready:

With view-only access, Combine and the other selection actions are unavailable.

Choose between batches in one dataset and sending into a dataset

Step 1 shows two cards, each with a before-and-after diagram. When both are available, nothing is selected for you; when only one is, it is picked. Pick one and click Next.

Pick Batches in one dataset to tidy up: for example, two uploads of the same report that should have been one dataset. Pick Send into a dataset when the originals have their own refreshes or pipelines you want to keep, and you want one dataset that collects from all of them.

Merge two datasets as batches in one dataset

This option is available only when all of these are true. When it is not, its card says why.

1. Choose Batches in one dataset and click Next.
2. Under Keep which one?, pick the dataset that stays. Each option shows its columns and rows. "Each batch keeps its own name and date, so you can suspend or remove one later."
3. If the two datasets have different numbers of columns, a warning says you will match columns next. Otherwise, any columns that don't line up are matched in the next step.
4. Click Combine into (the button names the dataset you keep).
5. The Add data dialog opens on the dataset you kept, with Select existing and the other dataset already chosen. Check the column match there.
6. Leave Delete dataset after combining ticked, so the other dataset stops existing. See Add or replace data.

The dataset you kept holds both sets of rows as separate batches. Check them in its Batches section under Settings & history: see Manage batches.

Send several datasets into one that keeps updating

This option works for any number of datasets. Each original gets a Send to Dataset step at the end of its View (the View you were last in, or its first View). The step runs every time that View's pipeline runs, so the destination keeps receiving rows as the originals refresh. For the step itself, see Join two datasets on a shared column.

Send into a new dataset

1. Choose Send into a dataset and click Next.
2. Under Send into, choose New dataset ("The originals stay and keep sending to it.").
3. Type a name in Name the new dataset. The new dataset goes into the folder you are in, or the top of the project.
4. Check the column review (see below).
5. Click Create (the button shows the new name), or press Enter in the name box.

The dialog stays open and shows its progress: "Reading the columns of each dataset…", "Creating the new dataset…", then, for example, "Sent 2 of 3…".

Send into an existing dataset

1. Choose Send into a dataset and click Next.
2. Under Send into, choose An existing dataset ("Any dataset in this project. Its columns stay as they are.").
3. In the finder that opens, pick the destination and click Choose a dataset. You can pick any dataset in the current project except the ones you are combining. To pick a different one, click Change.
4. Check the column review.
5. Click Send into (the button names the destination).

If one of the originals already sends its rows to that dataset, it is left out of this send, and the dialog says so. Sending it twice would add its rows twice on every refresh.

Match columns that differ between datasets

Before you send, Review columns shows what happens to each column, with the counts (for example 4 in all, 1 in some).

For a new dataset, the new dataset gets every column from every original, matched by name:

• A column that only some originals have is kept, and is "Empty in rows from" the others.
• Columns with close names are flagged ("Looks like the same column as …"). Click Make one column to merge them.
• Leave out drops a column from the new dataset.
• A column that is not the same type in every dataset becomes text, and the review says which types it found.

For an existing dataset, its columns stay as they are. Each original's columns are matched into the destination's columns by name, and you can send a column into a different destination column. Columns with no match are listed under "Left out: these have no column in" the destination.

If nothing from one original fits, the button is disabled. Send at least one of its columns into a column in the table, or go back and leave that dataset out of the selection.

What you see after the send

Sources are sent one at a time, and the send stops at the first failure. The message then says how many were sent, for example "Sent 2 of 3 to “All regions”, then West failed." The destination keeps what was sent.

Limits

Troubleshooting

Related

• Add or replace data: append or replace data from a file or one other dataset.
• Join two datasets on a shared column: match rows on a key instead of stacking.
• Send pipeline output to another dataset: the step that stacks rows.
• Dataset settings and history: batches for each dataset.
• Find your way around the Data Library: selecting datasets and bulk actions.
• Combine incoming data: add new files to a dataset automatically.