Copy data from source to target

You'll primarily use Data Refinery to read data from a source location, refine that data, and then load the analytics-ready data to a target location. But you can also use Data Refinery to simply and securely copy data from a source to a target.

To copy data:

  1. From within a project, add the data that you want to copy. This creates a data asset in the project.

  2. Create a connection for the target, if it doesn't already exist.

    Tip: When creating a target connection, be sure to use credentials that have Write permission or you won't be able to save your Data Refinery flow output to the target.

  3. From the project's Assets page, select Refine from the data asset's menu. Alternatively, click the data asset to see a preview and then click the Refine link.

  4. Click the Run Data Refinery flow icon in the Data Refinery toolbar.

  5. Save the Data Refinery flow output (target data set) to a connection.

    a. Optionally, edit the target name.

    b. Click Change Location and then Connection.

    c. Select the connection details, then click Save Location.

  6. Specify what to do if the data set already exists in the target location:

    • Append output to the data set - Append the Data Refinery flow output to the existing data set.

    • Recreate the data set - Drop the existing data set and re-create it, replacing the existing data with the Data Refinery flow output.

    • Repopulate the existing data set - Replace the existing data with the Data Refinery flow output.

  7. Click Save and Run.

  8. Optionally, follow the progress of the run by clicking View Flow to monitor the Data Refinery flow's status on the Data Refinery flow details page. When the Data Refinery flow completes, you can view the target data set from the Data Refinery flow details page too.

Watch this video to see how to copy data to a target.

Figure 1. Video iconCopy data to a target
This video shows you how to copy data to a target.