0 / 0
Managing metadata imports
Managing metadata imports

Managing metadata imports

You can import technical metadata associated with the data assets in your organization into a project or a catalog to inventory, evaluate, and catalog these assets.

Technical metadata in this context describes the structure of data objects. This metadata helps users decide whether the data is appropriate for the task at hand, whether they can trust the data, and how to work with the data.

Required service Watson Knowledge Catalog

Data format Tables from relational data sources Files from file-based connections to the data sources

Data size Any

Supported connections You can import assets from the data sources listed in Supported data sources for metadata import and metadata enrichment.

Required permissions
To create and run a metadata import, you must have the Admin or the Editor role in the project. To import metadata into a catalog, you must also have the Admin or the Editor role in the catalog to which you want to import.

For a data asset such as a table or a view imported from a database, technical metadata includes the following information:

  • Table name
  • Table view description
  • Column information that consists of these items:
    • Column name
    • Column type
    • Column length
    • Column description
  • Data source information (connection information) that consists of these items:
    • Server hostname or IP
    • Parent database that holds the table
    • Parent schema of the table

This list is not exhaustive. Also, when you import metadata from an unstructured data source such as a Box folder, a different set of metadata is imported. It includes, for example, file name, file type, size, access permissions, owner, creation date, last access date, parent folder, and other information.

The metadata that you import can later be enriched with other information to help users find data faster and use it with confidence. Such information includes, for example, terms that define the meaning of the data, rules that document ownership or determine quality standards, or reviews.

When you import metadata, you add data assets to a project or a catalog. If you import the assets to a project, they are not visible in any catalog until you publish them. After you share them to a catalog, other catalog users can work with these assets.

If your project is marked as sensitive, you can import assets only to that project and you can't publish the assets.

Learn more

Next steps

Parent topic: Curating data