Add a folder asset to a catalog

You can create a folder asset based on a path within an IBM Cloud Object Storage system that is accessed through a connection. You can view the files and subfolders that share the path with the folder asset. The files that you can view within the folder asset are not themselves data assets. For example, you can create a folder asset for a path that contains news feeds that are continuously updated.

You must have the Editor or Admin role in the catalog to add a folder asset.

To add a folder asset from a connection to a catalog:

  1. If necessary, create a connection asset. Include an Access Key and a Secret Key to your IBM Cloud Object Storage connection to enable the downloading of files within the folder asset. If you're using an existing IBM Cloud Object Storage connection asset that doesn't have an Access Key and Secret Key, edit the connection asset and add them. The Access Key and Secret Key are the HMAC credentials access_key_id and secret_key_id and you generate them in your IBM Cloud Object Storage credentials by adding the inline configuration parameter {"HMAC":true}. For more information, see IBM Cloud Object Storage Service credentials.
  2. Click Add to catalog > Connected asset.
  3. Click Select Source to select an existing connection asset as the source of the data.
  4. Select the folder you want and click Add.
  5. Specify the other asset properties.
  6. Click Add. The asset appears on the catalog Browse page.

Click the folder asset name to view the contents of the folder asset. Click the eye icon next to a file name to preview the contents of the files within the folder that have these formats:

  • CSV
  • JSON
  • Parquet

The files within the folder asset are not profiled because those files are not data assets.

You can specify a classification for the folder asset. The contents of the folder inherit the classification of the folder asset. Data policies can block access to the folder asset and its contents, but files within the folder are not individually subject to data policies. For example, a data policy might anonymize personal information in all data assets in the catalog, but that policy does not apply to files within folder assets. Any personal information in those files is not anonymized.

You can download files from within the folder asset if the IBM Cloud Object Storage connection asset that's associated with the folder asset has an Access Key and a Secret Key (also known as HMAC credentials). For more information about HMAC credentials, see IBM Cloud Object Storage Service credentials.

Next steps