Harvest from Oracle Object Storage
Harvesting is a process that extracts technical metadata from your data assets into your data catalog. A Data Asset represents a data source. For example: a database, an object store, a file or document store, a message queue, or an application.
In this tutorial, you:
- Allow Data Catalog to access any object in your Oracle Object Storage, in any bucket, in any compartment within the tenancy where the policy is created.
- Create an Oracle Object Storage data asset.
- Add one default connection for the data asset.
- Harvest the data asset by running the harvest job immediately.
Before You Begin
To successfully perform this tutorial, you must have the following:
- An Oracle Cloud Infrastructure account. See signing up for Oracle Cloud Infrastructure.
- Access to use the Data Catalog resources. See prerequisites and policy examples.
- A created data catalog instance. See creating a data catalog instance.
- Create a dynamic group (such as
data-catalog-dynamic-group) that includes the specific data catalog OCID as a
resource in the group.
Example:
Any {resource.id = 'ocid.datacatalog.oc1..<unique_ID>'}
1. Create an Access Policy
You create a policy to allow Data Catalog to access your Object Storage resources.
At the least, you must have READ
permission for all the individual resource types objectstorage-namespaces
, buckets
, and objects
, or for the Object Storage aggregate resource type object-family
.
To create an access policy to grant READ
permission to the Object Storage aggregate resource type object-family
, perform the following steps:
2. Create a Data Asset
You're now ready to register the Oracle Object Storage data sources with Data Catalog as a data asset .
To create an Oracle Object Storage data asset, perform the following steps:
3. Add a Connection
After creating the Oracle Object Storage data asset, you create a connection for the data asset.
To add a connection for the Oracle Object Storage data asset, follow these steps:
4. Harvest the Data Asset
You are now ready to harvest your Oracle Object Storage data asset.
To harvest your Oracle Object Storage data asset, perform the following steps:
What's Next
Now, you can explore the data asset, create a glossary, and link terms and tags to data objects.