gcp_dataplex_asset

ancestors

Type: UNORDERED_LIST_STRING

create_time

Type: TIMESTAMP
Provider name: createTime
Description: Output only. The time when the asset was created.

description

Type: STRING
Provider name: description
Description: Optional. Description of the asset.

discovery_spec

Type: STRUCT
Provider name: discoverySpec
Description: Optional. Specification of the discovery feature applied to data referenced by this asset. When this spec is left unset, the asset will use the spec set on the parent zone.

  • csv_options
    Type: STRUCT
    Provider name: csvOptions
    Description: Optional. Configuration for CSV data.
    • delimiter
      Type: STRING
      Provider name: delimiter
      Description: Optional. The delimiter being used to separate values. This defaults to ‘,’.
    • disable_type_inference
      Type: BOOLEAN
      Provider name: disableTypeInference
      Description: Optional. Whether to disable the inference of data type for CSV data. If true, all columns will be registered as strings.
    • encoding
      Type: STRING
      Provider name: encoding
      Description: Optional. The character encoding of the data. The default is UTF-8.
    • header_rows
      Type: INT32
      Provider name: headerRows
      Description: Optional. The number of rows to interpret as header rows that should be skipped when reading data rows.
  • enabled
    Type: BOOLEAN
    Provider name: enabled
    Description: Optional. Whether discovery is enabled.
  • exclude_patterns
    Type: UNORDERED_LIST_STRING
    Provider name: excludePatterns
    Description: Optional. The list of patterns to apply for selecting data to exclude during discovery. For Cloud Storage bucket assets, these are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these are interpreted as patterns to match table names.
  • include_patterns
    Type: UNORDERED_LIST_STRING
    Provider name: includePatterns
    Description: Optional. The list of patterns to apply for selecting data to include during discovery if only a subset of the data should considered. For Cloud Storage bucket assets, these are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these are interpreted as patterns to match table names.
  • json_options
    Type: STRUCT
    Provider name: jsonOptions
    Description: Optional. Configuration for Json data.
    • disable_type_inference
      Type: BOOLEAN
      Provider name: disableTypeInference
      Description: Optional. Whether to disable the inference of data type for Json data. If true, all columns will be registered as their primitive types (strings, number or boolean).
    • encoding
      Type: STRING
      Provider name: encoding
      Description: Optional. The character encoding of the data. The default is UTF-8.
  • schedule
    Type: STRING
    Provider name: schedule
    Description: Optional. Cron schedule (https://en.wikipedia.org/wiki/Cron) for running discovery periodically. Successive discovery runs must be scheduled at least 60 minutes apart. The default value is to run discovery every 60 minutes.To explicitly set a timezone to the cron tab, apply a prefix in the cron tab: “CRON_TZ=${IANA_TIME_ZONE}” or TZ=${IANA_TIME_ZONE}". The ${IANA_TIME_ZONE} may only be a valid string from IANA time zone database. For example, CRON_TZ=America/New_York 1 * * * *, or TZ=America/New_York 1 * * * *.

discovery_status

Type: STRUCT
Provider name: discoveryStatus
Description: Output only. Status of the discovery feature applied to data referenced by this asset.

  • last_run_duration
    Type: STRING
    Provider name: lastRunDuration
    Description: The duration of the last discovery run.
  • last_run_time
    Type: TIMESTAMP
    Provider name: lastRunTime
    Description: The start time of the last discovery run.
  • message
    Type: STRING
    Provider name: message
    Description: Additional information about the current state.
  • state
    Type: STRING
    Provider name: state
    Description: The current status of the discovery feature.
    Possible values:
    • STATE_UNSPECIFIED - State is unspecified.
    • SCHEDULED - Discovery for the asset is scheduled.
    • IN_PROGRESS - Discovery for the asset is running.
    • PAUSED - Discovery for the asset is currently paused (e.g. due to a lack of available resources). It will be automatically resumed.
    • DISABLED - Discovery for the asset is disabled.
  • stats
    Type: STRUCT
    Provider name: stats
    Description: Data Stats of the asset reported by discovery.
    • data_items
      Type: INT64
      Provider name: dataItems
      Description: The count of data items within the referenced resource.
    • data_size
      Type: INT64
      Provider name: dataSize
      Description: The number of stored data bytes within the referenced resource.
    • filesets
      Type: INT64
      Provider name: filesets
      Description: The count of fileset entities within the referenced resource.
    • tables
      Type: INT64
      Provider name: tables
      Description: The count of table entities within the referenced resource.
  • update_time
    Type: TIMESTAMP
    Provider name: updateTime
    Description: Last update time of the status.

gcp_display_name

Type: STRING
Provider name: displayName
Description: Optional. User friendly display name.

labels

Type: UNORDERED_LIST_STRING

name

Type: STRING
Provider name: name
Description: Output only. The relative resource name of the asset, of the form: projects/{project_number}/locations/{location_id}/lakes/{lake_id}/zones/{zone_id}/assets/{asset_id}.

organization_id

Type: STRING

parent

Type: STRING

project_id

Type: STRING

project_number

Type: STRING

resource_name

Type: STRING

resource_spec

Type: STRUCT
Provider name: resourceSpec
Description: Required. Specification of the resource that is referenced by this asset.

  • name
    Type: STRING
    Provider name: name
    Description: Immutable. Relative name of the cloud resource that contains the data that is being managed within a lake. For example: projects/{project_number}/buckets/{bucket_id} projects/{project_number}/datasets/{dataset_id}
  • read_access_mode
    Type: STRING
    Provider name: readAccessMode
    Description: Optional. Determines how read permissions are handled for each asset and their associated tables. Only available to storage buckets assets.
    Possible values:
    • ACCESS_MODE_UNSPECIFIED - Access mode unspecified.
    • DIRECT - Default. Data is accessed directly using storage APIs.
    • MANAGED - Data is accessed through a managed interface using BigQuery APIs.
  • type
    Type: STRING
    Provider name: type
    Description: Required. Immutable. Type of resource.
    Possible values:
    • TYPE_UNSPECIFIED - Type not specified.
    • STORAGE_BUCKET - Cloud Storage bucket.
    • BIGQUERY_DATASET - BigQuery dataset.

resource_status

Type: STRUCT
Provider name: resourceStatus
Description: Output only. Status of the resource referenced by this asset.

  • managed_access_identity
    Type: STRING
    Provider name: managedAccessIdentity
    Description: Output only. Service account associated with the BigQuery Connection.
  • message
    Type: STRING
    Provider name: message
    Description: Additional information about the current state.
  • state
    Type: STRING
    Provider name: state
    Description: The current state of the managed resource.
    Possible values:
    • STATE_UNSPECIFIED - State unspecified.
    • READY - Resource does not have any errors.
    • ERROR - Resource has errors.
  • update_time
    Type: TIMESTAMP
    Provider name: updateTime
    Description: Last update time of the status.

security_status

Type: STRUCT
Provider name: securityStatus
Description: Output only. Status of the security policy applied to resource referenced by this asset.

  • message
    Type: STRING
    Provider name: message
    Description: Additional information about the current state.
  • state
    Type: STRING
    Provider name: state
    Description: The current state of the security policy applied to the attached resource.
    Possible values:
    • STATE_UNSPECIFIED - State unspecified.
    • READY - Security policy has been successfully applied to the attached resource.
    • APPLYING - Security policy is in the process of being applied to the attached resource.
    • ERROR - Security policy could not be applied to the attached resource due to errors.
  • update_time
    Type: TIMESTAMP
    Provider name: updateTime
    Description: Last update time of the status.

state

Type: STRING
Provider name: state
Description: Output only. Current state of the asset.
Possible values:

  • STATE_UNSPECIFIED - State is not specified.
  • ACTIVE - Resource is active, i.e., ready to use.
  • CREATING - Resource is under creation.
  • DELETING - Resource is under deletion.
  • ACTION_REQUIRED - Resource is active but has unresolved actions.

tags

Type: UNORDERED_LIST_STRING

uid

Type: STRING
Provider name: uid
Description: Output only. System generated globally unique ID for the asset. This ID will be different if the asset is deleted and re-created with the same name.

update_time

Type: TIMESTAMP
Provider name: updateTime
Description: Output only. The time when the asset was last updated.

PREVIEWING: guacbot/translation-pipeline