TerraUtils

UploadDataTable

description
Upload a Terra-formatted entity TSV into a workspace data table. Optionally require that every entity ID in the new data already exists in the destination table, failing (and listing the offenders on stderr) when any do not.
volatile
true

Inputs

Required

  • entities_tsv (File, required): Terra-formatted entity TSV to upload. Its first column header must be entity:<table_name>_id.
  • table_name (String, required): Name of the destination data table (entity type) to upload into.

Optional

  • namespace (String?): Optional Terra billing project / namespace that owns the destination workspace. When omitted it is auto-detected (WORKSPACE_NAMESPACE env var, else the workspace whose Google project matches this VM).
  • runtime_attr_override (RuntimeAttr?): Override default runtime attributes.
  • workspace (String?): Optional name of the destination Terra workspace. When omitted it is auto-detected (WORKSPACE_NAME env var, else the workspace whose Google project matches this VM).

Defaults

  • columns_must_exist (Boolean, default=true): When true (default), every column in entities_tsv must already exist in the destination table; any that do not are printed to stderr and the task fails before uploading. When false, new columns are allowed.
  • require_existing_id (Boolean, default=true): When true (default), pull the destination table first and verify every entity ID in entities_tsv already exists there; any IDs that do not are printed to stderr and the task fails before uploading. When false, upload unconditionally.

Outputs

  • upload_log (File)