Docs

Sources

Source-system definitions: connection servers, schema abbreviations, access policies, and custom properties.


Source  

type: Source

A connection to a source system: which plugin reads it, how it authenticates, and the contract describing its schema.

Example

name: crm
plugin: postgres
secretRef: infisical/crm-creds   # vault reference for credentials
server:                          # non-secret connection routing
  type: postgres
  host: db.acme.io
  port: 5432
  database: crm
contract: contracts/crm.odcs.yaml
PropertyTypeRequiredDescription
abbreviationstringNoAbbreviation is the short identifier for this source in the data platform naming convention, used as the first segment of the generated schema prefix. Mandatory for multi-schema imports. Lowercase alphanumeric, 2-10 characters.
Abbreviation is the short identifier for this source in the data platform naming convention, used as the first segment of the generated schema prefix. Mandatory for multi-schema imports. Lowercase alphanumeric, 2-10 characters.
contractstringNoContract is the path to (or name of) the data contract describing this source’s schema. Optional when objects are selected via glob instead of an explicit contract file.
Contract is the path to (or name of) the data contract describing this source’s schema. Optional when objects are selected via glob instead of an explicit contract file.
driftPolicyPolicyNoDriftPolicy overrides the project-level schema-drift policy for this source.
DriftPolicy overrides the project-level schema-drift policy for this source.
namestringYesName identifies this source within the project. Must be unique among sources and is referenced by Job.Source.
Name identifies this source within the project. Must be unique among sources and is referenced by Job.Source.
pluginstringYesPlugin is the name of the source plugin used to connect (e.g. “postgres”, “mysql”). Must match a plugin configured in Plugins.Source.
Plugin is the name of the source plugin used to connect (e.g. “postgres”, “mysql”). Must match a plugin configured in Plugins.Source.
schemasSchemaAbbrev []NoSchemas maps source schema names to their data platform abbreviations. Populated for multi-schema imports; empty for single-schema sources.
Schemas maps source schema names to their data platform abbreviations. Populated for multi-schema imports; empty for single-schema sources.
secretRefstringNoSecretRef is the vault reference path for this source’s connection credentials.
SecretRef is the vault reference path for this source’s connection credentials.
serverServerNoServer describes the connection details for this source, taking precedence over any server defined in the associated contract. Optional for secretRef-only sources or sources that rely solely on the contract’s server.
Server describes the connection details for this source, taking precedence over any server defined in the associated contract. Optional for secretRef-only sources or sources that rely solely on the contract’s server.

Server  

type: Server

Data source details of where data is physically stored.

PropertyTypeRequiredDescription
accountstringNoAccount used by the server.
Account used by the server.
catalogstringNoName of the catalog.
Name of the catalog.
customPropertiesCustomProperty []NoA list of key/value pairs for custom properties.
A list of key/value pairs for custom properties.
databasestringNoName of the database.
Name of the database.
datasetstringNoName of the dataset.
Name of the dataset.
delimiterstringNoDelimiter.
Delimiter.
descriptionstringNoDescription of the server.
Description of the server.
endpointUrlstringNoServer endpoint.
Server endpoint.
environmentstringNoEnvironment of the server.
Environment of the server.
formatstringNoFile format.
File format.
hoststringNoHost name or IP address.
Host name or IP address.
locationstringNoA URL to a location.
A URL to a location.
pathstringNoRelative or absolute path to the data file(s).
Relative or absolute path to the data file(s).
portintegerNoPort to the server. No default value is assumed for custom servers.
Port to the server. No default value is assumed for custom servers.
projectstringNoProject name.
Project name.
regionstringNoCloud region.
Cloud region.
regionNamestringNoRegion name.
Region name.
rolesRole []NoList of roles that have access to the server.
List of roles that have access to the server.
schemastringNoName of the schema.
Name of the schema.
serverstringNoIdentifier of the server.
Identifier of the server.
serviceNamestringNoName of the service.
Name of the service.
stagingDirstringNoStaging directory.
Staging directory.
streamstringNoName of the data stream.
Name of the data stream.
typestringYesType of the server.
Type of the server.
warehousestringNoName of the cluster or warehouse.
Name of the cluster or warehouse.

Role  

type: Role

Role is an IAM role that grants access to the dataset, together with the approvers who can grant it.

PropertyTypeRequiredDescription
accessstringNoThe type of access provided by the IAM role.
The type of access provided by the IAM role.
descriptionstringNoDescription of the IAM role and its permissions.
Description of the IAM role and its permissions.
firstLevelApproversstringNoThe name(s) of the first-level approver(s) of the role.
The name(s) of the first-level approver(s) of the role.
rolestringYesName of the IAM role that provides access to the dataset.
Name of the IAM role that provides access to the dataset.
secondLevelApproversstringNoThe name(s) of the second-level approver(s) of the role.
The name(s) of the second-level approver(s) of the role.

Schema Abbreviation  

type: SchemaAbbrev

Maps a source schema name to its data platform abbreviation.

PropertyTypeRequiredDescription
abbreviationstringYesAbbreviation is the short identifier substituted for Name in generated schema/table names.
Abbreviation is the short identifier substituted for Name in generated schema/table names.
namestringYesName is the schema name as it exists in the source system.
Name is the schema name as it exists in the source system.

Custom Property  

type: CustomProperty

A list of key/value pairs for custom properties.

PropertyTypeRequiredDescription
propertystringNoThe name of the key. Names should be in camel case–the same as if they were permanent properties in the contract.
The name of the key. Names should be in camel case–the same as if they were permanent properties in the contract.
valueNoThe value of the key.
The value of the key.

Last updated on November 1, 2026