Connect Soda to Dremio

Access configuration details to connect Soda to a Dremio data source.

For Soda to run quality scans on your data, you must configure it to connect to your data source. To learn how to set up Soda and configure it to connect to your data sources, see Get started.

Compatibility

Soda supports Dremio version 22 or greater.

Connection configuration reference

Install package: soda-dremio

data_source my_datasource_name:
  type: dremio
  host: 127.0.0.1
  port: 5432
  username: simple
  password: simple_pass
  schema: public
  use_encryption: "false"
  routing_queue: queue
  disable_certificate_verification: "false"

Property	Required	Notes
type	required	Identify the type of data source for Soda.
host	required	Provide a host identifier.
port	required	Provide a port identifier.
username	required	Consider using system variables to retrieve this value securely.
password	required	Consider using system variables to retrieve this value securely.
schema	optional	Provide an identifier for the schema in which your dataset exists.
use_encryption	optional	Specify a boolean value to use, or not use, encryption. Default is false. Value requires double quotes.
routing_queue	optional	Provide an identifier for the routing queue to use.
disable_certificate_verification	optional	Specify a boolean value to demand that Dremio verify the host certificate against the truststore. If set to true, Dremio does not verify the host certificate. Default value is false to verify certificate. Value requires double quotes.

Test the data source connection

To confirm that you have correctly configured the connection details for the data source(s) in your configuration YAML file, use the test-connection command. If you wish, add a -V option to the command to returns results in verbose mode in the CLI.

soda test-connection -d my_datasource -c configuration.yml -V

Supported data types

Category	Data type
text	CHAR, VARCHAR, STRING
number	TINYINT, SMALLINT, INT, INTEGER, BIGINT, DOUBLE, FLOAT, DECIMAL
time	DATE, TIMESTAMP