Connect Soda to Dremio
Last modified on 20-Nov-24
For Soda to run quality scans on your data, you must configure it to connect to your data source.
To learn how to set up Soda and configure it to connect to your data sources, see Get started.
Compatibility
Soda supports Dremio version 22 or greater.
Connection configuration reference
Install package: soda-dremio
data_source my_datasource_name:
type: dremio
host: 127.0.0.1
port: 5432
username: simple
password: simple_pass
schema: public
use_encryption: "false"
routing_queue: queue
disable_certificate_verification: "false"
| Property | Required | Notes |
|---|---|---|
| type | required | Identify the type of data source for Soda. |
| host | required | Provide a host identifier. |
| port | required | Provide a port identifier. |
| username | required | Consider using system variables to retrieve this value securely. |
| password | required | Consider using system variables to retrieve this value securely. |
| schema | optional | Provide an identifier for the schema in which your dataset exists. |
| use_encryption | optional | Specify a boolean value to use, or not use, encryption. Default is false. Value requires double quotes. |
| routing_queue | optional | Provide an identifier for the routing queue to use. |
| disable_certificate_verification | optional | Specify a boolean value to demand that Dremio verify the host certificate against the truststore. If set to true, Dremio does not verify the host certificate. Default value is false to verify certificate. Value requires double quotes. |
Test the data source connection
To confirm that you have correctly configured the connection details for the data source(s) in your configuration YAML file, use the test-connection command. If you wish, add a -V option to the command to returns results in verbose mode in the CLI.
soda test-connection -d my_datasource -c configuration.yml -V
Supported data types
| Category | Data type |
|---|---|
| text | CHAR, VARCHAR, STRING |
| number | TINYINT, SMALLINT, INT, INTEGER, BIGINT, DOUBLE, FLOAT, DECIMAL |
| time | DATE, TIMESTAMP |
Was this documentation helpful?
What could we do to improve this page?
- Suggest a docs change in GitHub.
- Share feedback in the Soda community on Slack.
Documentation always applies to the latest version of Soda products
Last modified on 20-Nov-24