> For the complete documentation index, see [llms.txt](https://docs.soda.io/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.soda.io/integrations/collibra.md).

# Collibra

The **Soda↔Collibra optimized integration** synchronizes data quality checks from Soda to Collibra, creating a unified view of your data quality metrics. The implementation is optimized for performance, reliability, and maintainability, with support for bi-directional ownership sync and advanced diagnostic metrics.

### Key features

* **High Performance**: 3-5x faster execution through caching, batching, and parallel processing
* **Custom Attribute Syncing**: Flexible mapping of Soda check attributes to Collibra attributes for rich business context
* **Ownership Synchronization**: Bi-directional ownership sync between Collibra and Soda
* **Deletion Synchronization**: Automatically removes obsolete check assets from Collibra when checks are deleted in Soda
* **Multiple Dimensions Support**: Link checks to multiple data quality dimensions simultaneously
* **Monitor Exclusion**: Option to exclude Soda monitors from synchronization, focusing only on data quality checks
* **Diagnostic Metrics Processing**: Automatic extraction of diagnostic metrics from any Soda check type with intelligent fallbacks
* **Robust Error Handling**: Comprehensive retry logic and graceful error recovery
* **Advanced Monitoring**: Real-time metrics, performance tracking, and detailed reporting
* **CLI Interface**: Flexible command-line options for different use cases
* **Backward Compatibility**: Legacy test methods preserved for smooth migration

<figure><img src="/files/ZcAx87zDGM8tcvglN4Ji" alt=""><figcaption><p>Rulebook-level <strong>collection of Soda checks</strong> synced and mapped into <strong>Collibra</strong></p></figcaption></figure>

## Quickstart

> For technical details on how to configure the bi-directional Collibra integration, head to [Setup & configuration](/integrations/collibra/setup-and-configuration.md).

### Prerequisites

* **Python 3.10+** required
* Valid Soda Cloud API credentials
* Valid Collibra API credentials
* Properly configured Collibra asset types and relations

### Basic Usage

```bash
# Run the integration with default settings
python main.py

# Run with debug logging for troubleshooting
python main.py --debug

# Use a custom configuration file
python main.py --config custom.yaml

# Show help and all available options
python main.py --help
```

### Advanced Usage

```bash
# Run legacy Soda client tests
python main.py --test-soda

# Run legacy Collibra client tests
python main.py --test-collibra

# Run with verbose logging (info level)
python main.py --verbose
```

## How It Works

### 1. **Optimized Dataset Processing**

* **Smart Filtering**: Only processes datasets marked for synchronization
* **Parallel Processing**: Handles multiple operations concurrently
* **Caching**: Reduces API calls through intelligent caching
* **Batch Operations**: Groups similar operations for efficiency

### 2. **Enhanced Check Processing**

For each check in a dataset:

#### **Asset Management**

* **Bulk Creation/Updates**: Processes multiple assets simultaneously
* **Duplicate Handling**: Intelligent naming to avoid conflicts
* **Status Tracking**: Monitors creation vs. update operations

#### **Attribute Processing**

* **Standard Attributes**: Evaluation status, timestamps, definitions
* **Diagnostic Metrics**: Automatically extracts and calculates diagnostic metrics from check results
* **Custom Attributes**: Flexible mappings for business context (see [Custom Attribute Syncing](https://github.com/sodadata/soda-collibra-integration/blob/main/documentation.md#-custom-attribute-syncing))
* **Batch Updates**: Groups attribute operations for performance

#### **Relationship Management**

* **Dimension Relations**: Links checks to data quality dimensions
* **Table/Column Relations**: Creates appropriate asset relationships
* **Error Recovery**: Graceful handling of missing or ambiguous assets

### 3. **Ownership Synchronization**

* **Collibra to Soda Sync**: Automatically syncs dataset owners from Collibra to Soda
* **User Mapping**: Maps Collibra users to Soda users by email address
* **Error Handling**: Tracks missing users and synchronization failures
* **Metrics Tracking**: Monitors successful ownership transfers

### 4. **Advanced Error Handling**

* **Retry Logic**: Exponential backoff for transient failures
* **Rate Limiting**: Intelligent throttling to avoid API limits
* **Error Aggregation**: Collects and reports all issues at the end
* **Graceful Degradation**: Continues processing despite individual failures

***

> Head to [Setup & configuration](/integrations/collibra/setup-and-configuration.md) to learn how to integrate Collibra.

***

{% if visitor.claims.plan === 'datasetStandard' %}
{% hint style="success" %}
You are **logged in to Soda** and seeing the **Dataset Standard license** documentation. Learn more about [Documentation access & licensing](/reference/documentation-access-and-licensing.md).
{% endhint %}
{% endif %}

{% if visitor.claims.plan === 'enterprise' %}
{% hint style="success" %}
You are **logged in to Soda** and seeing the **Team license** documentation. Learn more about [Documentation access & licensing](/reference/documentation-access-and-licensing.md).
{% endhint %}
{% endif %}

{% if visitor.claims.plan === 'enterpriseUserBased' %}
{% hint style="success" %}
You are **logged in to Soda** and seeing the **Enterprise license** documentation. Learn more about [Documentation access & licensing](/reference/documentation-access-and-licensing.md).
{% endhint %}
{% endif %}

{% if !(visitor.claims.plan === 'enterprise' || visitor.claims.plan === 'enterpriseUserBased' || visitor.claims.plan === 'datasetStandard') %}
{% hint style="info" %}
You are **not logged in to Soda** and are viewing the default public documentation. Learn more about [Documentation access & licensing](/reference/documentation-access-and-licensing.md).

If you do have a Soda license, make sure to **log in to Soda Cloud in this same browser**.
{% endhint %}
{% endif %}


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.soda.io/integrations/collibra.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.