Ingestion Issues
Troubleshooting guides for DataHub metadata ingestion from various sources
- Airflow Plugin Generating Airflow 1.x-Style URLs for "Open in Airflow" Button on Airflow 2.x
- Domain-Scoped Ingestion Policies and Transformer Ordering: Why Newly Created Entities Get 403 Errors
- Resolving Snowflake Ingestion Failures with HTTP 400 Errors from Large Lineage Payloads
- Fixing Duplicate dbt URNs Caused by URN Casing Changes Breaking Sibling Lineage
- Tag Associations Visible on Assets But Missing from Tag Picker: Emitting Tag Entities vs. Associations
- Fixing Snowflake Lineage Gaps When Staging Tables Are Denied and OpenLineage Naming Is Malformed
- Resolving Incomplete or Broken Lineage When Using dbt with Snowflake in DataHub
- dbt Ingestion Stateful Ingestion and Pipeline Name Best Practices to Avoid Excessive Soft-Deletions
- Configuring dbt Artifact Ingestion from Cloud Storage (GCS, S3) into DataHub
- Removing Ingested User Emails from Looker Ingestion in DataHub
- How to Export Ingestion Recipes from the DataHub UI to YAML Files
- Snowflake Ingestion Failing Due to Incorrect Allowlist or Denylist Regex Patterns
- Configuring AWS Secrets Manager with DataHub Remote Executor for Snowflake Connections
- System Ingestion Jobs Failing to Download acryl-datahub Wheel for a Specific Version
- dbt tags_to_structured_properties Transformer Not Working Due to Stateful Ingestion Skipping
- Snowflake MCP Connector Not Appearing: OAuth Resource URL and Integration Setup
- Metrics Ingestion from Snowflake Blocked by Deprecated Classifier Feature Pinning CLI Version
- Ingestion Jobs Stuck in Pending Status Due to Remote Executor SQS Connectivity Issues
- Skipping MLflow ML Model Ingestion in Databricks to Speed Up Ingestion
- Redash Ingestion Fails or Times Out Due to Long Run Duration and Executor Restarts
- Enabling Lineage Between dbt and AWS Glue in DataHub: URN Alignment and Column Lineage
- Power BI Ingestion Returns 401 Unauthorized When Admin-Consent Power BI Permissions Are Present on the App Registration
- Power BI Column-Level Lineage Missing Due to Column Name Case Mismatch
- Lineage Missing After Adding Platform Instance to Databricks or Fivetran Ingestion
- Tableau Ingestion Hangs or Times Out: Debugging Project Pattern Regex, PAT Sharing, Virtual Connections, and Node Limits
- Tableau Ingestion Fails with Invalid SchemaField URN Error
- Kafka Connect Debezium Ingestion Discovers 0 Tables When Platform Instance Is Configured
- Kafka Topic Schema Not Showing in DataHub: Avro Parsing and Inconsistent Schema Handling
- Multi-Cloud Ingestion: Connecting a Single DataHub Instance to Both AWS and Azure Sources
- Soda Quality Check Duplication in DataHub UI When Adding or Renaming Check Names