Ingestion Issues
Troubleshooting guides for DataHub metadata ingestion from various sources
- Large Dataset Ingestion Lag and Eventual Consistency
- Snowflake Tag Extraction with Lineage Configuration
- SQLite Version Error After DataHub SDK Upgrade
- Domain Entity Does Not Support Soft Deletion
- AWS Glue Ownership Information Not Appearing in DataHub
- How to Extract Logs and Query Dumps from Remote Executor for Debugging
- Snowflake Ingestion - Handling Large View Counts (10,000+ Views)
- Hex Ingestion Causing "Too Many Calls" API Error
- S3 Folder-Level Ingestion Failures
- Snowflake Profiling Showing Incorrect Numbers
- Structured Properties Support Issues in v0.15.0.5
- Outdated Lineage Edges Not Being Removed
- MCE Consumer Errors in Logs
- BigQuery Remote Executor Missing QualifiedName Property
- Redshift Ingestion Connection Errors
- Extra Pip Libraries Field Not Respected in Ingestion
- ETL Tool Integration (Apache Spark, Flink)
- Materialized Views and View Lineage
- Ingestion Performance Tuning and Optimization
- Dataset Profile and Statistics Missing
- Ingestion Recipe Secret Management
- Cross-Platform Lineage and URN Mapping
- Query Translation and SQL Lineage Parser Errors
- S3 Data Lake Metadata Ingestion
- Airflow Lineage Integration
- Unity Catalog (Databricks) Metadata Sync
- AWS Glue Catalog Integration Issues
- Trino/Presto Query-Based Lineage Extraction
- File-Based Lineage Ingestion Format Issues
- Column-Level Lineage Not Extracting