Area: Ingestion Issues
Sub-Area: Snowflake Ingestion / Metrics Entity Configuration
Issue
When attempting to ingest Snowflake Semantic View metrics into DataHub's Metrics entities, metrics may fail to appear even after upgrading the CLI to a version that supports Metrics ingestion. This occurs because a previously configured Classifier feature in the Snowflake ingestion recipe pins the CLI to an older version (e.g., 1.6.x), overriding any manual CLI version selection. Since the pinned older CLI does not include support for Metrics entity ingestion from Semantic Views, no metric data flows through regardless of other configuration changes. Additionally, the Metrics entities feature itself must be explicitly enabled in DataHub Cloud environments before any metric data can be received or displayed.
Error Messages
No metrics ingested from Snowflake Semantic Views despite CLI upgrade
You Might Be Asking
- Why are my Snowflake Semantic View metrics not appearing in DataHub after I upgraded the CLI?
- Why is my Snowflake ingestion still using an old CLI version even though I set a newer one?
- How do I enable the Metrics entities feature in DataHub Cloud?
- Does using the Classifier feature in Snowflake ingestion affect which CLI version is used?
Solution
-
Enable the Metrics entities feature flag in your DataHub Cloud environment.
The Metrics entities feature (which provides first-class
MetricandSemanticModelentity types, dedicated entity pages, and sidebar navigation) is opt-in and must be enabled by DataHub Support or Cloud Engineering for your managed environment. Contact DataHub Support to request that the feature flag be enabled for your production instance. Once enabled, the Metrics section will appear in the DataHub sidebar. -
Identify whether a Classifier configuration is pinning your CLI version.
Navigate to the DataHub UI and open your Snowflake ingestion source settings. Check whether a Classifier (or any deprecated feature) is configured that forces a specific, older CLI version. The pinned version will override your intended CLI version for all ingestion runs from that source.
In the ingestion source configuration, look for a section similar to:
executor_id: <your-executor-id> version: 1.6.0.5 # <-- This pin is set by the Classifier feature and blocks Metrics ingestion -
Remove the deprecated Classifier feature from your ingestion recipe.
The
Classifierfeature is deprecated and its use prevents upgrading to newer CLI versions that support Metrics ingestion. Remove the Classifier configuration block from your Snowflake ingestion recipe. A simplified example of a recipe before and after the fix:Before (Classifier present — pins CLI to older version):
source: type: snowflake config: account_id: "<your-snowflake-account>" username: "<your-username>" password: "<your-password>" role: "<your-role>" warehouse: "<your-warehouse>" classification: enabled: true # Additional deprecated Classifier settings... sink: type: datahub-rest config: server: "https://<your-instance>.datahubproject.io/api/gms"After (Classifier removed — CLI version no longer pinned):
source: type: snowflake config: account_id: "<your-snowflake-account>" username: "<your-username>" password: "<your-password>" role: "<your-role>" warehouse: "<your-warehouse>" sink: type: datahub-rest config: server: "https://<your-instance>.datahubproject.io/api/gms" -
Set the CLI version to one that supports Metrics ingestion (1.7.0 or later).
In the DataHub UI, navigate to your Snowflake ingestion source and update the CLI version to
1.7.0or the latest available version. This can be done in the ingestion source's advanced settings. For DataHub Cloud managed environments, the default CLI version may be updated automatically over time; confirm the target version with DataHub Support.# Example: Specifying CLI version in ingestion source advanced settings (UI or API) version: "1.7.0" -
Re-trigger your Snowflake ingestion run.
After removing the Classifier and confirming the correct CLI version is in use, manually trigger a new ingestion run for your Snowflake source. Once the run completes successfully, Semantic View metrics should flow into the Metrics entities in DataHub.
-
Verify metrics are appearing in DataHub.
Navigate to the Metrics section in the DataHub sidebar and confirm that metrics derived from your Snowflake Semantic Views are now visible.
Additional Notes
- The Classifier feature in Snowflake ingestion is deprecated. Its continued use not only pins the CLI to an older version but may also cause other compatibility issues with newer DataHub features. It is strongly recommended to remove it from all ingestion recipes.
- The Metrics entities feature (
MetricandSemanticModelentity types) requires DataHub Cloud version 2.1.0 or later and must be explicitly enabled by DataHub Support for managed cloud environments. Self-hosted users should consult the relevant release notes for feature flag configuration. - CLI version and server version should be kept in alignment. Using a CLI version significantly older than your DataHub server version may result in missing support for newer entity types, aspects, or ingestion capabilities.
- In DataHub Cloud managed environments, the default CLI version for all ingestion sources is periodically updated. Pinning a specific version via deprecated features or manual overrides may prevent your environment from receiving these updates automatically.
- If you require the classification functionality previously provided by the deprecated Classifier feature, consult the DataHub documentation for the recommended replacement approach using DataHub's native classification capabilities.
Related Documentation
- Metrics and Semantic Models Feature Guide
- DataHub Cloud Release Notes — v2.1.0 (Metrics Feature)
- DataHub Cloud Overview
- Snowflake Ingestion Source Reference
- UI-Based Ingestion Configuration
Tags: snowflake, metrics, semantic-models, ingestion, cli-version, classifier, feature-flag, datahub-cloud, snowflake-semantic-views, ingestion-pinning