Area: Ingestion
Sub-Area: Structured Properties
Issue
Unexpected behavior was observed when working with structured properties in version 0.15.0.5, particularly around how structured properties were ingested, displayed, and managed. The behavior differed from earlier versions and was not functioning as previously documented.
You Might Be Asking:
- How have structured properties changed in recent versions?
- Why aren't my structured properties showing up?
- What's the correct format for ingesting structured properties?
Solution
The structured properties implementation has been corrected to match expected behavior. When ingesting structured properties:
# In your ingestion recipe
structured_properties:
- qualified_name: "io.mycompany.property_name"
value: "property_value"
valueType: STRING # or NUMBER, BOOLEAN, DATE, etc.
Via Python SDK:
from datahub.metadata.schema_classes import StructuredPropertiesClass
structured_props = StructuredPropertiesClass(
properties=[
{
"propertyUrn": "urn:li:structuredProperty:io.mycompany.property_name",
"value": "property_value"
}
]
)
Additional Notes
Fixed in version v0.3.12. Note that structured properties underwent schema changes between versions. Consult the migration guide if upgrading from versions prior to v0.3.10.
Related Documentation
Tags:
structured-properties, ingestion, metadata, schema, bug-fix, v0.3.12