Dataset Application Dropdown Limited to 1000 Results – DataHub Customer Support Portal

Area: UI Issues

Sub-Area: Dataset Management Interface

Issue

When editing dataset applications through the DataHub UI, the application selector dropdown only displays the first 1000 applications available in your instance. If your organization has more than 1000 applications, those beyond this limit will not appear in the dropdown, making them unselectable through the standard UI workflow.

You Might Be Asking

Why can't I see all my applications in the dropdown when editing dataset applications?
How do I assign an application to a dataset when it doesn't appear in the selection list?
Is there a limit on how many applications DataHub can handle?

Solution

This limitation was addressed in DataHub v0.3.17.x and later versions. The solution depends on your current version:

For DataHub v0.3.17.x and Later (Recommended)

Upgrade to DataHub v0.3.17.x or later, which includes server-side search functionality
The updated application selector now supports:
- Server-side lazy loading with search capabilities
- Debounced search input (300ms delay)
- 3-character minimum before switching from wildcard to keyword search
- Support for organizations with 10,000+ applications

Workarounds for Older Versions

If you cannot upgrade immediately, you can use these alternatives:

API/GraphQL Assignment:

mutation batchSetApplication {
  batchSetApplication(input: {
    resources: ["urn:li:dataset:(,,PROD)"]
    application: "urn:li:application:"
  })
}

Python SDK Assignment:

from datahub.emitter.mce_builder import make_dataset_urn, make_application_urn
from datahub.emitter.rest_emitter import DatahubRestEmitter

emitter = DatahubRestEmitter("")

dataset_urn = make_dataset_urn("", "")
application_urn = make_application_urn("")

# Set application for dataset
emitter.emit_mcp(
    MetadataChangeProposal(
        entityUrn=dataset_urn,
        entityType="dataset",
        changeType=ChangeTypeClass.UPSERT,
        aspectName="applications",
        aspect=Applications(applications=[application_urn])
    )
)

Search Filtering: Use the search box in the dropdown to filter through the 1000 loaded applications (client-side filtering only)

Additional Notes

This was a design limitation in the original SetApplicationModal component, not a regression. The 1000-application limit was hardcoded in the initial implementation. Organizations with large numbers of applications should prioritize upgrading to v0.3.17.x or later for the best user experience. The API and Python SDK methods have no such limitations and can handle any number of applications.