Skip to main content

​
Data License Ingestion

This page explains how to tell when a Data License delivery is fully complete and ready for ingestion. It is the single source of truth for delivery completion signals and automation best practices across Data License delivery methods.

​
What you should use

For every Data License delivery, the reliable completion signal is the top-level file named:
This file is generated only after the full delivery is finished. It is the file your automation should use to start ingestion.

​
Why COMPLETED matters

When the COMPLETED file exists:
  • ✅ All data files have been delivered
  • ✅ No additional files will be added to the delivery
  • ✅ It is safe to begin ingestion
Using COMPLETED avoids partial ingestion and inconsistent results.

​
Where COMPLETED appears

  • The file is placed in the parent/top-level folder for the delivery
  • It covers all files and subdirectories within that delivery
  • It appears for all supported delivery methods:
    • S3
    • Snowflake
    • Azure
    • GCP
    • Direct Download
Databricks delivery uses Delta Sharing rather than file transfer, so it does not produce a COMPLETED file. See Data Delivery Using Databricks for setup details.

​
Don’t Use: _SUCCESS

Some deliveries may also include _SUCCESS files inside nested folders. These files are not intended as a customer ingestion trigger because:
  • They are created per subdirectory
  • They can appear before the overall delivery is complete
  • They reflect internal PDL processing, not final delivery readiness
Do not trigger ingestion from _SUCCESS files. Use only the top-level COMPLETED file for automation.

  1. Monitor the delivery folder for COMPLETED
  2. When COMPLETED appears, start ingestion
  3. Process all files and subfolders in the delivery
  4. If COMPLETED is missing, do not ingest partial data
  5. If the delivery is delayed, contact your CSM or support team

​
Example delivery layout


​
When to contact support

If the COMPLETED file does not appear after you expect the delivery to be ready:
  • check your delivery notifications
  • verify that the delivery destination is correct
  • contact your Customer Success Manager

​
Why this is the best signal

COMPLETED provides a consistent ingestion trigger across delivery methods and avoids the confusion caused by _SUCCESS files appearing at different times. For delivery-specific setup and access instructions, see the relevant Data License delivery method pages.

Related topics

Data Delivery Using SnowflakeData Delivery Using GCPData Delivery Using S3Data Delivery Using Direct DownloadData Delivery Using Azure