Daily Deliveries (Job Posting Data)

What is this?

Daily Job Posting Data Deliveries enable customers to receive daily refreshes of PDL’s Job Posting Data.

Unlike traditional “push” deliveries, this is a pull-based system, meaning:

• Pull: Customers retrieve data from a PDL-hosted S3 bucket using credentials provisioned by PDL.
• Push: PDL delivers data directly to the customer’s S3 bucket or cloud storage.

This approach is intended to simplify the delivery process and likelihood of delivery errors due to logistical errors. With this approach, customers no longer need to manage or configure credentials to receive their data and can access it on-demand and as many times as needed.

⚠️

Important Notes

• Daily deliveries are currently only available for Job Posting Data.
• Initial access is limited to S3 buckets; future expansions will include Snowflake and other platforms.

How does it work?

Daily Job Posting Data is organized in a customer-specific S3 bucket. Each day has its own folder with the format:

YYYYMMDD_{major_version}_{minor_version}

Each daily release includes:

• COMPLETED files (which can be used to trigger data ingestion workflows)
• Delta files – organized into the following subfolders:
  • Added: New records (first_seen date after last release)
  • Updated: Records updated since last release (last_verified date)
  • Deactivated: Newly deactivated records (deactivated_date)
  • Deleted: Records removed since the previous release

Delivery Failures

⚠️

Beta Notice

Daily Job Posting Updates are currently in beta. Given the early-stage nature of this new delivery mechanism, customers should set expectations around:

• Occasional issues or missed daily updates
• Potential changes to delivery method or format based on feedback

Unlike monthly deliveries, daily deliveries only have one attempt per day. Potential failure scenarios include:

• Outages in partner crawls
• Data quality issues from partners
• Pipeline failures within PDL

In the event of a failed delivery the PDL Engineering team is constantly monitoring for quick fixes, but there may still be some days with no delivery.

Customers can configure notifications from their API Dashboard to be alerted in the case when data is not delivered.

Note that missed data will be backfilled in the next release window (usually the following day).

📘

Configuring Delivery Notifications

Customers can configure notifications via API Dash > License Delivery > Settings.

By default:

• Notifications for both successes and failures are enabled
• Customers can adjust settings to meet their preferences

How to Get Access

Daily Job Posting Data Deliveries are available as an add-on for Job Posting Data customers.

As of October 2025 (v32.0):

The feature is in open beta

• Feedback is welcomed to help improve delivery reliability and features
• Currently not available for Snowflake
• Only supported for Job Posting Data licenses

To sign up for beta access, reach out to your Customer Success team.