November 2024 Release Notes (v28.1)

Release NameDataset VersionPublish Date
November 2024v28.111/05/2024

v28.1 was released on November 5 2024.

📘

November 2024 (v28.1) is a Minor Release

Since January 2022 (v17), PDL has been releasing data updates every month with a major release every quarter. Minor releases (such as v26.2) typically contain fewer product updates or key changes, but still contain important data improvements.

Welcome to our November 2024 release notes! We have some exciting updates to share this month:

Here are the key highlights:

Excited yet? Read on to learn more, or jump to a specific section using the table of contents below.

Table of Contents

❗Breaking Changes

✨ New Products and Features

🚀 Data Updates

🛠 Improvements and Bug Fixes


❗Breaking Changes

⚠️ Upcoming Breaking Changes

🚧

Upcoming Breaking Changes

These are upcoming breaking changes in future versions that may impact your current processes. We are announcing them here to provide ample time for you to adjust your processes accordingly.

⚠️ New Role and Sub Role Job Title Taxonomy (Person / Company / IP)

Change expected in: February 2025

Previous Announcements: v26 / April 2024, v27.0 / July 2024, v27.1 / August 2024, v27.2 / September 2024, v28.0 / October 2024

Products Impacted: Person / Company / IP Schema

Person Fields ImpactedCompany Fields ImpactedIP Fields Impacted
job_title_role
job_title_sub_role
experience.title.role
experience.title.sub_role
average_tenure_by_role
employee_count_by_month_by_role
employee_count_by_role
recent_exec_departures
recent_exec_hires
top_next_employers_by_role
top_previous_employers_by_role
person.job_title_role
person.job_title_sub_role

Last month (v28.0), we officially released our new Role and Sub Role Job Title Taxonomy for full General Availability to all customers. With the GA release of this new taxonomy, the previous (legacy) taxonomy has now entered its deprecation period with support fully ending as of February 2025 (v29.1).

⚠️

Legacy Taxonomy will be fully deprecated in February 2025

In February 2025 (v29.1), PDL datasets for all customers will be transitioned to the new taxonomy.

To access the new taxonomy, customers must explicitly opt-in for v28.1, v28.2, and v29.0 (Nov - Jan releases) by reaching out to your Account team to enable these fields in your data deliveries. API customers can access the new taxonomy by using a new updated_title_roles parameter in their API requests. Existing customers still using the legacy taxonomy can choose to delay opting-in to receive the new taxonomy until the legacy taxonomy is fully deprecated in the v29.1 release.

Our Recommendations

If you are an existing customer who has not yet evaluated the new taxonomy:

  • Please reach out to receive a sample as soon as possible.
  • Opt-in to the new taxonomy and begin transitioning your systems to the new taxonomy. The January 2025 (v29.0) release will be the last supported release that you will be able to receive the legacy taxonomy. In February (v29.1), all customers will be transitioned to the new taxonomy. Connect with your CS and TS team to plan and coordinate your migration process.
  • If you are an API customer, you can begin accessing the new taxonomy by including a new updated_title_roles parameter in your API requests and setting it to True.

If you an existing customer who has already begun evaluating the data or participated in the beta release:

  • Continue or begin your migration process. We strongly encourage you to fully transition your systems to using the new taxonomy as early as possible ahead of the February 2025 deprecation to provide time to address any unforeseen transition challenges you run into.

If you are a new customer or you do not currently use any of the fields impacted by this change:

  • In February (v29.1), you will be automatically transitioned to the new taxonomy.
  • Again, if you are an API customer, you can access the new taxonomy by including a new updated_title_roles parameter in your API requests and setting it to True.

Timeline

Given the scope of the changes, our goal is to provide clear visibility on the process and ample opportunity to work through this transition together. The projected timeline for this release is as follows:

  • July 2024 - Breaking Change Announcement and Resource Launch:
    • Public notice of our planned role / subrole transition and initial resources provided (see below)
  • August 2024 - Beta:
    • We will open up beta access to the new role / subrole taxonomy as well as a new data field title.class
    • Customers will be able to test sample data from our Technical Services team to explore the new taxonomy and the potential data impacts
    • We will release a guide documenting our recommended best practices for transitioning to the new taxonomy with the beta release as well
  • October 2024 - General Availability:
    • We will make the new role / subrole taxonomy generally available for all customers and begin the deprecation process for the previous taxonomy
    • Customers can opt in to accessing the new taxonomy via API (using a new updated_title_roles parameter) and flat file deliveries. Customers will have the ability to delay transitioning until their systems are updated
  • ⏭️ February 2025 - Final Deprecation:
    • We will fully deprecate and officially end support for the previous taxonomy
    • All new and existing customers will be moved onto the new role / subrole taxonomy.

Resources

Please use the following resources to better understand the upcoming changes and to start preparing for the transition. As always, reach out to your Customer Success and Technical Services teams for questions and support.

The new set of canonical classes, roles, and subroles is here:

The mapping from the current role/subrole taxonomy to the improved taxonomy is here:

Sample records using the updated role / subrole taxonomy are here:


⚠️ New Release Schedule (All Products)

Change expected in: v29.0 / January 2025
Products Impacted: All PDL Products

Beginning in January 2025 (v29.0), we will be modifying the schedule for our releases, shifting the release date by 15 days to the middle of the month.

Currently, all releases (major and minor) occur on the first Tuesday of every month. Under the new schedule, all releases will occur on the third Tuesday of the month, with the first release following this new schedule occurring on January 21, 2024 (v29.0).

Why are we making this change?
The primary goal for this change is to increase the freshness of our Company Insights data, which summarizes aggregate employee headcounts to the “last completed month” of data. Shifting our release schedule by half a month allows us to calculate the aggregated headcount totals immediately after the completion of a month. The end result is that we will be able to report our Insights data with an extra month’s worth of information in each data release.

Timeline

❗️

Notice that between v28.2 and v29.0 there will be an additional gap of half a month as we shift from one release schedule to the other.

Release VersionRelease DateComments
v28.0Oct 1, 2024First Tuesday of the Month
v28.1Nov 5, 2024First Tuesday of the Month
v28.2Dec 3, 2024First Tuesday of the Month
v29.0Jan 21, 2025Third Tuesday of the Month
v29.1Feb 18, 2025Third Tuesday of the Month

⚠️ Deprecation of gics_sector (Company)

Change expected in: v29.0 / January 2025
Products Impacted: Company

Company Fields Impacted
gics_sector

In January 2025 (v29.0), we will be removing the gics_sector field from our data. This change will only impact a subset of records in our company dataset.

Currently, this field is only populated in ~27.8k PDL company records (0.003% of our company dataset) since it is derived from the self-identified industry sector reported in the filings of public companies. This field is redundant with other self-reported industry fields contained in our company records (which have much higher coverage). As a result, we have made the decision to deprecate this field in favor of our other industry field representations.

For customers interested in continuing to source public company sector information, we recommend the following resources:

  • Free web sources:
  • Paid API and programmatic resources:

⚠️ Deprecation of version_status (Person)

Change expected in: v29.0 / January 2025
Previous Announcements: v17.0 / January 2022

Products Impacted: Person

Person Fields Impacted
version_status

In January 2025 (v29.0), we will be removing the version_status field from our person dataset.

We officially deprecated this field in January 2022 (v17.0). While this field has continued to exist in our data since then, we have introduced more reliable references to a profile’s history / lineage across releases via the recommended alternatives below. As such, we are fully removing this field from our schema.

Recommended Alternatives
For customers that were using the version_status field to lookup the current version of the data, please use the dataset_version field available in both our Person and Company records.

For customers using this field to understand the change history of records, please use the ID Changelogs (Person / Company) for the relevant monthly / quarterly time period that you are looking to compare against.

⚠️ Free Tier Restructure for Self-Serve Plans

Change expected in: v29.0 / January 2025

Products Impacted: Person

In January 2025, we will be restructuring all existing free-tier plans to limit access to specific fields in our Person datasets. This change impacts all self-serve customers with free tier plans created before July 29, 2024.

Back in July 2024, we made the decision to limit access for new free tier plans to certain person fields that were prone to exploitation for unauthorized and potentially nefarious use cases. Based on the usage patterns we’ve observed since then, we have made the decision to migrate all legacy free tier users to this new free tier plan.

This migration will go into effect in January 2025, after which the person fields shown in the table above will be converted from values to true/false flags. To continue accessing these fields, customers will need to upgrade to a Pro plan with at least $100 minimum monthly commitment.

Example Free Tier Field

Legacy Plan (Pre-Migration)New Plan (Post-Migration)
”work_email”: “[email protected]”work_email”: true


✨ New Products and Features

Custom Insights Professional Services (Company Schema)

This month, we are excited to publicly announce the beta release of our Custom Insights Professional Services. This service allows users to augment PDL company data records with customized headcount breakdowns and insights fields tailored to the specific employee groups and personas you care about.

So far, we’ve seen customers use these customized headcount breakdowns across a variety of use cases including:

  • Automating territory mapping processes for sales reps
  • Building targeted Account-Based Marketing and GTM strategies
  • Conducting competitive intelligence and strategic market research
  • And more

How it works

The Custom Insights service is provided through our Technical Services team. Our team will first work with you to scope and refine your desired persona definitions, Insights fields and output format or schema based on your unique needs.

📘

Example Persona Definition: AI / ML Engineer

As an example, if you were interested in tracking the number of AI/ML Engineers across different companies you could define a custom persona using:

  • Job titles (such as “ML Engineer”, “AI Engineer”, etc)
  • Job Roles / Sub Role (such as “Engineering”)
  • Seniority Levels
  • Geographic Regions (such as “United States”)

Using these definitions, our team can then generate tailored Insights fields and headcount breakdowns, which will be included in your PDL company records with each delivery (exactly the same way as our standard Insights fields are delivered).

Furthermore, using our integrations with Salesforce, Snowflake and Databricks, you can seamlessly integrate this Custom Insights data into any type of data workflow no matter how simple or complex.

Getting started

If you are interested in learning more about Custom Insights or would like to try it out, please reach out to your Customer Success team!


🚀 Data Updates

📘

November 2024 is a Minor Release

As a reminder, November 2024 is a minor release. This means that the information reported below is based off of the last one month of updates (rather than the 3 months of updates we typically report for the major releases).

Freshness

The number of jobs and locations verified in our datasets over the past month (based on the job_last_verified and location_last_updated fields).

DatasetGeographyFieldRecords Updated
ResumeGlobalexperience153,804,702
ResumeGloballocation219,467,192
ResumeUnited Statesexperience22,746,934
ResumeUnited Stateslocation39,101,330

Job Changes

The number of person records where the primary job experience changed in our Person Dataset over the past month (based on the job_last_changed field).

DatasetGeographyFieldRecords Updated
ResumeGlobalexperience2,056,292
ResumeUSlocation620,697

Coverage (Full Stats: Person, Company)

Resume Dataset

LinkageCoverage in v28.0Coverage in v28.1Increase (%)
total_records727,795,179724,408,322-0.47%
twitter_url11,779,92612,755,6138.28%

API Dataset

LinkageCoverage in v28.0Coverage in v28.1Increase (%)
total_records2,466,332,6442,462,408,799-0.16%

Email Dataset

LinkageCoverage in v28.0Coverage in v28.1Increase (%)
total_records636,349,646637,512,3950.18%
twitter_username10,020,55611,107,83110.85%

Mobile Phone Dataset

LinkageCoverage in v28.0Coverage in v28.1Increase (%)
total_records566,067,759587,370,3963.76%
work_email30,044,56431,935,0636.29%
twitter_url4,353,2654,740,8528.90%

Company Dataset

LinkageCoverage in v28.0Coverage in v28.1Increase (%)
total_records71,340,27871,418,1150.11%
alternative_domains5,680,9446,196,5749.08%

Commentary

  • We saw a 9% increase in our coverage of alternative_domains in our company dataset as a result of adding new sources of company website information and improvements to our logic for selecting primary websites for company records
  • We saw a 6% increase in our linkage between emails and mobile phones

🛠 Improvements and Bug Fixes

Improvements

  • We made improvements to our profile deduplication logic by adding a new internal key for identifying profiles. This identifier supported with 4M profile merges in the current build, and will continue to increase helping with entity resolution in future builds
  • We adjusted our name cleaner to support more uncommon names in person records
  • We made improvements to our standardization for non-english job titles (such as French)

Bug Fixes

  • We fixed a bug that was leading to errors in how we tagged a company’s primary HQ location that was discovered in v27.2
  • We fixed a bug leading to incorrectly tagging some large, public companies with a revenue range $0-$1M
  • We fixed a bug in our School dataset that lead to some Schools having facebook urls in the linkedin_url field
  • We fixed a bug leading to incorrect locations in some person profiles due to parsing errors.