ID Changelog

To read more about our persistent ID logic please consult our Persistent IDs page.

version_status Field

Data license customers will have an additional field appended to each data license profile, a version_status for the ID. This object will track the pervious and current dataset version, any other persistent IDs that were merged into this record using improved entity resolution, and the status of the record. Records still existing in the dataset can have one of three statuses added, updated, or unchanged. Records can also have a null version_status if they are not in any of our license datasets.

ID Changelog

An additional changelog including all six statuses (moved, opted_out, and deleted records included) will also be provided as a flat file in a public AWS bucket here. Example schemas are also provided:

Status             Frequency       Description                                                              
added commonThis record was not in a previous build
deleted very rareThis ID was removed due to a source-level removal
moved variableLess common then added/updated, will vary from build to build based on linkage improvements
opted_out very rareThis ID was removed due to an opt out on our website.
unchanged commonNo new data sources have been added to the record. However parsing/standardization improvements may have been made
updated commonA new data sources contributed to this record

Additional Metadata

Some of the statuses listed in the table above will also contain some additional metadata:

Metadata Field

Corresponding Version Status

Description

contains

updated

The persistent IDs of any records that existed in a previous version and have been merged together before or during the current version.

to

moved

The persistent ID that this record has been assigned in the current version.

{
    "previous_version": "14.0",
    "current_version": "15.0",
    "status": "added",
    "additional_meta": None
}
{
    "previous_version": "14.0",
    "current_version": "15.0",
    "status": "deleted",
    "additional_meta": None
}
{
    "previous_version": "14.0",
    "current_version": "15.0",
    "status": "moved",
    "additional_meta": {
        "to": "abcabc"
    }
}
{
    "previous_version": "14.0",
    "current_version": "15.0",
    "status": "opted_out",
    "additional_meta": None
}
{
    "previous_version": "14.0",
    "current_version": "15.0",
    "status": "unchanged",
    "additional_meta": None
}
{
    "previous_version": "14.0",
    "current_version": "15.0",
    "status": "updated",
    "additional_meta": {
        "contains": ["123123",...]
    }
}

Did this page help you?