Frequently asked questions about bringing offline data into Audience Manager.
Can you summarize the onboarding process?
The onboarding process consists of 2 core components described in the Technical Specifications for Inbound Batch Data Transfers. These involve:
Below is a list of questions and answers you might find helpful after reviewing the documentation.
Can you summarize the deployment process?
We recommend the following:
What FTP mode should I use to transfer compressed or encrypted files?
Can I upload an inbound data file (.sync or .overwrite file) before deploying Audience Manager code into production?
Consider the following use cases in which the data provider is not configured to use Profile Merge:
On Monday, a visitor identified in the CRM database as visitor ABC logs in, which initiates a client-side ID sync. Audience Manager stores the mapping of visitor ABC to Audience Manager visitor 123.
On Tuesday, the CRM database transfers a data file (.sync) to the Audience Manager server with the following record:
In this case, Audience Manager:
On Monday, the CRM database pushes a data file (.sync) to the Audience Manager server with the following record:
Audience Manager does not have a record of this visitor (or an associated visitor ID) so this record is not processed.
On Tuesday, visitor DEF logs in. This action initiates the first client-side ID sync for that visitor. This action maps visitor DEF to Audience Manager ID 456. However, this visitor does not have CRM data associated with their profile. As a result, Audience Manager does not go back and reprocess old files.
On Wednesday, the CRM database pushes another data file to the Audience Manager server with the following record:
In this case, Audience Manager:
What time of day should I transfer my file?
Audience Manager checks for and processes files multiple times throughout the day. Upload your data whenever you're ready.
How long does it take before data from an uploaded file is available for targeting?
Data is available for targeting after 48 hours. Also, do not interpret the "successful upload" email as a statement that the data is available. This only means that Audience Manager has picked up the file and completed the first step of processing.
How often should I send files and should these be full or incremental files?
As a best practice, send an incremental file once per day for new visitors and for visitors whose data has changed. Many Audience Manager customers send a full file once per month. However, these file intervals and increments are flexible. You should send data in increments and at times that make sense for you.
How long does Audience Manager keep my files on the server?
FTP files are removed after they've been processed. S3 files are removed after 30-days. Files that cannot be processed due to format, syntax, or other errors are removed. See also, Privacy and Data Retention FAQ.
What's the difference between full and incremental files?
The following use cases demonstrate how these file types affect stored visitor profiles.
Incremental and Full
For more information about full and incremental file types, see:
What happens if I send in a file with IDs for visitors that have never performed the on-page ID sync?
During processing, Audience Manager simply skips that record and moves on to the next. If a DPID (Data provider ID) is set up as a cross-device DPID, data that is ingested before an ID sync is saved and is available for use shortly after the ID sync occurs.
What is the time stamp, what is it for, and can you provide an example?
Time stamps are used for logging and record keeping. They are required by the syntax used for a properly formatted inbound file name. See:
What is a Data Provider ID (DPID) and how do I get it?
Your Adobe consultant will assign a three-digit or four-digit DPID to your particular data source. This ID is unique and does not change.
How large can the daily data files be?
Does Audience Manager support file compression?
The primary key in my data source database is an email address. Is that considered personally identifiable information?
Yes. Audience Manager does not store email addresses in our database. Visitors should be assigned a random ID or a one-way-hashed version of the email address prior to initiating ID syncs.
Are the data file contents case-sensitive? How about the ID sync?
There are two basic components of a data file: A Unique User ID (UUID) and profile data, usually in the form of key-value pairs or codes. The UUID is case-sensitive. Generally, profile or key-value data is not case-sensitive.
Should I use FTP or Amazon S3 to transfer files?
As best practice, we recommend Amazon S3 because the process is simpler. Audience Manager transfers FTP files to S3 regardless, so the process is more streamlined if you drop the files on Amazon S3 yourself. What's more, customers uploading simultaneously to FTP share the FTP's bandwidth, so they should expect slower upload speeds. Amazon S3 is also replicated and distributed, so it is generally safer and more reliable than an FTP server. For more information, see Amazon S3: About.