The DoubleClick (DC) Data Transfer (DT) can be setup to provide access to clicks, impressions and activities (conversions) at a 'network' or 'advertiser' level. Where a network represents a grouping of advertisers, whereas advertiser is a single advertiser.
Oftentimes, agencies will have one or more DC networks with all their managed clients (advertisers) within. When granted access to a network, Abakus will sequester data and only process and use data from the advertisers where we have a contractual relationship. All other data remains unprocessed.
If an agency prefers to perform their own sequestering, this article summarizes how Abakus performs the sequestering of DCM log files so that it can be implemented through 3rd party automation.
The basic idea is to process all click, impression and activity files and filter out rows of data that are not associated with advertisers that Abakus will process. The file naming conventions will not change.
File Naming Conventions
The following highlights the naming conventions of DCM network log files:
- Activity - dcm_account<network_id>_
- Click - dcm_account<network_id>_click_
- Impressions - dcm_account<network_id>_
- Match Tables - dcm_account<network_id>_match_
Identify Floodlight Configurations
Download and unzip the most recent version of the match table: dcm_account<network id>_match_table_advertisers_
The following is the high-level summary of sequestering logic that should be built.
Step 1. Sequester Activity File(s)
For each row in the daily activity file, discard row when the Floodlight Configuration (Column W) is not in the list of Valid IDs.
Step 2. Sequester Click File(s)
For each row in the hourly click file, use the dcm_account<network id>_match_table_advertisers_
Step 3. Sequester Impression File(s)
For each row in the hourly impression file, use the dcm_account<network id>_match_table_advertisers_
Step 4. Pass on Match Table Files
Given there is no means to sequester the lookup tables, these files will be passed on in their entirety.
Step 5. Upload to Storage
Once files have been processed according to the above logic, they should be placed on an FTP, SFTP, S3 or GCS storage location to be agreed to with Abakus.