Bulk Data Export

Suggest Edits

Overview

The Bulk Data Export feature is designed to provide you with a streamlined and efficient way to export your data to your cloud storage. This service allows daily export of data regarding campaign information and ad performance, packaged in the efficient and fast parquet file format. This enables you to ingest large amounts of data without making requests to the Report API.

📘

Note

Bulk Data Export is currently not available to all customers. If you’re interested in using it, please contact your Moloco representative.

Export Schedule

The export schedule is configured for 6 A.M. local time to guarantee that the data from the previous day is fully complete and available for retrieval at your convenience.

🚧

Warning

Be aware that the data for the day of export is incomplete and subject to alteration due to the attribution process.

Export Timezone

Depending on your chosen timezone, we'll use the local time clocks for our daily data export jobs. For instance, if you pick US Eastern Timezone, we'll automatically use either Eastern Standard Time (EST) or Eastern Daylight Time (EDT). If you opt for Coordinated Universal Time (UTC), we'll base our daily processing on UTC.

📘

Note

During daylight saving time shifts, the daily export job will account for a 23-hour time window for the day. For example, on the second Sunday of March, the US East switches its clock to Eastern Daylight Time (UTC+4) from Eastern Standard Time (UTC+5). On the day daylight saving starts, the day's total hours will be 23.

Conversely, on the first Sunday of November, the region switches back to EST from EDT. On the day when daylight saving ends, the day's total hours will be 25.

Supported Use Cases

Currently, we support the bulk export of:

Data Lifecycle

The data can be downloaded for a period of up to 30 days.

Accessing Your Data

Your data will be exported to your cloud storage, and the transfer method can vary per cloud service. For detailed access instructions and support, refer to our guide (How to Transfer Data).

Data Format and Storage path

  • All data is stored in parquet format.
  • Storage path format: gs://{bucket}/{version}/{revision}/{data_type}/{date}/{file_name}.
    • Example: gs://mcm-export-moloco/v1/r0/report/2024-01-08/data-000000000000.parquet
ParametersDescription
{bucket}mcm-export-<platform>
{version}The version number can increase when breaking changes are introduced. For example, an exiting schema is changed, a new dataset is added, or any other significant changes or additions are made. (e.g., v1)
{revision}The revision number can increase by the change of feature configuration, not by implementation. A specific change or set of changes made to a current version due to customer-specific needs. (e.g, r1)
{data_type}The type of data exported. (e.g., campaign_digests, or report)
{date}YYYY-MM-DD (e.g,. 2024-01-08)
{file_name}Only parquet file format is supported. There can be multiple files. e.g., data-000000000000.parquet

Updated about 1 month ago