Export Data from Insider One to Azure Blob Storage

Prev Next

The data export feature allows you to efficiently export large volumes of your Insider One event data directly to your Azure Blob Storage container.

In this guide, you will find answers to the following questions:

Requirements

After completing these prerequisites, you can proceed to configure the integration and start sending your data to Azure Blob Storage.

  • A Microsoft Azure Storage Account where you intend to store your data.

  • A Blob Service Container created within that Storage Account.

  • The Connection String for the Storage Account (found under Access Keys), with permissions that allow creating objects in the container you will use to retrieve the data.

Create an Azure Storage account

  1. Navigate to the Azure Portal.

  2. Search for Storage accounts.

  3. Open the Resources tab and create a new Storage Account.

  4. Once the Storage Account is created, return to the Resources tab and select the Storage Account you just created.

  5. To create a container. Navigate to Storage Browser > Blob Containers and click + Add Container.

  6. After the container is created, go to Security + networking > Access keys and copy the Connection String.

How can I launch the integration?

  1. Navigate to InOne > Components > Integrations > External Platform Integrations.

  2. Search for the Microsoft Azure Blob Storage integration and select it.

  3. In the Authentication step, provide the following:
    - Connection String: Paste the Connection String you copied from your Storage Account.

    - Container Name: Enter the name of the container you created.

    - Blob Path Prefix (Optional): Enter a prefix to organize your data within the container. If left empty, data will be written to the container root.

  4. Click Verify Authentication to validate the credentials. If you encounter an issue, a message at the top of the page will explain the authentication error in detail. Once the credentials are validated, click Save and Continue.

  5. In the configure step, select one or more events to trigger your integration in the tabs.

  6. After you select the first event type you want to trigger the data collection, you can see the events based on the type and select or deselect the ones you want to collect. You can also add other event types via the same section.

    To select the journey event’s name parameter, you need to use journey_campaign_name as the event parameter’s key.

  7. The Event Parameter section will be enabled after you select an event. You can select your events’ parameters through the dropdown that you want to send to your storage.

  8. You can select additional attributes to include in the data sent to your storage destination. Use this step to enrich your event data with extra details.

    For example, when sending an email open event, you can also include the email address. This helps you identify which users opened specific email campaigns.

  9. In the Launch step, you can adjust your sync frequency and activate your campaign. Once the campaign is activated, after the first sync, you will see a CSV file in your specified container.

  • Anonymous user events are also included in the CSV file.

  • If a user is created and then deleted within the sync period, their data will still appear in the CSV.

When creating a new Microsoft Azure Blob Storage integration or editing the current one, Insider One performs an automated test to verify the integration works correctly by placing a test file in the specified bucket.

If the provided credentials lack permissions to delete objects, the test file cannot be removed and will remain in the bucket after the test.

This is a one-time occurrence during the activation of the Microsoft Azure Blob Storage integration. You can manually delete the test file if needed.

If your Microsoft Azure Blob Storage integration encounters a Credential Error, the integration will stop immediately and no new data will be delivered while the error persists. It’s also important to note that after you resolve the error, the file names sent to storage may change, as they will follow the current timestamp sequence from the moment the integration resumes.

What are the Azure Blob Storage integration details?

Integration Type

Event Export. This integration involves exporting event data.

File Format

{account_name}{export_type}{integration_id}{start_date}{end_date}.csv

  • {account_name}: The name of the account in the InOne panel used for the integration.

  • {export_type}: Indicates the type of export (e.g., events).

  • {integration_id}: Integration id

  • {start_date}: Start date of the exported data range.

  • {end_date}: End date of the exported data range.

The exported file will be in CSV (Comma-Separated Values) format. You can see an example file below:

Microsoft Azure Blob Storage Export Example
1.06 KB

Export Periods

  • Specify the intervals at which data will be exported.

  • You can choose export periods of 1, 2, 4, 6, 12, or 24 hours based on your reporting or analysis needs.

The Raw Export logs events based on their actual timestamp, regardless of when they are recorded in the User Content Database (UCD). In contrast, the Azure Blob Export captures events within specific intervals, like the past hour, according to their UCD entry time.
For example, the event counts displayed on the Metadata Analytics page represent all transmissions sent to UCD. Sending the same event 100 times results in only one entry in the database, but shows a transmission count of 100 on the page, while Raw Export will show only 1.

If an event was timestamped three days ago but sent today, it will appear in Azure Blob Export, like the last hour, based on the current transmission timeframe.

You can create up to 5 total destination integrations across Amazon S3 Export, Google Cloud Storage (GCS) and Microsoft Azure Blob. This is a shared, dynamic limit. For example, you might use all 5 for S3, or split between S3, GCS and Azure as needed. If you reach the total limit, you must remove an existing integration before adding a new one.

Pause Azure Blob integration

To pause your Azure Blob integration,

  1. Go to the Launch step of your Azure Blob Integration on InOne.

  2. Select Activation Status as Paused and Save as Paused.