Overview

When Snowflake as a data source is enabled in your account, Cordial automatically queries one or multiple tables and/or views in your Snowflake warehouse on a regular interval. Cordial automatically detects any new or updated customer records and updates those records in our system. This keeps your customer data in sync with Snowflake cloud data for real-time segmentation and personalization, eliminating the need for a separate integration between your cloud warehouse and messaging platform.

Additional benefits

• Full refresh syncs used by one-time data jobs as well as incremental syncs using recurring data job automations to leverage real-time data.
• Load contact and supplement data into Cordial.
• Customize data refresh intervals.
• Write transformation scripts to further modify data as it comes into Cordial.

Use cases

You can send data from Snowflake to Cordial via the UI by selecting Snowflake as a destination for:

• Data Jobs and Transformations
• Message reports
• Event Data Reports
• Audience Trends data
• Dashboard data

Create a table in your Snowflake account

In your Snowflake account, create a table to store the customer data you want to use in Cordial. Here are some important settings to keep in mind when creating your table in Snowflake:

• At minimum, you must have read-only access to the table in Snowflake and access to the specific table or view that will send data to Cordial.
• Cordial is unable to ingest binary table columns.
• Set a specific maximum length in your table/view for VARCHAR columns. Column size limit is 8kb or VARCHAR(8192).
• Your table/view must be set to convert nanoseconds (default in Snowflake) into microseconds (default in Cordial) in order to successfully transfer date attributes.

Geo attributes

Geo attributes should be represented as separate columns. For example, geo attribute homeaddress would be broken up into columns such as:

• homeaddress.street_address
• homeaddress.city
• homeaddress.state
• homeaddress.postal_code

Array attributes

Array attributes will be updated as a whole unless additional syntax is included to add or remove an item from an array, as follows:

• Remove from array: { "remove": ["apple"] }
• Add to array: { "add": ["apple"] }

Your table/view must be set to convert nanoseconds (default in Snowflake) into microseconds (default in Cordial) in order to successfully transfer date attributes.

Enable Snowflake as a data source

1. Log in to Cordial, navigate to Integrations > Partners, and select Enable on the Snowflake card.

2. Fill in the required information:

• Snowflake account identifier (format should be [organization]-[identifier])
• Warehouse name
• Username
• Authentication method: Password or Saved key
• Role name
• Database name
• Schema name
• Table or view name

Connection parameters are case sensitive and should match the exact case of the named objects—warehouse, user, role, database, table/view, or schema—in Snowflake.

3. To add a table/view, click Add Table/View.

4. Click Test Connection. If it's successful, select Continue.

Saved key authentication

Select this method if you want to use key-pair authentication in Snowflake.

1. You first need to create a secret (aka saved key) in Cordial by navigating to Settings > Account Settings > Secrets Vault > New.

2. Your new secret will include a Public key (PEM format).

3. Update the user in the Snowflake by pasting in the Public key (PEM format) of your created secret.

Don't include the -----BEGIN PUBLIC KEY----- and -----END PUBLIC KEY----- that appear with your PEM key. These are markers for where the key begins and ends, not part of the PEM key.

4. In the export job from Cordial, select Saved Key as the authentication method and choose your Cordial secret under Saved key.

Send data from Snowflake to Cordial

1. Once you've successfully enabled Snowflake as a source, navigate to Data Jobs > Create New Data Job, select the appropriate Data Job, and fill in the required fields.

2. Select Edit in the Data Source pane.

3. Choose External under Data Source.

4. Choose Snowflake under Data location.

5. Choose the appropriate Snowflake connection and Snowflake table/views.

Cordial will automatically query Snowflake at a specified interval, updating modified records and inserting any new records since the last sync. You can configure your data refresh interval to occur every 15 minutes, every 30 minutes, every hour, every week, or every month to optimize access to real-time data.

6. Choose the sync type: Full refresh or Incremental.

Sync types

One-time Data Jobs only support full refresh syncs. Data Job Automations support both full refresh and incremental syncs.

Full refresh

• Used in one-time data jobs and recurring Data Job automations.
• Selects all records from the Snowflake table.
• Query doesn't have WHERE and ORDER parts.

Incremental

• Used in recurring Data Job automations.
• Cordial stores sequence (last updated date from last imported row) as {prevValue}
• Select the desired Cursor field from the dropdown.
• The cursor value is not repeated between syncs option controls how Cordial selects records for the incremental sync.

If the cursor field has unique values, such as unique IDs, we can simplify the process and select all the new records. But if the cursor field is not unique, such as a timestamp or date, Cordial skips one or more records with the maximum value.

In the examples below, UPDATED_AT and ORDER_ID are cursor fields:

• If you select The cursor value is not repeated checkbox, Cordial creates a query like this:

SELECT ... WHERE ORDER_ID  {prevValue}

• If the checkbox is not selected, Cordial runs a query like this:

SELECT ... WHERE UPDATED_AT  {prevValue} AND UPDATED_AT <(select max(updated_at)="max(UPDATED_AT)" from="FROM" {table})="{table})"></(select>

The second example means Cordial doesn't import at least one row with max(UPDATED_AT).

API support

The following Cordial endpoints support Snowflake as a data source:

• POST/v2/contactimports
• POST/v2/supplements/{supplement}/imports

•   {
     "source":{
        "transport":"snowflake",
        "connection":"same_name_used_in_marketplace_setup",
        "tableview":"same_table_view_name_used_in_marketplace_setup"
     },
     "hasHeader":true,
     "confirmEmail":"msmith@example.com"
  }
  

Disable connection

To stop the sync, you can disable the connection by clicking Configure on the Snowflake Integrations card and selecting the Disable button. When the connection is re-enabled, the job will continue looking for all records that were inserted or updated since the last sync.