Snapchat to Snowflake Integration: 2 Easy Methods

on Data Warehouses, Snapchat, Snowflake • July 27th, 2022 • Write for Hevo

Snapchat to Snowflake FI

Businesses are driven by data and as such, companies are investing resources in technologies that can help improve the way they react to the data being produced daily. One such way in which organizations are trying to derive valuable insight from data is by integrating available technologies with other platforms to make the most out of their data by gaining much-needed comprehension to drive businesses forward. 

This article is going to present easy methods by which you can connect Snapchat to Snowflake. Snapchat is a messaging platform that is used by millions around the world to share and upload images, text, and so on while Snowflake has become a household name when it comes to Data Warehousing.

Table of Contents

What is Snapchat?

Snapchat to Snowflake: snapchat logo
Image Source

Snapchat is a free downloadable messaging application predominantly used for sharing photos, videos, text, and drawings, it has become hugely popular, especially among young people. Snapchat allows you to send messages directly to an individual or through group messaging.

Snapchat is unique from other available messaging applications as it has features that allow you to express yourself with million of lenses, learn about the world through your map known as Snapchat maps, share your creativity, and most importantly, it enables messages to disappear quickly after some few seconds as they are only available for a short time before they become inaccessible by the recipients though, the details of the sender and the timestamp would still be visible as it remains. It also allows users to keep photos in a password-protected space known as my eyes only.

Key Features of Snapchat

Here are a few key features of Snapchat:

  • Drives Traffic: Snaps are designed to only last for a short amount of time. In spite of the fact that it seems to be somewhat ineffective, it can result in an increase in traffic. Adding a sense of urgency to your photographs by designing them to be deleted gives your audience a reason not to miss out on seeing them.
  • Boost Engagement: This is ideal for marketers who are organizing events, who want to highlight the culture of their business, or who want to use them in an integrated marketing effort. Those who want to use them in an integrated marketing effort can also benefit from this. You have the ability to create one-of-a-kind geofilters with Snapchat’s on-demand geofilters, which other users can then use.
  • Build Brand Awareness: Companies use Snapchat as an advertising medium of choice because the app is effective. Snapchat has more than 265 million daily active users, which means that the platform can help you reach a sizeable audience through entertaining advertisements, eye-catching filters, or compelling stories.

What is Snowflake?

Snapchat to Snowflake: snowflake logo
Image Source

Snowflake is a cloud-based Software-as-a-Service (SaaS) platform that offers cloud-based storage and analytics services. Its cloud data warehouse is built on Amazon Web Service,  Microsoft Azure, and Google infrastructure, providing a platform for storing and retrieving data. Snowflake has a unique architecture that separates its storage unit from its compute unit, thereby scaling differently so customers can use and pay for both independently. 

With Snowflake, there is no hardware or software to select, install, configure, or manage, therefore, making it ideal for organizations that do not want to have dedicated resources for setup, maintenance, and support for in-house servers. 

Since Snowflake decouples the storage and compute functions, it means you can have an unlimited number of concurrent workloads against a single copy of data and not interfere with the performance of other users, it is also highly scalable, flexible with big data, and the sharing functionality of Snowflake makes it easy for organizations to quickly share and secure data in real-time. For further information on Snowflake, visit the official website here.

Key Features of Snowflake

  • Scalability: Snowflake’s multi-cluster architecture facilitates separate computing and storage resources. This design allows it to scale up and down in accordance with business needs. Users of Snowflake also have access to auto-scaling features, enabling Snowflake to start and terminate clusters automatically during resource-intensive processes.
  • Better Analytics: By switching from nightly batch loads to real-time data streams, Snowflake helps optimize your analytics workflow. Providing safe, concurrent, and controlled access to your data warehouse throughout your organization may improve the quality of your analytics.
  • Cloning: Another key aspect of the Snowflake cloud data warehouse is cloning. The zero-copy functionality in Snowflake allows you to quickly clone any database or table without having to produce a new copy. It does it by keeping track of clone changes in its metadata store while still referring to the same data files in the backend.

Reliably Integrate data with Hevo’s Fully Automated No Code Data Pipeline

If yours is anything like the 1000+ data-driven companies that use Hevo, more than 70% of the business apps you use are SaaS applications Integrating the data from these sources in a timely way is crucial to fuel analytics and the decisions that are taken from it. But given how fast API endpoints etc can change, creating and managing these pipelines can be a soul-sucking exercise.

Hevo’s no-code data pipeline platform lets you connect over 150+ sources in a matter of minutes to deliver data in near real-time to your warehouse. What’s more, the in-built transformation capabilities and the intuitive UI means even non-engineers can set up pipelines and achieve analytics-ready data in minutes. 

All of this combined with transparent pricing and 24×7 support makes us the most loved data pipeline software in terms of user reviews.

Take our 14-day free trial to experience a better way to manage data pipelines.

Get started for Free with Hevo!

Methods to Connect Snapchat to Snowflake

With the integration of Snapchat to Snowflake, you can extract your marketing data from Snapchat, transform it, and load it seamlessly into Snowflake where your decision-making process will be greatly improved and quickly implemented.

Method 1: Connect Snapchat to Snowflake Using Hevo

Snapchat to Snowflake: hevo logo
Image Source

Hevo provides Amazon Redshift as a Destination for loading/transferring data from any Source system, which also includes Snapchat. You can refer to Hevo’s documentation for Permissions, User Authentication, and Prerequisites for Amazon Redshift as a destination here

Configure Snapchat as a Source

Configure Snapchat as the Source in your Pipeline for Snapchat to Snowflake Integration by following the steps below:

  • Step 1: In the Asset Palette, select PIPELINES.
  • Step 2: In the Pipelines List View, click + CREATE to connect Snapchat to Snowflake.
  • Step 3: Select Snapchat on the Select Source Type page.
  • Step 4: Click + ADD SNAPCHAT ADS ACCOUNT on the page that asks you to configure your Snapchat ads account to migrate Snapchat to Snowflake.
  • Step 6: To grant Hevo access to your Snapchat Ads data, click Continue.
  • Step 7: Enter the information below in the Configure your Snapchat Ads Source page:
    • Pipeline Name: A name for the Pipeline that is unique and does not exceed 255 characters. 
    • Select Organizations: The Snapchat company whose information you want to take in. You can choose from a variety of organizations.
    • Select Ad Accounts: The account for Snapchat Ads whose data you want to download. You can choose several Ad Accounts.
    • Historical Sync Duration: The time it takes for historical data to be synced with the Destination. 1 Year is the default value.
Snapchat to Snowflake: configure snapchat ads as source
Image Source
  • Step 8: TEST & CONTINUE is the button to click to connect Snapchat to Snowflake.
  • Step 9: Set up the Destination and configure the data ingestion.

Configure Snowflake as a Destination

To set up Snowflake as a destination in Hevo for Snapchat to Snowflake Integration, follow these steps:

  • Step 1: In the Asset Palette, select DESTINATIONS to integrate Snapchat to Snowflake.
  • Step 2: In the Destinations List View, click + CREATE.
  • Step 3: Select Snowflake from the Add Destination page to connect Snapchat to Snowflake.
  • Step 4: Set the following parameters on the Configure your Snowflake Destination page:
Snapchat to Snowflake: config redshift as destination
Image Source
  • Destination Name: Give your destination a unique name.
  • Database Cluster Identifier: The IP address or DNS of the Snowflake host is used as the database cluster identifier.
  • Database Port: The port on which your Snowflake server listens for connections is the database port. 5439 is the default value.
  • Database User: In the Snowflake database, a user with a non-administrative position.
  • Database Password: The user’s password.
  • Database Name: The name of the destination database into which the data will be loaded.
  • Database Schema: The Destination database schema’s name. The default setting is public.
  • Step 5: To test connectivity with the Snowflake warehouse, click Test Connection to connect Snapchat to Snowflake.
  • Step 6: When the test is complete, select SAVE DESTINATION.

Deliver Smarter, Faster Insights with your Unified Data

Using manual scripts and custom code to move data into the warehouse is cumbersome. Changing API endpoints and limits, ad-hoc data preparation and inconsistent schema makes maintaining such a system a nightmare. Hevo’s reliable no-code data pipeline platform enables you to set up zero-maintenance data pipelines that just work.

  • Wide Range of Connectors: Instantly connect and read data from 150+ sources including SaaS apps and databases, and precisely control pipeline schedules down to the minute.
  • In-built Transformations: Format your data on the fly with Hevo’s preload transformations using either the drag-and-drop interface, or our nifty python interface. Generate analysis-ready data in your warehouse using Hevo’s Postload Transformation.
  • Near Real-Time Replication: Get access to near real-time replication for all database sources with log based replication. For SaaS applications, near real time replication is subject to API limits.   
  • Auto-Schema Management: Correcting improper schema after the data is loaded into your warehouse is challenging. Hevo automatically maps source schema with destination warehouse so that you don’t face the pain of schema errors.
  • Transparent Pricing: Say goodbye to complex and hidden pricing models. Hevo’s Transparent Pricing brings complete visibility to your ELT spend. Choose a plan based on your business needs. Stay in control with spend alerts and configurable credit limits for unforeseen spikes in data flow.
  • 24×7 Customer Support: With Hevo you get more than just a platform, you get a partner for your pipelines. Discover peace with round the clock “Live Chat” within the platform. What’s more, you get 24×7 support even during the 14-dayfree trial.
  • Security: Discover peace with end-to-end encryption and compliance with all major security certifications including HIPAA, GDPR, SOC-2.
Get started for Free with Hevo!

Get Started for Free with Hevo’s 14-day Free Trial.

Method 2: Manually Connect Snapchat to Snowflake

Snapchat to Snowflake extraction can be done with a few clicks, after which you can build data pipelines and visualize your data using powerful data visualization tools.

Extracting data from Snapchat is done by using its marketing API which is available to developers as it has no restrictions on the minimum size and scope of what you want to build to maintain access to the platform. In this method, you will use the Snapchat Conversion API (CAPI) to illustrate this.

The Snapchat Conversion API is a structured interface that allows users to directly pass web, app, and offline events to Snap via a Server-to-Server (S2S) integration. You can do this on Snapchat through direct integration.

Direct Integration

This method of Snapchat to Snowflake Integration involves direct integration with the conversion API and it gives you control over the integration process but first, you have to activate the Marketing API. To activate access to Snapchat’s Marketing API, a business account would need to be set up, before doing the following: 

  • Step 1: Log in to Ads Manager.
  • Step 2: Click the menu in the top corner and select Business Details.
  • Step 3: Click +OAuth App.
  • Step 4: Click Agree to the terms and conditions to activate access.
  • Step 5: Click on Save.

Having done this, you then proceed to access Snapchat’s Conversion API in Snapchat to Snowflake Integration. To achieve this, a business account must be set up where you can generate a token on the business page of Ads Manager to make Conversion API calls. This is shown in the steps below:

  • Step 1: Log in to Ads Manager.
  • Step 2: Click the menu in the top corner and select Business Details.
  • Step 3: Under the OAuth App section, a section Conversion API Tokens would be visible, click on the Generate Token button to generate a new token.
  • Step 4: Copy the token to be used as an OAuth token and include the token header e.g Authorization: Bearer <<Newly generated Conversion API token>> to connect Snapchat to Snowflake.
  • Step 5: Multiple tokens can be generated and you can delete tokens to invalidate them.

When sending data through the Conversion API in Snapchat to Snowflake Integration, one or a combination of the following parameters are required to get a successful response and improve performance: hashed_email, hashed_phone, hashed_ip, and user_agent. Additional parameters which can be passed with each event, whether WEB, MOBILE_APP, or OFFLINE are listed here.

Using the API

As stated earlier, the Snapchat Conversion API allows the passing of web, app, and offline events to Snap through a Server-to-Sever integration in Snapchat to Snowflake Integration. These Conversions API requests are tied to unique identifiers that link the server events to your Snapchat ad account. Pixel ID is used for WEB and OFFLINE events while Snapchat App ID is used for APP events only. 

To have clean data, each identifier be it text email, mobile identifiers, IP addresses, or phone numbers should be normalized before hashing. This can be done by removing white spaces found at the beginning and end of email addresses, converting all characters to lower cases, including country codes in phone numbers, providing the UNIX timestamp calculated in seconds of the conversion event, etc.

Depending on the type of events you will be reporting to Snap in Snapchat to Snowflake Integration, you will be required to set up your Snap App ID or a Pixel ID. The ID determines the parameters you will pass when sending events.

The Web property carries a pixel_id and it shows events taking place on a web property like a website, the Mobile App property has a snap_app_id showing events taking place within an App, and finally, the Offline property has a pixel_id that measures events taking place in-store, over the phone or online but are not Pixable.

Below are examples of what a structured Conversion API request looks like for both Snap App ID and Pixel ID in Snapchat to Snowflake Integration.

{
   "pixel_id":"783c04c9-cd00-485a-ab54-02f0832dfc24",
   "timestamp":"1645723911000",
   "event_type":"VIEW_CONTENT",
   "event_conversion_type":"WEB",
   "event_tag": "badger_tunneling",
   "page_url":"https://www.example.com/tunneling",
   "hashed_email":"20e468ca5f7903e80fe3aa79ac3b8f1436f99163a9802b55891f38be95b7959e",
   "user_agent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.5 Safari/605.1.15",
   "hashed_ip_address":"1150a143ae46d77bca2f9f4429f8c65d4d746edc37b769b044659b820493d0db"
}

Example of Conversion API for Pixel ID in Snapchat to Snowflake Integration:

{
   "snap_app_id":"fb5b83ec-c593-4a64-9c6d-a0eb9da0edba",
   "app_id":"447188370",
   "timestamp":"1636574053",
   "event_type":"PAGE_VIEW",
   "event_conversion_type":"MOBILE_APP",
   "event_tag": "instore",
   "device_id":"9ec84f2eddcff338084a8c51808a45034c9286dc427a4cb01b8688b7b823be28",
   "user_agent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.5 Safari/605.1.15",
   "hashed_ip_address":"1150a143ae46d77bca2f9f4429f8c65d4d746edc37b769b044659b820493d0db"
}

Example of Conversion API for Pixel ID in Snapchat to Snowflake Integration

The expected response for both cases would be seen as displayed below.

{
   "status": "SUCCESS",
   "reason": "All records processed"
}

Further examples of Conversion APIs used for various purposes in Snapchat to Snowflake Integration are shown below.

curl -X POST -H "Content-Type: application/json" \
  -H "Authorization: Bearer meowmeowmeow" \
  -d '{
    "app_id": "447188370",
    "snap_app_id": "3984298349849",
    "timestamp": "1521504154084",
    "event_type": "APP_INSTALL",
    "event_conversion_type": "MOBILE_APP",
    "event_tag": "appsignups",
    "transaction_id": "3409181200909",
"hashed_mobile_ad_id": "9543d100cf0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4aaa",
"hashed_email": "f13ff72f0a7cf3f0d187f4e4f6c41110e4bbd2d7560ede70ca68bd0b8b7fdc15",
"hashed_phone_number": "d10cad0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4aaa",
"hashed_idfv": "d10cad0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4aca",
    "user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X x.y; rv:42.0) Gecko/20100101 Firefox/42.0",
"hashed_ip_address": "d10cad0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4bbb",
}' \
  https://tr.snapchat.com/v2/conversion

App Install Conversion for Snapchat to Snowflake Integration

curl -X POST -H "Content-Type: application/json" \
  -H "Authorization: Bearer meowmeowmeow" \
  -d '{
    "app_id": "447188370",
    "snap_app_id": "3984298349849",
    "timestamp": "1521504154084",
    "event_type": "PURCHASE",
    "event_conversion_type": "MOBILE_APP",
    "event_tag": "retention",
    "price": "43",
    "currency": "usd",
    "transaction_id": "3409181200909",
"hashed_mobile_ad_id": "9543d100cf0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4aaa",
"hashed_email": "f13ff72f0a7cf3f0d187f4e4f6c41110e4bbd2d7560ede70ca68bd0b8b7fdc15"
"hashed_phone_number": "d10cad0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4aaa",
"hashed_idfv": "9543d100cf0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4aaa",
    "user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X x.y; rv:42.0) Gecko/20100101 Firefox/42.0",
"hashed_ip_address": "9543d100cf0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4aaa",
}' \
  https://tr.snapchat.com/v2/conversion

App Purchase Conversion for Snapchat to Snowflake Integration

curl -X POST -H "Content-Type: application/json" \
  -H "Authorization: Bearer meowmeowmeow" \
  -d '{
    "pixel_id":"67d34640-b7a4-42a8-b821-6434d70f08a4",
    "timestamp": "1521504154084",
    "event_type": "PAGE_VIEW",
    "event_conversion_type": "WEB",
    "event_tag": "web_traffic",
    "user_agent": Mozilla/5.0 (Macintosh; Intel Mac OS X x.y; rv:42.0) Gecko/20100101 Firefox/42.0",
"hashed_ip_address": "d100cf0775a3926d66cfbc557941a79c81370b019e5c927063e99b8e4aad",
}' \

  https://tr.snapchat.com/v2/conversion

Web Page View Conversion

The expected response for the examples above is displayed below.

{
   "status": "SUCCESS",
   "reason": "All records processed"
}

For more information about Snapchat Conversion APIs and its parameter description for each event and more examples, visit here.

Conclusion

This article has looked at how to integrate Snapchat to Snowflake. It mentioned how this could be done through direct integration that involved setting up Snapchat’s Conversion API. It concluded by walking you through the process and showing code snippets for various Conversion API endpoints like app purchase conversion, web page view conversion, app install conversion, etc. alongside possible responses.

However, as a Developer, extracting complex data from a diverse set of data sources like Databases, CRMs, Project management Tools, Streaming Services, and Marketing Platforms to your Database can seem to be quite challenging. If you are from non-technical background or are new in the game of data warehouse and analytics, Hevo Data can help!

Visit our Website to Explore Hevo

Hevo Data will automate your data transfer process, hence allowing you to focus on other aspects of your business like Analytics, Customer Management, etc. Hevo provides a wide range of sources – 150+ Data Sources (including 40+ Free Sources) – that connect with over 15+ Destinations. It will provide you with a seamless experience and make your work life much easier.

Want to take Hevo for a spin? Sign Up for a 14-day free trial and experience the feature-rich Hevo suite firsthand.

You can also have a look at our unbeatable pricing that will help you choose the right plan for your business needs!

No-Code Data Pipeline for Snowflake