Snowflake

This guide contains information to set up a Snowflake Sink in Vanus Connect.

Introduction

Snowflake is a cloud-based data warehousing platform that allows users to store, manage, and analyze large amounts of structured and semi-structured data using a SQL interface.

Using Snowflake sink, you can receive EventClouds and effortlessly transfer them to your Snowflake warehouse.

Prerequisites

Before forwarding events to Snowflake, you must have:

• A Vanus Cloud Account.
• A Snowflake account with administrative privileges
• The user has either an ACCOUNTADMIN or SECURITYADMIN role in Snowflake.

Getting Started

备注

If you have a Snowflake account already, you can skip Step 1 and directly go to Step 2.

Step 1: (Optional) Creating a Snowflake Account

When you sign up for an account on Snowflake, you'll receive 30 days of free access and $400 credits. However, any usage beyond this limit will be charged. The free trial begins once you complete the sign-up process and activate your account.

If you end up utilising all $400 credits before the 30-day trial period is over, your account will be suspended, and you won't be able to use any of its features. You can still log in to your account, but you won't be able to perform any actions, such as running a virtual warehouse, loading data, or running queries.

Let's get started:

1. Go to Snowflake Sign Up

2. On the Sign Up page, provide the required details① and click CONTINUE②.

3. Select the Snowflake edition③ you want to use, choose your cloud provider④, select your preferred region⑤, agree to the Snowflake Self Service On Demand Terms⑥ and click GET STARTED⑦.

备注

To make an informed choice that aligns with your organisation's requirements, Snowflake offers multiple editions and supported cloud platforms. Please explore the Snowflake Editions documentation to understand the various edition options available. Additionally, for detailed pricing and specifics of each supported cloud platform, refer to the Supported Cloud Platforms documentation.

4. Click on Skip⑧ to continue your configuration.

5. An activation email from Snowflake has been sent to your registered email address. Click on CLICK TO ACTIVATE⑨ to activate your account.

6. Provide your preferred Username⑩ and Password⑪, Confirm Password⑫ and click Get started⑬.

---

Step 2: Obtain Essential Snowflake Data

1. Get your account URL by going to Admin① and Accounts② from the side menu. Afterward, click on the ellipsis icon③.

2. Select Manage Urls④.

3. Click on the chain-link icon⑤ to copy the URL, and then click Close⑥.

4. Navigate to the Worksheets⑦ page.

5. Click on the +⑧ button.

6. Select SQL Worksheet⑨.

7. Run the CREATE DATABSE my_db;⑩ command to create a database named MY_DB⑪.

8. Click on the ellipsis icon⑫ and click Refresh⑬ to reflect the changes.

9. Take note of your Role⑭ and Warehouse⑮, and then execute the SHOW SCHEMAS;⑯ command to identify the active schema⑰, which will be indicated by a Y⑱ next to its name in the is_current field.

备注

We utilized the default role, warehouse, and schema, but you have the option to create your own if you prefer.

Step 3: SnowFlake Connection Settings

1. Write the following information from the previous steps.

• Account URL①: This is the web address used to access and interact with your Snowflake data warehouse in the cloud.
• Role②: This is the Role name with the necessary privileges to perform operations on the Snowflake table.
• Warehouse③: This is the warehouse name that will execute queries for the Snowflake table.
• Database④: This is the name of the database that contains the Snowflake table.
• Schema⑤: This is the name of the schema that contains the Snowflake table.
• Username⑥: This is the username for your Snowflake account.
• Password⑦: This is the password for your Snowflake account.
• Table⑧: Generate a table by specifying the desired name for it, and the table will be set up with the required fields for your event.

Step 4: Personalize Event Structure

备注

This is a general instruction on how to personalize your event structure. You can structure your events to suit your specific requirements and create connections for different scenarios.

1. Click on Display sample events① for reference and click on Add More② to add events.

2. Input key③ and search for the corresponding value④ for the event you want.

3. You can fill in as many key-value pairs⑤ as you wish to receive, and then click Submit⑥ to finish the configuration process.

Required Data Format

The event data must be in JSON format with the following keys:

{
    "column1": "value1",
    "column2": "value2",
    "column3": "value3",
    "etc...": "etc..."
}