Skip to content

Snowflake

Snowflake is a powerful cloud-based data warehouse that makes it super easy to store, analyze, and share your company's data. It can handle massive amounts of information, from traditional spreadsheets to complex, unstructured data like web logs and sensor readings. The key thing that sets Snowflake apart is its unique architecture.

Instead of having a single, monolithic database, Snowflake separates the storage of your data from the computing power needed to analyze it. This means you can scale up or down the amount of processing power you use without having to worry about moving or reorganizing your data.

Snowflake parameters

Required parameters are in red and Optional parameters are in blue.

  • username, your Snowflake username
  • warehouse, the name of a Snowflake warehouse you have accces to
  • role, the name of a Snowflake role you have access to
  • authentication, the type of authentication mechanism to use to connect to Snowflake
    ( allowed: basic, key-pair, sso, oauth )
  • database, the database to write new data to
    if tables do not exist in the database.schema location already, we'll auto-create them
  • schema, the schema to write new data to
    if tables do not exist in the database.schema location already, we'll auto-create them
  • secret, the secret value to pass to the authentication mechanism
    this will be either a password or oauth token
  • private_key_path, full path to an encrypted private key file
  • log_level, the noisiness of the underlying Snowflake sql driver
    default: warning ( allowed: debug, info, warning )
  • temp_dir, location to write temporary files prior to staging to Snowflake
    default: CS_TOOLS.TEMP_DIR (your temporary directory in the CS Tools configuration)
  • load_strategy, how to write new data into existing tables
    default: APPEND ( allowed: APPEND, TRUNCATE, UPSERT )
How do I use the Snowflake syncer in commands?

cs_tools tools searchable bi-server --syncer snowflake://account_name=...&username=...&secret=...&warehouse=WH_DATA_LOADS_XS&role=DATA_OPERATIONS&database=GO_TO_MARKET&authentication=basic

- or -

cs_tools tools searchable bi-server --syncer snowflake://definition.toml

Definition TOML Example

definition.toml 

[configuration]
account_name = '...'
username = '...'
secret = '...'
warehouse = 'WH_DATA_LOADS_XS'
role = 'DATA_OPERATIONS'
database = 'GO_TO_MARKET'
schema = 'CS_TOOLS'
authentication = 'basic'
load_strategy = 'truncate'