Snowflake
Snowflake is a powerful cloud-based data warehouse that makes it super easy to store, analyze, and share your company's data. It can handle massive amounts of information, from traditional spreadsheets to complex, unstructured data like web logs and sensor readings. The key thing that sets Snowflake apart is its unique architecture.
Instead of having a single, monolithic database, Snowflake separates the storage of your data from the computing power needed to analyze it. This means you can scale up or down the amount of processing power you use without having to worry about moving or reorganizing your data.
Snowflake parameters
Required parameters are in red and Optional parameters are in blue.
- account_name, your Snowflake account identifier
for most customers, this is your account name
if you are using Privatelink, use the format<account>.<region>.privatelink
- username, your Snowflake username
- warehouse, the name of a Snowflake warehouse you have accces to
- role, the name of a Snowflake role you have access to
- authentication, the type of authentication mechanism to use to connect to Snowflake
( allowed:basic,key-pair,sso,oauth)
- database, the database to write new data to
if tables do not exist in the database.schema location already, we'll auto-create them
- schema, the schema to write new data to
if tables do not exist in the database.schema location already, we'll auto-create them
default:PUBLIC
- secret, the secret value to pass to the authentication mechanism
this will be either a password or oauth token
- private_key_path, full path to an encrypted private key file
- log_level, the noisiness of the underlying Snowflake sql driver
default:warning( allowed:debug,info,warning)
- temp_dir, location to write temporary files prior to staging to Snowflake
default:CS_TOOLS.TEMP_DIR(your temporary directory in the CS Tools configuration)
- load_strategy, how to write new data into existing tables
default:APPEND( allowed:APPEND,TRUNCATE,UPSERT)
How do I use the Snowflake syncer in commands?
cs_tools tools searchable bi-server --syncer snowflake://account_name=...&username=...&secret=...&warehouse=WH_DATA_LOADS_XS&role=DATA_OPERATIONS&database=GO_TO_MARKET&authentication=basic
- or -
cs_tools tools searchable bi-server --syncer snowflake://definition.toml
Definition TOML Example
definition.toml