Parquet

Parameters

Required parameters are in red and Optional parameters are in blue.

---

• directory, the folder location to write Parquet files to

---

• compression, the method used to compress data
  default: GZIP ( allowed: GZIP, SNAPPY )

---

Serverless Requirements

If you're running CS Tools    serverless, you'll want to ensure you install these    python requirements.

Don't know what this means? It's probably safe to ignore it.

How do I use the Syncer in commands?

CS Tools accepts syncer definitions in either declarative or configuration file form.

_{Find the copy button to the right of the code block.}

  Declarative   Configuration File

Simply write the parameters out alongside the command.

cs_tools tools searchable metadata --syncer "parquet://directory=." --config dogfood

^{* when declaring multiple parameters inline, you should wrap the enter value in quotes.}

1. Create a file with the .toml extension.

   syncer-overwrite.toml

   [configuration]
   directory = "."
   compression = "GZIP"
   

   ^{* this is a complete example, not all parameters are required.}

2. Write the filename in your command in place of the parameters.

   cs_tools tools searchable metadata --syncer parquet://syncer-overwrite.toml --config dogfood