Learn about the fields used to create Databricks Delta Lake connection with ThoughtSpot DataFlow.
Here is a list of the fields for an Databricks Delta Lake connection in ThoughtSpot DataFlow. You need specific information to establish a seamless and secure connection.
Connection properties
- Connection name
- Name your connection.
- Mandatory field.
- Example:
AzureDatabricksConnection - Connection type
- Choose the Azure Dtabricks connection type.
- Mandatory field.
- Example:
Azure Databricks - Server Hostname
- Specify the hostname of the Databricks server
- Mandatory field.
- Example:
www.example.com - Port
- Specify the port associated with the system.
- Mandatory field.
- Example:
1234 - Default:
443 - HTTP path
- Specify the HTTP Path.
- Mandatory field.
- Example:
abcservice - Protocol
- Specify the remote server connection
- Mandatory field.
- Example:
https - Valid Values:
https, http - Default:
https - Cluster id
- Specify the canonical identifier for the cluster
- Mandatory field.
- Example:
1234 - Access token
- Specify the access token to authenticate Databricks API.
- Mandatory field.
- Example:
ABCDEFGH245HIJK - DBFS stage location
- Specify the mount storage object location
- Mandatory field.
- Default:
/dataflow/stage
Sync properties
- Column delimiter
- Specify the column delimiter character.
- Mandatory field.
- Example:
1 - Valid Values:
Any printable ASCII character or decimal value for ASCII character - Default:
1 - Enclosing character
- Specify if the text columns in the source data needs to be enclosed in quotes.
- Optional field.
- Example:
DOUBLE - Valid Values:
SINGLE, DOUBLE - Default:
DOUBLE - Other notes:
This is required if the text data has newline character or delimiter character. - Escape character
- Specify this if the text qualifier is mentioned. This should be the character which escapes the text qualifier character in the source data.
- Optional field.
- Example:
\" - Valid Values:
Any ASCII character - Default:
\" - TS load options
- Specifies the parameters passed with the
tsloadcommand, in addition to the commands already included by the application. The format for these parameters is:--<param_1_name> <optional_param_1_value>--<param_2_name> <optional_param_2_value> - Optional field.
- Example:
--max_ignored_rows 0 - Valid Values:
--null_value ""--escape_character ""--max_ignored_rows 0 - Default:
--max_ignored_rows 0