Learn about the fields used to create an Azure Blob Storage connection with ThoughtSpot DataFlow.

Here is a list of the fields for an Azure Blob Storage connection in ThoughtSpot DataFlow. You need specific information to establish a seamless and secure connection.

Connection properties

Connection name
Name your connection.
Mandatory field.
Example:
AzureBlobAStorageConnection
Connection type
Choose the Azure Blob Storage connection type.
Mandatory field.
Example:
Azure Blob Storage
Storage type
Choose the Storage type: Azure Blob Storage (default) or Data Lake GEN2 Storage.
Mandatory field.
Account
Azure Storage has an address that includes our unique account name which is a combination of the account name and the Azure Storage blob endpoint forms the base address for the objects in your storage account.
Mandatory field.
Example:
userdi
Authentication type
This supports two types of authentication methods: Azure account key: Choose to authenticate based on access keys and other parameters to produce an encrypted signature stringthat is passed on the request in the Authorization header.Shared access signatures (SAS): Choose to grant fine-grained access to resources in your storage account with specified permissions and over a specified time interval.
Mandatory field.
Example:
Azure account key
Valid Values:
Azure account key Shared acess signature
Key
The 512-bit access key generated while creating storage account.
Mandatory field.
Example:
ABCDEFGH245HIJK
Container
Give container details that organizes a set of blobs, like a directory in a file system.
Mandatory field.
Example:
container

Sync properties

File name
Specify name of the file
Mandatory field.
Example:
testfile.csv
Valid Values:
Any string literal
Default:
The name of the file used to create sync
Other notes:
To specify wildcard pattern use '*' character in the file name
Column delimiter
Specifies the delimiter between the columns in the source file
Mandatory field.
Example:
,
Valid Values:
Any printable ASCII character or decimal value for ASCII character
Default:
The delimiter specified in sync
Enable archive on success
Specify if file needs to be archived once it is succeeded
Optional field.
Example:
No
Valid Values:
Yes, No
Default:
No
Delete on success
Specify if file needs to be deleted after execution is successful
Optional field.
Example:
No
Valid Values:
Yes, No
Default:
No
Compression
Specify this if the file is compressed and what kind of compressed file it is
Mandatory field.
Example:
gzip
Valid Values:
None, gzip
Default:
None
Enclosing character
Specify if the text columns in the source data is enclosed in quotes.
Mandatory field.
Example:
Single
Valid Values:
Single, Double, Empty
Default:
Empty
Escape character
Specify the escape character if using a text qualifier in the source data.
Optional field.
Example:
\\
Valid Values:
Any ASCII character
Default:
Empty
Null value
Specifies the string literal indicates the null value for a column. During the data load, the column value matching this string will be loaded as null in the target.
Optional field.
Example:
NULL
Valid Values:
Any string literal
Default:
NULL
Date style
Specifies how to interpret the date format
Optional field.
Example:
YMD
Valid Values:
YMD, MDY, DMY, DMONY, MONDY, Y2MD, MDY2, DMY2, DMONY2, and MONDY2
Default:
YMD
Other notes:
MDY: 2-digit month, 2-digit day, 4-digit year
DMY: 2-digit month, 2-digit day, 4-digit year
DMONY: 2-digit day, 3-character month name, 4-digit year
MONDY: 3-character month name, 2-digit day, 4-digit year
Y2MD: 2-digit year, 2-digit month, 2-digit day
MDY2: 2-digit month, 2-digit day, 2-digit year
DMY2: 2-digit day, 2-digit month, 2-digit year
DMONY2: 2-digit day, 3-character month name, 2-digit year
MONDY2: 3-character month name, 2-digit day, 2-digit year
Date delimiter
Specifies the separator used in the date format.
Optional field.
Example:
-
Valid Values:
Any printable ASCII character
Default:
-
Time style
Specifies the format of the time portion in the data.
Optional field.
Example:
24HOUR
Valid Values:
12HOUR, 24 HOUR
Default:
24HOUR
Time delimiter
Specifies the character used as separate the time components.
Optional field.
Example:
:
Valid Values:
Any printable ASCII character
Default:
:
Skip trailer rows
Skip the number of trailer rows specified while loading the data
Optional field.
Example:
5
Valid Values:
Any numeric value
Default:
0
TS load options
Specify additional parameters passed with the tsload command. The format for these parameters is:
--<param_1_name> <optional_param_1_value>
Optional field.
Example:
--max_ignored_rows 0
Valid Values:

--null_value ""
--escape_character ""
--max_ignored_rows 0
Default:
--max_ignored_rows 0
Reference:
tsload flag reference
Boolean representation
Specifies the representation of data in the boolean field
Optional field.
Example:
true_false
Valid Values:
true_false, T_F, 1_0, T_NULL
Default:
true_false

Dataflow tips