You can use the DataBricks client to customize Databricks Delta Lake connections in DataFlow.
To use Databricks client with DataFlow, you must have the following versions of Python:
- Python 3: you must have version 3.6 or above
- Python 2: you must have version 2.7.9 or above
Follow these steps to install the Databricks client:
- Run the
pip install databricks-cli
command using the appropriate version ofpip
for your Python installation.
For Python 3:
#sudo pip3 install databricks-cli
For Python 2:
#sudo pip install databricks-cli
- Restart dataflow services.
#tscli --adv service restart dataflow