Using Git folders with Databricks extension for Visual Studio Code

The Databricks extension for Visual Studio Code supports working with files in Databricks Git folders within the Azure Databricks workspace. Databircks Git folders was the default sync before version 0.3.15, but is no longer recommended.

Files in Git folders is enabled by default in all Azure Databricks workspaces, but can be disabled by admins using the REST API. Contact your workspace administrator if you cannot access this functionality.

Set the repository

If you choose to use a Databricks Git folder instead of a workspace directory in your Azure Databricks workspace, then with the extension and your code project opened, and an Azure Databricks configuration profile already set, use the Databricks extension for Visual Studio Code to create a new repository in Databricks Git folders and use it, or select an existing repository in Databricks Git folders that you created earlier with the Databricks extension for Visual Studio Code and want to reuse instead.

To enable the Databricks extension for Visual Studio Code to use repositories in Databricks Git folders within an Azure Databricks workspace, you must first set the extension's Sync: Destination Type setting to repo as follows:

1. With the extension and your code project opened, and an Azure Databricks configuration profile already set, in the Command Palette (View > Command Palette), type Preferences: Open User Settings, and then click Preferences: Open User Settings.
2. On the User tab, expand Extensions, and click Databricks.
3. For Sync: Destination Type, select repo.
4. Quit and restart Visual Studio Code.

Create a new repo

To create a new repository, do the following:

1. In the Configuration pane, next to Sync Destination, click the gear (Configure sync destination) icon.

   

2. In the Command Palette, click Create New Sync Destination.

3. Type a name for the new repository in Databricks Git folders, and then press Enter.

   The extension appends the characters .ide to the end of the repo's name and then adds the repo's workspace path to the code project's .databricks/project.json file, for example "workspacePath": "/Workspace/Repos/someone@example.com/my-repo.ide".

   Note

   If the remote repo's name does not match your local code project's name, a warning icon appears with this message: The remote sync destination name does not match the current Visual Studio Code workspace name. You can ignore this warning if you do not require the names to match.

4. After you set the repository, begin synchronizing with the repository by clicking the arrowed circle (Start synchronization) icon next to Sync Destination.

   

Reuse an existing repo

If you have an existing repository in Databricks Git folders that you created earlier with the Databricks extension for Visual Studio Code and want to reuse in your current Visual Studio Code project, then do the following:

1. In the Configuration pane, next to Sync Destination, click the gear (Configure sync destination) icon.

   

2. In the Command Palette, select the repository's name from the list.

   The extension adds the repo's workspace path to the code project's .databricks/project.json file, for example "workspacePath": "/Workspace/Repos/someone@example.com/my-repo.ide".

   Note

   If the remote repo's name does not match your local code project's name, a warning icon appears with this message: The remote sync destination name does not match the current Visual Studio Code workspace name. You can ignore this warning if you do not require the names to match.

3. After you set the repository, begin synchronizing with the repository by clicking the arrowed circle (Start synchronization) icon next to Sync Destination.