How can I use IntelliJ IDEA with Azure Databricks?

  • Article

IntelliJ IDEA by JetBrains is an integrated development environment (IDE) for JVM languages designed to maximize developer productivity. It does the routine and repetitive tasks for you by providing clever code completion, static code analysis, and refactorings, and lets you focus on the bright side of software development, making it not only productive but also an enjoyable experience. You can use IntelliJ IDEA on your local development machine to write, run, and debug code in Azure Databricks, as follows:

Name Use this when you want to…
Databricks Connect in IntelliJ IDEA with Scala Use IntelliJ IDEA Ultimate to write, run, and debug local Scala code on a remote Azure Databricks workspace.
Databricks Asset Bundles Use IntelliJ IDEA to make authoring, deploying, and running bundles easier. Databricks Asset Bundles (or bundles for short) enable you to programmatically define, deploy, and run Azure Databricks jobs, Delta Live Tables pipelines, and MLOps Stacks by using CI/CD best practices and workflows.
Databricks CLI Use the built-in Terminal in IntelliJ IDEA to work with Azure Databricks from the command line.
Databricks SDK for Java Use IntelliJ IDEA to write, run, and debug Java code that works with Azure Databricks.
Provision infrastructure Use the Terraform and HCL plugin for IntelliJ IDEA to make it easier to provision Azure Databricks infrastructure with Terraform and follow infrastructure-as-code (IaC) best practices. Use IntelliJ IDEA to write and deploy Java definitions of Azure Databricks infrastructure through third-party offerings such as the Cloud Development Kit for Terraform (CDKTF) and Pulumi.