Connect to Prophecy
Prophecy helps teams be successful and productive on Apache Spark and Apache Airflow with low-code development, scheduling, and metadata.
You can integrate your Azure Databricks compute resources with Prophecy.
Connect to Prophecy manually
Use the steps in this section to connect Prophecy to your workspace.
Requirements
To complete this series of steps, you need an Azure Databricks personal access token or a Microsoft Entra ID (formerly Azure Active Directory) token.
Note
As a security best practice, when you authenticate with automated tools, systems, scripts, and apps, Databricks recommends that you use personal access tokens belonging to service principals instead of workspace users. To create tokens for service principals, see Manage tokens for a service principal.
Steps to connect manually
To connect to Prophecy manually, do the following:
Sign in to your Prophecy account, or create a new Prophecy account, at https://app.prophecy.io.
On the navigation bar, click Metadata.
Click the Fabrics tab.
Important
If you sign in to your organization's Prophecy account, there may already be a list of existing fabric entries. These entries might contain connection details for workspaces that are separate from yours. If you want to reuse one of these fabrics, and you trust the workspace and have access to it, then skip the following steps.
Click the plus (+) icon.
Click the Fabric tab.
Enter a Name, select a Team, and enter an optional Description. (Do not change the Execution Url value.)
Click Create Fabric.
In the list of fabrics, click the name of the fabric that you just added.
Learn about Fabric usage patterns.
Next steps
- See Creating a Pipeline in the Prophecy documentation.