Prompt flow ecosystem

The prompt flow ecosystem provides a comprehensive set of tutorials, tools, and resources for developers who want to leverage the power of prompt flow to experimentally tune their prompts and develop their LLM-based application in a pure local environment, without any dependencies on Azure resources binding. This article provides an overview of the key components within the ecosystem, which include:

  • Prompt flow open source project in GitHub.
  • Prompt flow SDK and CLI for seamless flow execution and integration with CI/CD pipeline.
  • VS Code extension for convenient flow authoring and development within a local environment.

Prompt flow SDK/CLI

The prompt flow SDK/CLI empowers developers to use code to manage credentials, initialize flows, develop flows, and execute batch testing and evaluation of prompt flows locally.

It's designed for efficiency, allowing simultaneous triggering of large dataset-based flow tests and metric evaluations. Additionally, you can easily integrate the SDK/CLI into your CI/CD pipeline, automating the testing process.

To get started with the prompt flow SDK, explore and follow the SDK quick start notebook in steps.

VS Code extension

The ecosystem also provides a powerful VS Code extension designed for enabling you to easily and interactively develop prompt flows, fine-tune your prompts, and test them with a user-friendly UI.

Screenshot of the prompt flow extension in the VS Code showing the UI.

To get started with the prompt flow VS Code extension, go to the extension marketplace to install and read the details tab.

Screenshot of the prompt flow extension in the VS Code marketplace.

Transition to production in cloud

After you develop and test your prompt flow within the community ecosystem, you might want to transition to a production-grade LLM application. Use Azure Machine Learning for this phase to ensure security, efficiency, and scalability.

You can shift your local flow to your Azure resource to leverage large-scale execution and management in the cloud. For more information, see Integration with GenAIOps.

Community support

The community ecosystem thrives on collaboration and support. Join the active community forums to connect with fellow developers, and contribute to the growth of the ecosystem.

GitHub Repository: promptflow

For questions or feedback, you can open GitHub issue directly or reach out to pf-feedback@microsoft.com.

Next steps

The prompt flow community ecosystem empowers developers to build interactive and dynamic prompts with ease. By using the prompt flow SDK and the VS Code extension, you can create compelling user experiences and fine-tune your prompts in a local environment.