Azure Event Hubs output binding for Azure Functions
This article explains how to work with Azure Event Hubs bindings for Azure Functions. Azure Functions supports trigger and output bindings for Event Hubs.
For information on setup and configuration details, see the overview.
Use the Event Hubs output binding to write events to an event stream. You must have send permission to an event hub to write events to it.
Make sure the required package references are in place before you try to implement an output binding.
Important
This article uses tabs to support multiple versions of the Node.js programming model. The v4 model is currently in preview and is designed to have a more flexible and intuitive experience for JavaScript and TypeScript developers. Learn more about the differences between v3 and v4 in the upgrade guide.
Azure Functions supports two programming models for Python. The way that you define your bindings depends on your chosen programming model.
The Python v2 programming model lets you define bindings using decorators directly in your Python function code. For more information, see the Python developer guide.
This article supports both programming models.
Example
The following example shows a C# function that writes a message string to an event hub, using the method return value as the output:
[Function(nameof(EventHubFunction))]
[FixedDelayRetry(5, "00:00:10")]
[EventHubOutput("dest", Connection = "EventHubConnection")]
public string EventHubFunction(
[EventHubTrigger("src", Connection = "EventHubConnection")] string[] input,
FunctionContext context)
{
_logger.LogInformation("First Event Hubs triggered message: {msg}", input[0]);
var message = $"Output message created at {DateTime.Now}";
return message;
}
The following example shows a timer triggered TypeScript function that sends a single message to an event hub:
import { app, InvocationContext, output, Timer } from '@azure/functions';
export async function timerTrigger1(myTimer: Timer, context: InvocationContext): Promise<string> {
const timeStamp = new Date().toISOString();
return `Message created at: ${timeStamp}`;
}
app.timer('timerTrigger1', {
schedule: '0 */5 * * * *',
return: output.eventHub({
eventHubName: 'myeventhub',
connection: 'MyEventHubSendAppSetting',
}),
handler: timerTrigger1,
});
To output multiple messages, return an array instead of a single object. For example:
import { app, InvocationContext, output, Timer } from '@azure/functions';
export async function timerTrigger1(myTimer: Timer, context: InvocationContext): Promise<string[]> {
// <displayInDocs>
const timeStamp = new Date().toISOString();
const message = `Message created at: ${timeStamp}`;
return [`1: ${message}`, `2: ${message}`];
// </displayInDocs>
}
app.timer('timerTrigger1', {
schedule: '0 */5 * * * *',
return: output.eventHub({
eventHubName: 'myeventhub',
connection: 'MyEventHubSendAppSetting',
}),
handler: timerTrigger1,
});
The following example shows a timer triggered JavaScript function that sends a single message to an event hub:
const { app, output } = require('@azure/functions');
const eventHubOutput = output.eventHub({
eventHubName: 'myeventhub',
connection: 'MyEventHubSendAppSetting',
});
app.timer('timerTrigger1', {
schedule: '0 */5 * * * *',
return: eventHubOutput,
handler: (myTimer, context) => {
const timeStamp = new Date().toISOString();
return `Message created at: ${timeStamp}`;
},
});
To output multiple messages, return an array instead of a single object. For example:
const { app, output } = require('@azure/functions');
const eventHubOutput = output.eventHub({
eventHubName: 'myeventhub',
connection: 'MyEventHubSendAppSetting',
});
app.timer('timerTrigger1', {
schedule: '0 */5 * * * *',
return: eventHubOutput,
handler: (myTimer, context) => {
// <displayInDocs>
const timeStamp = new Date().toISOString();
const message = `Message created at: ${timeStamp}`;
return [`1: ${message}`, `2: ${message}`];
// </displayInDocs>
},
});
Complete PowerShell examples are pending.
The following example shows an event hub trigger binding and a Python function that uses the binding. The function writes a message to an event hub. The example depends on whether you use the v1 or v2 Python programming model.
import logging
import azure.functions as func
app = func.FunctionApp()
@app.function_name(name="eventhub_output")
@app.route(route="eventhub_output")
@app.event_hub_output(arg_name="event",
event_hub_name="<EVENT_HUB_NAME>",
connection="<CONNECTION_SETTING>")
def eventhub_output(req: func.HttpRequest, event: func.Out[str]):
body = req.get_body()
if body is not None:
event.set(body.decode('utf-8'))
else:
logging.info('req body is none')
return 'ok'
Here's Python code that sends multiple messages:
import logging
import azure.functions as func
from typing import List
app = func.FunctionApp()
@app.function_name(name="eventhub_output")
@app.route(route="eventhub_output")
@app.event_hub_output(arg_name="event",
event_hub_name="<EVENT_HUB_NAME>",
connection="<CONNECTION_SETTING>")
def eventhub_output(req: func.HttpRequest, event: func.Out[List[str]]) -> func.HttpResponse:
my_messages=["message1", "message2","message3"]
event.set(my_messages)
return func.HttpResponse(f"Messages sent")
The following example shows a Java function that writes a message containing the current time to an event hub.
@FunctionName("sendTime")
@EventHubOutput(name = "event", eventHubName = "samples-workitems", connection = "AzureEventHubConnection")
public String sendTime(
@TimerTrigger(name = "sendTimeTrigger", schedule = "0 */5 * * * *") String timerInfo) {
return LocalDateTime.now().toString();
}
In the Java functions runtime library, use the @EventHubOutput
annotation on parameters whose value would be published to Event Hubs. The parameter should be of type OutputBinding<T>
, where T
is a POJO or any native Java type.
Attributes
Both in-process and isolated worker process C# libraries use attribute to configure the binding. C# script instead uses a function.json configuration file as described in the C# scripting guide.
Use the [EventHubOutputAttribute] to define an output binding to an event hub, which supports the following properties.
Parameters | Description |
---|---|
EventHubName | The name of the event hub. When the event hub name is also present in the connection string, that value overrides this property at runtime. |
Connection | The name of an app setting or setting collection that specifies how to connect to Event Hubs. To learn more, see Connections. |
Decorators
Applies only to the Python v2 programming model.
For Python v2 functions defined using a decorator, these properties are supported for event_hub_output
:
Property | Description |
---|---|
arg_name |
The variable name used in function code that represents the event. |
event_hub_name |
he name of the event hub. When the event hub name is also present in the connection string, that value overrides this property at runtime. |
connection |
The name of an app setting or setting collection that specifies how to connect to Event Hubs. To learn more, see Connections. |
For Python functions defined by using function.json, see the Configuration section.
Annotations
In the Java functions runtime library, use the EventHubOutput annotation on parameters whose value would be published to Event Hubs. The following settings are supported on the annotation:
Configuration
Applies only to the Python v1 programming model.
The following table explains the properties that you can set on the options
object passed to the output.eventHub()
method.
Property | Description |
---|---|
eventHubName | The name of the event hub. When the event hub name is also present in the connection string, that value overrides this property at runtime. |
connection | The name of an app setting or setting collection that specifies how to connect to Event Hubs. To learn more, see Connections. |
The following table explains the binding configuration properties that you set in the function.json file, which differs by runtime version.
function.json property | Description |
---|---|
type | Must be set to eventHub . |
direction | Must be set to out . This parameter is set automatically when you create the binding in the Azure portal. |
name | The variable name used in function code that represents the event. |
eventHubName | Functions 2.x and higher. The name of the event hub. When the event hub name is also present in the connection string, that value overrides this property at runtime. |
connection | The name of an app setting or setting collection that specifies how to connect to Event Hubs. To learn more, see Connections. |
When you're developing locally, add your application settings in the local.settings.json file in the Values
collection.
Usage
The parameter type supported by the Event Hubs output binding depends on the Functions runtime version, the extension package version, and the C# modality used.
When you want the function to write a single event, the Event Hubs output binding can bind to the following types:
Type | Description |
---|---|
string |
The event as a string. Use when the event is simple text. |
byte[] |
The bytes of the event. |
JSON serializable types | An object representing the event. Functions tries to serialize a plain-old CLR object (POCO) type into JSON data. |
When you want the function to write multiple events, the Event Hubs output binding can bind to the following types:
Type | Description |
---|---|
T[] where T is one of the single event types |
An array containing multiple events. Each entry represents one event. |
For other output scenarios, create and use types from Microsoft.Azure.EventHubs directly.
There are two options for outputting an Event Hubs message from a function by using the EventHubOutput annotation:
Return value: By applying the annotation to the function itself, the return value of the function is persisted as an Event Hubs message.
Imperative: To explicitly set the message value, apply the annotation to a specific parameter of the type
OutputBinding<T>
, whereT
is a POJO or any native Java type. With this configuration, passing a value to thesetValue
method persists the value as an Event Hubs message.
Complete PowerShell examples are pending.
There are two options for outputting an Event Hubs message from a function:
Return value: Set the
name
property in function.json to$return
. With this configuration, the function's return value is persisted as an Event Hubs message.Imperative: Pass a value to the set method of the parameter declared as an Out type. The value passed to
set
is persisted as an Event Hubs message.
Connections
The connection
property is a reference to environment configuration which specifies how the app should connect to Event Hubs. It may specify:
- The name of an application setting containing a connection string
- The name of a shared prefix for multiple application settings, together defining an identity-based connection.
If the configured value is both an exact match for a single setting and a prefix match for other settings, the exact match is used.
Connection string
Obtain this connection string by clicking the Connection Information button for the namespace, not the event hub itself. The connection string must be for an Event Hubs namespace, not the event hub itself.
When used for triggers, the connection string must have at least "read" permissions to activate the function. When used for output bindings, the connection string must have "send" permissions to send messages to the event stream.
This connection string should be stored in an application setting with a name matching the value specified by the connection
property of the binding configuration.
Identity-based connections
If you are using version 5.x or higher of the extension, instead of using a connection string with a secret, you can have the app use an Azure Active Directory identity. To do this, you would define settings under a common prefix which maps to the connection
property in the trigger and binding configuration.
In this mode, the extension requires the following properties:
Note
The environment variable provided must currently be prefixed by AzureWebJobs
to work in the Consumption plan. In Premium plans, this prefix is not required.
Property | Environment variable template | Description | Example value |
---|---|---|---|
Fully Qualified Namespace | AzureWebJobs<CONNECTION_NAME_PREFIX>__fullyQualifiedNamespace |
The fully qualified Event Hubs namespace. | <event_hubs_namespace>.servicebus.chinacloudapi.cn |
Additional properties may be set to customize the connection. See Common properties for identity-based connections.
Note
When using Azure App Configuration or Key Vault to provide settings for Managed Identity connections, setting names should use a valid key separator such as :
or /
in place of the __
to ensure names are resolved correctly.
For example, <CONNECTION_NAME_PREFIX>:fullyQualifiedNamespace
.
When hosted in the Azure Functions service, identity-based connections use a managed identity. The system-assigned identity is used by default, although a user-assigned identity can be specified with the credential
and clientID
properties. Note that configuring a user-assigned identity with a resource ID is not supported. When run in other contexts, such as local development, your developer identity is used instead, although this can be customized. See Local development with identity-based connections.
Grant permission to the identity
Whatever identity is being used must have permissions to perform the intended actions. You will need to assign a role in Azure RBAC, using either built-in or custom roles which provide those permissions.
Important
Some permissions might be exposed by the target service that are not necessary for all contexts. Where possible, adhere to the principle of least privilege, granting the identity only required privileges. For example, if the app only needs to be able to read from a data source, use a role that only has permission to read. It would be inappropriate to assign a role that also allows writing to that service, as this would be excessive permission for a read operation. Similarly, you would want to ensure the role assignment is scoped only over the resources that need to be read.
You will need to create a role assignment that provides access to your event hub at runtime. The scope of the role assignment can be for an Event Hubs namespace, or the event hub itself. Management roles like Owner are not sufficient. The following table shows built-in roles that are recommended when using the Event Hubs extension in normal operation. Your application may require additional permissions based on the code you write.
Binding type | Example built-in roles |
---|---|
Trigger | Azure Event Hubs Data Receiver, Azure Event Hubs Data Owner |
Output binding | Azure Event Hubs Data Sender |
Exceptions and return codes
Binding | Reference |
---|---|
Event Hubs | Operations Guide |