Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Use message routing in Azure IoT Hub to send telemetry data from your IoT devices to Azure services such as blob storage, Service Bus Queues, Service Bus Topics, and Event Hubs. Every IoT hub has a default built-in endpoint that is compatible with Event Hubs. You can also create custom endpoints and route messages to other Azure services by defining routing queries. Each message that arrives at the IoT hub is routed to all endpoints whose routing queries it matches. If a message doesn't match any of the defined routing queries, it is routed to the default endpoint.
In this tutorial, you perform the following tasks:
- Create an IoT hub and send device messages to it.
- Create a storage account.
- Create a custom endpoint for the storage account and route messages to it from the IoT hub.
- View device messages in the storage account blob.
An Azure subscription. If you don't have an Azure subscription, create a Trial before you begin.
An IoT hub in your Azure subscription. If you don't have a hub yet, you can follow the steps in Create an IoT hub.
This tutorial uses sample code from Azure IoT SDK for C#.
- Download or clone the SDK repo to your development machine.
- Have .NET Core 3.0.0 or greater on your development machine. Check your version by running
dotnet --version
and Download .NET if necessary.
Make sure that port 8883 is open in your firewall. The sample in this tutorial uses MQTT protocol, which communicates over port 8883. This port may be blocked in some corporate and educational network environments. For more information and ways to work around this issue, see Connecting to IoT Hub (MQTT).
Optionally, install Azure IoT Explorer. This tool helps you observe the messages as they arrive at your IoT hub. This article uses Azure IoT Explorer.
You can use the local Azure CLI.
If you prefer, install the Azure CLI to run CLI reference commands.
Local Azure CLI, see how to install the Azure CLI. If you're running on Windows or macOS, consider running Azure CLI in a Docker container. For more information, see How to run the Azure CLI in a Docker container.
Sign in to the Azure CLI by using the az login command. To finish the authentication process, follow the steps displayed in your terminal. For other sign-in options, see Sign in with the Azure CLI.
When you're prompted, install the Azure CLI extension on first use. For more information about extensions, see Use extensions with the Azure CLI.
Run az version to find the version and dependent libraries that are installed. To upgrade to the latest version, run az upgrade.
Register a new device in your IoT hub.
Tip
Many of the CLI commands used throughout this tutorial use the same parameters. For your convenience, we have you define local variables that can be called as needed. Be sure to run all the commands in the same session, or else you will have to redefine the variables.
Define variables for your IoT hub and device.
IOTHUB_NAME: Replace this placeholder with the name of your IoT hub.
DEVICE_NAME: Replace this placeholder with any name you want to use for the device in this tutorial.
hubName=IOTHUB_NAME deviceName=DEVICE_NAME
Run the az iot hub device-identity create command in your CLI shell. This command creates the device identity.
az iot hub device-identity create --device-id $deviceName --hub-name $hubName
From the device-identity output, copy the primaryKey value without the surrounding quotation marks and save it. You'll use this value to configure the sample code that generates simulated device telemetry messages.
Now that you have a device ID and key, use the sample code to start sending device telemetry messages to IoT Hub.
Tip
If you're following the Azure CLI steps for this tutorial, run the sample code in a separate session. That way, you can allow the sample code to continue running while you follow the rest of the CLI steps.
If you didn't as part of the prerequisites, download or clone the Azure IoT SDK for C# repo from GitHub now.
From the folder where you downloaded or cloned the SDK, navigate to the
azure-iot-sdk-csharp\iothub\device\samples\how to guides\HubRoutingSample
folder.Install the Azure IoT C# SDK and necessary dependencies as specified in the
HubRoutingSample.csproj
file:dotnet restore
In an editor of your choice, open the
Parameters.cs
file. This file shows the parameters that are supported by the sample. Only thePrimaryConnectionString
parameter will be used in this article when running the sample. Review the code in this file. No changes are needed.Build and run the sample code using the following command:
Replace
<myDevicePrimaryConnectionString>
with your primary connection string from your device in your IoT hub.dotnet run --PrimaryConnectionString <myDevicePrimaryConnectionString>
You should start to see messages printed to output as they are sent to IoT Hub. Leave this program running during the tutorial.
Configure IoT Explorer to connect to your IoT hub and read messages as they arrive at the built-in endpoint.
First, retrieve the connection string for your IoT hub.
Run the az iot hub connection-string show command:
az iot hub connection-string show --hub-name $hubName
Copy the connection string without the surrounding quotation marks.
Now, use that connection string to configure IoT Explorer for your IoT hub.
Open IoT Explorer on your development machine.
Select Add connection.
Paste your hub's connection string into the text box.
Select Save.
Once you connect to your IoT hub, you should see a list of devices. Select the device ID that you created for this tutorial.
Select Telemetry.
With your device still running, select Start. If your device isn't running you won't see telemetry.
You should see the messages arriving from your device, with the most recent displayed at the top.
Watch the incoming messages for a few moments to verify that you see three different types of messages: normal, storage, and critical. After seeing this, you can stop your device.
These messages are all arriving at the default built-in endpoint for your IoT hub. In the next sections, we're going to create a custom endpoint and route some of these messages to storage based on the message properties. Those messages will stop appearing in IoT Explorer because messages only go to the built-in endpoint when they don't match any other routes in IoT hub.
You're going to route messages to different resources based on properties attached to the message by the simulated device. Messages that aren't custom routed are sent to the default endpoint (messages/events).
The sample app for this tutorial assigns a level property to each message it sends to IoT hub. Each message is randomly assigned a level of normal, storage, or critical.
The first step is to set up the endpoint to which the data will be routed. The second step is to set up the message route that uses that endpoint. After setting up the routing, you can view endpoints and message routes in the portal.
Create an Azure Storage account and a container within that account, which will hold the device messages that are routed to it.
Define the variables for your storage account and container.
GROUP_NAME: Replace this placeholder with the name of the resource group that contains your IoT hub.
STORAGE_NAME: Replace this placeholder with a name for your storage account. Storage account names must be lowercase and globally unique.
CONTAINER_NAME: Replace this placeholder with a name for your container.
resourceGroup=GROUP_NAME storageName=STORAGE_NAME containerName=CONTAINER_NAME
Use the az storage account create command to create a standard general-purpose v2 storage account.
az storage account create --name $storageName --resource-group $resourceGroup
Use the az storage container create to add a container to your storage account.
az storage container create --auth-mode login --account-name $storageName --name $containerName
Now set up the routing for the storage account. In this section you define a new endpoint that points to the storage account you created. Then, create a route that filters for messages where the level property is set to storage, and route those to the storage endpoint.
Note
The data can be written to blob storage in either the Apache Avro format, which is the default, or JSON.
The encoding format can be only set at the time the blob storage endpoint is configured. The format cannot be changed for an endpoint that has already been set up. When using JSON encoding, you must set the contentType to JSON and the contentEncoding to UTF-8 in the message system properties.
For more detailed information about using a blob storage endpoint, please see guidance on routing to storage.
Configure the variables that you need for the endpoint and route commands.
ENDPOINT_NAME: Provide a name for the endpoint that represents your storage container.
ROUTE_NAME: Provide a name for the route that filters messages for the storage endpoint
endpointName=ENDPOINT_NAME routeName=ROUTE_NAME
Use the az iot hub message-endpoint create command to create a custom endpoint that points to the storage container you made in the previous section.
az iot hub message-endpoint create storage-container \ --connection-string $(az storage account show-connection-string --name $storageName --query connectionString -o tsv) \ --endpoint-name $endpointName \ --hub-name $hubName \ --container $containerName \ --resource-group $resourceGroup \ --encoding json
Use the az iot hub message-route create command to create a route that passes any message where
level=storage
to the storage container endpoint.az iot hub message-route create \ --route-name $routeName \ --hub-name $hubName \ --resource-group $resourceGroup \ --source-type devicemessages \ --endpoint-name $endpointName \ --enabled true \ --condition 'level="storage"'
Once the route is created in IoT Hub and enabled, it will immediately start routing messages that meet its query condition to the storage endpoint.
Return to the IoT Explorer session on your development machine. Recall that the IoT Explorer monitors the built-in endpoint for your IoT hub. That means that now you should be seeing only the messages that are not being routed by the custom route we created.
Start the sample again by running the code. Watch the incoming messages for a few moments and you should only see messages where level
is set to normal
or critical
.
Verify that the messages are arriving in the storage container.
In the Azure portal, navigate to your storage account.
Select Containers from the Data storage section of the menu.
Select the container that you created for this tutorial.
There should be a folder with the name of your IoT hub. Drill down through the file structure until you get to a .json file.
Select the JSON file, then select Download to download the JSON file. Confirm that the file contains messages from your device that have the
level
property set tostorage
.Stop running the sample.
If you want to remove all of the Azure resources you used for this tutorial, delete the resource group. This action deletes all resources contained within the group. If you don't want to delete the entire resource group, use the Azure portal to locate and delete the individual resources.
If you intend to continue to the next tutorial, keep the resources that you created here.
Use the az resource list command to view all the resources in your resource group.
az resource list --resource-group $resourceGroup --output table
Review all the resources that are in the resource group to determine which ones you want to clean up.
If you want to delete all the resources, use the az group delete command.
az group delete --name $resourceGroup
If you only want to delete certain resources, use the az resource delete command. For example:
az resource delete --resource-group $resourceGroup --name $storageName
In this tutorial you learned how to create a custom endpoint for an Azure resource and then create a route to send device messages to that endpoint. Continue to the next tutorial to learn how to enrich messages with extra data that can be used to simplify downstream processing