This tutorial will give you a hands on introduction to Microsoft Azure from the perspective of a Modern Data Analytics Platform by walking you through a use case for Real Time Analytics. The tutorial is adopted from a 2 day workshop provided by Microsoft on their Modern Data Analytics Platform.
IMPORTANT:
-
The services covered in this course are only a subset of a much larger family of Azure services. Similar outcomes can be achieved by leveraging other services and/or features not covered by this workshop. Specific business requirements may also ask for the use of different services or features not included in this workshop.
-
Some concepts presented in this course can be quite complex and you may need to seek for more information from different sources to compliment your understanding of the Azure services covered.
This document contains detailed step-by-step instructions on how to implement Real Time Analytics in a Modern Data Platform architecture using Azure Data Services. It’s recommended you carefully read the detailed description contained in this document for a successful experience with all Azure services.
You will see the label IMPORTANT whenever a there is a critical step to the lab. Please pay close attention to the instructions given.
In this lab you will use an Azure Logic App to analyse a stream of crypto stock purchase transactions. The logic app will then send the messages to Event Hubs. You will then use Stream Analytics to receive and process the stream and perform aggregations to calculate the number of transactions and amount traded in the last 10 seconds. Stream Analytics will send the results to a real-time dataset in Power BI.
The estimated time to complete this lab is: 90 minutes.
| Step | Description |
|---|---|
 |
Review the Azure Logic App logic that retrieve Crypto stock transaction stream sent to EventHubs |
 |
Save Crypto stock transaction messages into your data lake for future analysis (cold path) |
 |
Send stream of Crypto stock transaction messages to Stream Analytics for real-time analytics (hot path) |
 |
Visualize real-time data generated by Stream Analytics with Power BI |
The following prerequisites must be completed before you start these labs:
-
You must be connected to the internet;
-
Use either Edge or Chrome when executing the labs. Internet Explorer may have issues when rendering the UI for specific Azure services.
-
You must have a Pay-As-You-Go Azure account with administrator- or contributor-level access to your subscription. If you don’t have an account, you can sign up for an account following the instructions here: https://azure.microsoft.com/en-us/free/.
IMPORTANT: When you deploy the lab resources in your own subscription you are responsible for the charges related to the use of the services provisioned. For more information about the list of services and tips on how to save money when executing these labs, please visit the Cost Management section of the Platform Provisioning page. -
This tutorial requires you to have a Power BI Pro account. If you don’t have an account you can sign up for a 60-day trial for free here: https://powerbi.microsoft.com/en-us/power-bi-pro/
In this section you will provision all Azure resources required to complete the tutorial. We will use a mix of pre-defined ARM templates as well as manual deployment to provision the services required.
IMPORTANT: Please make sure to delete the Resource Group at the end of the Tutorial in order to avoid using up your Azure credits. We will be needing these credits for your assignment later on in the semester.
Please click here to deploy the resources needed for the workshop.
Once you have completed the deployment, please continue with the workshop here.
IMPORTANT: ONCE YOU ARE COMPLETE, PLEASE DELETE ALL RESOURCES YOU USED IN THE WORKSHOP FROM YOUR AZURE PORTAL TO PREVENT CONTINUED USAGE OF YOUR CREDITS.
The implementation from this tutorial forms a part of the larger modern data analytics platform architecture referenced below:
- The reference architecture proposed in this workshop aims to explain just enough of the role of each of the Azure Data Services included in the overall modern data platform architecture. This workshop does not replace the need of in-depth training on each Azure service covered.