From the course: Microsoft Azure Data Scientist Associate (DP-100) Cert Prep

Unlock this course with a free trial

Join today to access over 24,900 courses taught by industry experts.

Analyze data by using Azure Data Explorer

Analyze data by using Azure Data Explorer - Azure Tutorial

From the course: Microsoft Azure Data Scientist Associate (DP-100) Cert Prep

Start my 1-month free trial Buy for my team

Analyze data by using Azure Data Explorer

“

- [Instructor] Let's take a look at this data management and ingestion system for Azure Data Explorer. It's a fully managed service that is responsible for doing data ingestion. And you can see in this diagram that Azure Data Explorer will be able to pull the data from an external source. And that external source will then send a request to an Azure queue, and it's either batched or streamed to the data manager. At that point, batched data can flow to the same database and table and it's optimized for ingestion. And then Azure Data Explorer will then validate the initial data and convert it to a data format where you can use the data in a form that is better for processing. At that point, you could do things like data manipulation with schema, organizing, indexing, and coding, or compressing the data, and then setting a data retention policy. So there's a full solution here that is able to wire into the Azure system. And this allows you to do batching ingestion management, all…

Contents