From the course: Microsoft Azure Data Engineer Associate (DP-203) Cert Prep by Microsoft Press

Unlock this course with a free trial

Join today to access over 24,900 courses taught by industry experts.

Transform data by using Data Factory

Transform data by using Data Factory - Azure Tutorial

From the course: Microsoft Azure Data Engineer Associate (DP-203) Cert Prep by Microsoft Press

Start my 1-month free trial Buy for my team

Transform data by using Data Factory

“

- [Instructor] And we've seen in the lessons thus far that we can easily create data sets in the Azure Data Factory Studio and those data sources can be resident in Azure or not, it doesn't matter. We can use the self-hosted integration runtime to connect to data sources that might exist in your local data centers or might exist in other clouds. We can perform just about any kind of transformation we want. We can change the database schema, we can remove empty rows, we can perform any kind of transformations we want. The value proposition of ADF is that library of activities where many of them have canned transformations that you can just call and configure, or alternatively, you can use a script activity and call a SQL script to perform those transformations for you over and over and over again. Some examples of Azure Data Factory pipelines, all of which are defined fundamentally in JSON, would be copying data based in…

Contents