From the course: Rust for Data Engineering

Unlock this course with a free trial

Join today to access over 24,900 courses taught by industry experts.

Jack and the Beanstalk data pipelines

Jack and the Beanstalk data pipelines - Rust Tutorial

From the course: Rust for Data Engineering

Start my 1-month free trial Buy for my team

Jack and the Beanstalk data pipelines

“

- [Instructor] Let's use the fairytale, "Jack and the Beanstalk" as an analogy for building data pipelines. Let's get a recap of the story first. Once upon a time in a small village lived a boy named Jack. Jack's family owned a farm, but it wasn't productive anymore, and his mother decided to sell their only asset, a cow, in the local market. On the way, Jack met a mysterious old man who offered him magic beans in exchange for the cow. Intrigued by the offer, Jack traded the cow for magic beans and rushed home. His mother was very upset, threw the beans out the window, and sent Jack to bed without supper. But to Jack's surprise, overnight, the beans sprouted into a gigantic beanstalk reaching up to the clouds. Now, let's go ahead and compare that story to a data pipeline. First up, we have planting the beans. This is like data ingestion. Just like how the magic beans are planted into the soil, the data…

Contents