From the course: Data Quality: Transactions, Ingestions, and Storage
Join today to access over 24,900 courses taught by industry experts.
Ingestion code exploration
From the course: Data Quality: Transactions, Ingestions, and Storage
Ingestion code exploration
- [Speaker] Now that we have a high-level understanding of how our ingestion script works, I want you to pause the video and take a moment to explore the ingestion code yourself. There's some additional data quality steps I have that's hidden in there that's worth exploring. Now, if you don't know where it's at, we go to data platform, ingestion and we're gonna go to postgres_ingestion_csv.py. Take a moment, skim through there and see what other data quality steps are happening here. And don't worry, time boxes spend maybe like five minutes max if it's a little overwhelming. That's completely okay because when we come back from this pause, I'm gonna go through my own notes that I have from my product requirements document, and welcome back from your code sleuthing. Now, if you wanna see my notes throughout the entire course, you go to course assets, and from here, you can see our product requirements document complete,…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.