From the course: End-to-End Data Engineering Project

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

Setting up your data warehouse

Setting up your data warehouse

- [Instructor] Cloud data warehouses have transformed the way we manage and analyze data. They have become the center of the modern data stack, holding huge amounts of data ready for us to gain valuable insights. Google BigQuery is a powerful player in this revolution. BigQuery is a fully managed serverless data warehouse that enables super fast SQL queries. Using the processing power of Google's infrastructure. It is a scalable, cost effective, and integrates very well with other data tools. I have chosen BigQuery for this project mainly because it offers a generous free tier, which is perfect for learning and small projects. But please know that you can use any other data warehouse, such as Snowflake or Redshift if you have access to them. Some steps in this project will be slightly different, but you can definitely follow along. Even a local Postgres database could work as your data warehouse. And now let's set up our…

Contents