Apr 8
Loading video player...
Learn and Engineering and Crack Interview - https://datavidhya.com/data-engineering-course-bundle/ In this video, I'll walk you through building a production-grade data pipeline on AWS from scratch — step by step, entirely on the AWS Console. We'll ingest live YouTube trending data using the YouTube Data API, process it through a Medallion Architecture (Bronze → Silver → Gold), run data quality checks, and orchestrate the entire workflow with AWS Step Functions — exactly how real companies build data lakes. This is NOT a toy project. By the end, you'll have a fully automated pipeline that runs every 6 hours, pulls fresh data, transforms it, validates quality, and sends you alerts on success or failure. Codes used in video - https://github.com/darshilparmar/youtube-data-piepline-aws-s3-lambda-glue-athena-stepfunction Subscribe to FREE Data Engineering newsletter - http://blog.datavidhya.com/ 👦🏻 My LinkedIn - https://www.linkedin.com/in/darshil-parmar/ 📷 Instagram - https://www.instagram.com/datawithdarshil 🎯Twitter - https://twitter.com/parmardarshil07 🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟 ✨ Tags ✨ aws data pipeline, aws data engineering project, medallion architecture, build data pipeline from scratch, aws hands on tutorial, aws data engineer certification ✨ Hashtags ✨ #dataengineering #aws #project