Building Efficient Web Scrapers: Rust vs. Python for Data Ingestion with Camille Owens

Description

Web scraping is a powerful technique for extracting data from websites, but how does it compare to using APIs? In this Lunch and Learn, I will dive into web scraping fundamentals, covering key differences between scrapers and API calls. I will explore Rust and Python libraries like reqwest, scraper, and Polars for data extraction, along with best practices for asynchronous HTTP requests, error handling, and parsing HTML. Will also cover performance trade-offs, cost considerations, and DevOps insights when deploying scrapers in production. Whether you are building data pipelines or exploring new tools, this session will provide valuable insights into efficient data ingestion strategies. Recorded live, 24 June 2025 Join us live for our next Women In Rust session: https://www.meetup.com/women-in-rust/