Feb 27
Loading video player...
Data Engineering with Rust - Michele Vigilante at EuroRust 2025 🦀 Data engineering has long been the domain of JVM-based and Python ecosystems—think Apache Spark, Hadoop, and pandas. Rust’s performance, safety, and growing ecosystem now make it an ideal choice for building high-throughput, low-latency data pipelines. In this talk, you’ll learn how to harness crates like arrow-rs, datafusion, and delta-rs to ingest, transform, store, and query large datasets entirely in Rust. We’ll explore real-world examples, benchmark comparisons against traditional tools, and best practices for architecting robust, production-ready pipelines. About Michele Vigilante Michele Vigilante is based in Vienna Austria and am 31 years old. He's employed as a software engineer at a HR tech company where he's been for the past 6 years. Currently he's in the role of staff engineer for a programmatic ad-tech application, supporting the various teams with architectural decisions and teaching software development using Rust. He's very passionate about Rust and has been following the development of the language and its ecosystem since around 2018, however he didn’t start using it in a professional context until 2022. He started out in application development at a software automation company using C/C++. After that he worked as a developer for a SaaS startup using functional Scala which was eventually acquired by his current employer where he decided that he wanted to change domains. For the past 3 years he has been focused on learning about the domain of data engineering as it was quite interesting to me and he got to work with Sebastian Magri who is a long time member of the Rust community. He's also currently building and maintaining an open source framework that tries to bundle all of the knowledge i’ve aquired over time called Aqueducts. Initially just a toy project it ended up being used quite heavily in multiple teams at his company. -------------------- EuroRust 2026 – Get your ticket for EuroRust 2026 now and join us in Barcelona! 👉 https://eurorust.eu EuroRust is organized by Mainmatter, experts in Rust and distributed systems 👉 https://mainmatter.com/rust/