At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.
Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.
Distributed Systems Engineer (Apache Spark Internals) at BairesDev
We are seeking a Distributed Systems Engineer with experience in Apache Spark internals to work on the engine itself, not pipelines built on top of it. The work covers the core components of Spark — Catalyst Optimizer, Tungsten execution, DAG Scheduler, Shuffle subsystem, and memory management — at petabyte scale. The technology stack centers on the open source Apache Spark project and adjacent ecosystem projects (Iceberg, Hive, Hadoop, Arrow, Parquet), with ample scope for upstream contribution. We're looking for engineers who have worked on engine-level code in Spark or comparable distr...