Improve coverage of the RAPIDS Spark plugin to enable more operators and execs from Apache Spark to be GPU accelerated
Enable fast I/O on table layout formats like Delta and Apache Iceberg
Profile code to identify and implement performance improvements
Work on native code (C++) implementations of Apache Spark functionality
Work with open source communities to enhance RAPIDS through technical discussion and code contributions

Requirements

9+ years of experience in software development, with the majority in data processing
5+ years hands on experience with data platform development
BS/MS/PhD in computer science or a related field (or equivalent experience)
Proficiency in Scala, Java, SQL, solid understanding of C++, Python
Familiarity working on the internals of the open source data platform ecosystem (Apache Spark, Presto, Apache Flink, Apache Arrow, Apache DataFusion, Apache Iceberg, Delta Lake, etc).
Code contributions to one or more of these platforms is a plus.
Experience working on cloud platforms
Experience supporting enterprise customers.

Benefits

equity
benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

C++ScalaJavaSQLPythondata processingperformance improvementsGPU accelerationnative code implementationdata platform development

BS in computer scienceMS in computer sciencePhD in computer science