Full Stack Developer
MoxiWorks
AWSCloudEC2GraphQLJavaScriptPostgresReactRubyRuby on RailsTypeScript
Staff Software Engineer, Batch Processing Platform
full-time
Posted on:
Location Type: Hybrid
Location: Seattle • Washington • 🇺🇸 United States
Visit company websiteSalary
💰 $170,371 - $350,763 per year
Job Level
Lead
Tech Stack
AWSHadoopJavaKubernetesOpen SourcePythonScalaSpark
About the role
- Lead the strategy and technical direction of Pinterest’s Spark platform
- Improve and customize the internals of open source Spark to meet our challenges at scale and actively participate in the open source community
- Build and scale batch processing frameworks and infrastructure to process petabytes-scale datasets
- Work with internal customers on critical business use cases that rely on batch processing
- Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly, and efficiently at scale
- Contribute to the team’s technical vision and long-term roadmap
Requirements
- 8+ years of industry experience with a proven track record of technical excellence
- 5+ years of experience in building and supporting large scalable big data infrastructure/platform
- 2+ years of experience contributing to open-source Spark
- Deep knowledge of big data technologies (e.g. Spark, Hadoop, Parquet/ORC, Flink)
- Experience in leading cross-team engineering efforts
- Proficiency in one or more programming languages (Java, Scala, Python)
- Experience in Kubernetes and AWS technologies
- BS+ degree in a relevant field such as Computer Science OR equivalent experience
Benefits
- Health insurance
- Relocation assistance not provided
- Flexibility to collaborate and connect in-person as needed
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
big dataSparkHadoopParquetORCFlinkJavaScalaPythonKubernetes
Soft skills
leadershipcommunicationcollaborationstrategic thinkingproblem solvingthought leadershiptechnical vision
