Senior Software Engineer, Data
Affinity.co
full-time
Posted on:
Location Type: Remote
Location: Remote • California, New York • 🇺🇸 United States
Visit company websiteSalary
💰 $106,200 - $200,000 per year
Job Level
Senior
Tech Stack
ApacheAWSAzureCloudDistributed SystemsGoogle Cloud PlatformKafkaSparkSQL
About the role
- Design scalable and reliable data pipelines to consume, integrate and analyze large volumes of complex data from different sources, supporting the evolving needs of our business.
- Help define our data roadmap. You'll collaborate with our team of machine learning engineers, software engineers, product, and business leaders to shape product development.
- Build and maintain frameworks for measuring and monitoring data quality and integrity.
- Establish and optimize CI/CD processes, test frameworks, and infrastructure-as-code tooling.
- Build and implement robust data-intensive applications over distributed systems.
- Articulate the trade-offs of different approaches to building data pipelines and storage solutions, providing clear recommendations aligned with product and business requirements.
Requirements
- 5+ years of experience as a Software Engineer or Data Engineer with at least 2-3 years in a Senior Engineering role, leading complex, and sometimes ambiguous, engineering projects across team boundaries.
- Proficiency in event streaming and batch processing pipelines for data-intensive applications is essential.
- Proven hands-on experience with scalable and robust distributed data systems using Kafka, AWS SQS or similar technologies.
- Comfortable working with large datasets and high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark.
- Strong proficiency in SQL.
- Experience with cloud platforms such as AWS, Databricks, GCP, Azure or related technologies.
- Familiar with CI/CD processes and test frameworks.
- Comfortable partnering with product and machine learning teams on large, strategic data projects.
Benefits
- We cover your medical, dental, and vision insurance premiums with comprehensive PPO, HDHP and HMO options (in CA), and offer flexible personal & sick days to support your well-being.
- We offer a 401(k) plan to help you plan for your future.
- We provide an annual education budget and a comprehensive L&D program.
- We reimburse monthly for things like home internet, meals, and wellness memberships/equipment to support your overall health and happiness.
- Virtual team-building activities and socials to keep our team connected, because building strong relationships is key to success.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipelinesdata integrationdata analysisevent streamingbatch processingdistributed systemsSQLdata qualitydata integritycloud platforms
Soft skills
collaborationleadershipcommunicationproblem-solvingrecommendation articulation