As the Staff Engineer/ Technical Lead for the Analytics Team, you will spearhead a team of engineers, providing the guidance and technical oversight necessary to ensure the successful delivery of all project milestones.
Architect and evolve scalable data pipelines using Python (PySpark) on Databricks.
Lead design and implementation of data ingestion, transformation, and orchestration frameworks.
Mentor and guide other data engineers through technical leadership and coaching.
Drive performance optimization, cost efficiency, and system reliability at scale.
Contribute to long-term data platform strategy and roadmap
Review designs and code, providing thoughtful feedback and raising the engineering bar
Research and build proof of concepts in the data space
Write clean, well-structured, and maintainable code, adhering to established coding standards and best practices
Perform thorough code reviews, providing constructive feedback to peers and identifying potential risks or areas for improvement
Debug and resolve defects, proactively identifying and addressing potential issues before they impact users
Create and maintain comprehensive technical documentation
Actively participate in Agile ceremonies, such as stand-ups, sprint planning, and retrospectives, ensuring effective communication and collaboration across the team
Assist in the estimation, prioritization, and planning of development tasks, ensuring projects are delivered on time and within budget
Continuously evaluate and recommend new dataframe related technologies, frameworks, and tools, helping to drive innovation and keep the team up-to-date with industry trends
Engage in ongoing professional development to stay current with industry best practices, and share knowledge and insights with the team as appropriate
Assist in the implementation and maintenance of security, compliance, and governance policies within the Databricks and AWS environment to ensure adherence to industry standards and regulatory requirements.

Requirements

7+ years of experience in data engineering or backend/platform engineering
Strong expertise in Python, with deep hands-on experience using PySpark
Proven experience designing and operating production systems in Databricks
Solid understanding of data modeling, ETL/ELT process, and distributed computing
Bachelor's degree in Computer Science, Computer Engineering or related field
Strong understanding of software design patterns, data structures, and algorithms
Experience with Agile development methodologies
Ability to work independently as well as in a team
Strong problem-solving and analytical skills
Strong verbal and written communication skills
Related experience in analytic programming, data extraction, querying databases/data warehouses and data analysis.

Benefits

Four weeks paid time off yearly (prorated based on start date for the first year)
10 paid company holidays
Flexible schedule and remote-first culture
$3000 annual education stipend
Work from home setup including a Macbook
Collaborative, learning environment
Medical, dental, and company-paid vision insurance
Optional HSA account with some medical plans and a company contribution
Company paid basic life and AD&D insurance coverages
Company paid short and long term life insurance
Optional critical illness and accident insurance
401K plan with 3% safe harbor contribution
Wellness resources and virtual care
Perks Plus employee discounts

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonPySparkDatabricksdata modelingETLELTdistributed computingsoftware design patternsdata structuresalgorithms

Soft Skills

technical leadershipmentoringproblem-solvinganalytical skillsverbal communicationwritten communicationcollaborationindependencefeedbackcoaching

Certifications

Bachelor's degree in Computer ScienceBachelor's degree in Computer Engineering