Cloud Data Integration Architect
Advocate Aurora Health
AirflowCloudPythonSQL
Data Engineering Manager
Machinify, Inc.
full-time
Posted on:
Origin: • 🇺🇸 United States • California
Visit company websiteJob Level
SeniorLead
Tech Stack
AirflowPythonSparkSQL
About the role
- Lead, mentor, and grow a high-performing team of Data Engineers, fostering technical excellence, collaboration, and career growth.
- Own the design, review, and optimization of production pipelines, ensuring high performance, reliability, and maintainability.
- Drive customer data onboarding projects, standardizing external feeds into canonical models.
- Collaborate with senior leadership to define team priorities, project roadmaps, and data standards, translating objectives into actionable assignments.
- Lead sprint planning and prioritize initiatives that improve customer metrics and product impact.
- Partner closely with Product, ML, Analytics, Engineering, and Customer teams to translate business needs into effective data solutions.
- Ensure high data quality, observability, and automated validations across all pipelines.
- Contribute hands-on when necessary to architecture, code reviews, and pipeline design.
- Identify and implement tools, templates, and best practices that improve team productivity and reduce duplication.
- Build cross-functional relationships to advocate for data-driven decision-making and solve complex business problems.
- Hire, mentor, and develop team members, fostering a culture of innovation, collaboration, and continuous improvement.
- Communicate technical concepts and strategies effectively to both technical and non-technical stakeholders.
- Measure team impact through metrics and KPIs, ensuring alignment with company goals.
Requirements
- Degree in Computer Science, Engineering, or a related field.
- 3+ years of combined technical leadership and engineering management experience, preferably in a startup.
- 10+ years of experience in data engineering, including building and maintaining production pipelines and distributed computing frameworks.
- Strong expertise in Python, Spark, SQL, and Airflow.
- Hands-on experience in pipeline architecture, code review, and mentoring junior engineers.
- Prior experience with customer data onboarding and standardizing non-canonical external data.
- Deep understanding of distributed data processing, pipeline orchestration, and performance tuning.
- Exceptional ability to manage priorities, communicate clearly, and work cross-functionally.
- Demonstrated experience leading small teams, including performance management and career development.
- Comfortable with ambiguity, taking initiative, thinking strategically, and executing methodically.
- Ability to drive change, inspire distributed teams, and solve complex problems with a data-driven mindset.
- Customer-oriented, ensuring work significantly advances product value and impact.
- Work authorization/residency considerations: application asks about legal authorization to work in the United States and current U.S. residence.
