FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAirflowAzureBigQueryCloudDistributed SystemsGoogle Cloud PlatformKafkaSparkSQL
About the role
Key responsibilities & impact- Lead and grow a high-performing team of 8-10 data engineers building and operating the People Data Lake
- Own the architecture, design, and delivery of scalable batch and future streaming data pipelines using Spark, Big Query, Airflow, and related cloud-native technologies.
- Drive best practices across data modeling, pipeline reliability, observability, and cost optimization to ensure high performance and availability.
- Define and implement the data security framework for the lake, including encryption (at rest and in transit), masking and fine-grained access controls.
- Establish secure data sharing and governance mechanisms to protect sensitive data and ensure regulatory and enterprise compliance.
- Partner with Product, HR, Analytics, Security, and Architecture teams to define roadmap, prioritize initiatives, and deliver scalable, resilient, and secure data solutions.
- Build a strong engineering culture focused on operational excellence, technical rigor, and continuous improvement while shaping the mid- to long-term platform vision.
- Establish best engineering and operational excellence practices based on product, engineering, and scrum metrics.
- Work with senior leadership to chart out the future roadmap of the products
- Participate in hiring, mentoring, and building high performing agile teams.
- Establishing clear expectations with individuals based on their level and role, meeting regularly to discuss performance, provide feedback and coaching
Requirements
What you’ll need- 12+ years of experience in software or data engineering with 3+ years leading high-performing engineering teams.
- Strong hands-on expertise in Spark, BigQuery, Airflow (or equivalent), and distributed data systems on GCP.
- Experience with big data and distributed systems like Spark, Flink, etc.
- Proven experience designing, building, and operating large-scale data lakes or lakehouse platforms with batch and streaming ingestion.
- Deep understanding of data security principles including encryption, PII protection, masking, IAM, and row/column-level security.
- Strong SQL and data modeling skills with experience implementing CI/CD, monitoring, and reliability best practices for data platforms.
- Ability to operate at both strategic and execution levels, influence cross-functional stakeholders, and translate platform vision into secure, scalable business outcomes.
- Knowledge in Pub sub system like Kafka.
- Knowledge of cloud platforms like Azure, GCP etc.
- Lead the integration of AI/ML toolkits and frameworks into day-to-day (D2D) data engineering workflows, enabling teams to accelerate development, automate data processes, and enhance decision-making capabilities.
Benefits
Comp & perks- incentive awards for your performance
- maternity and parental leave
- PTO
- health benefits
- best-in-class benefits
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
SparkBigQueryAirflowSQLdata modelingCI/CDdata securityencryptionPII protectiondistributed data systems
Soft Skills
leadershipmentoringcoachingstrategic thinkinginfluencingcommunicationoperational excellencecontinuous improvementteam buildingperformance management