Carrier

Data Engineer

Carrier

full-time

Posted on:

Location Type: Office

Location: Hyderabad • India

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

ApacheBigQueryCloudGoogle Cloud PlatformPythonSQL

About the role

  • Design and implement batch and streaming data pipelines on GCP using services such as Cloud Storage, BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
  • Build ingestion and transformation pipelines that support raw, curated, and consumption‑ready datasets aligned to Lakehouse patterns.
  • Optimize pipelines for performance, reliability, and cost efficiency on GCP.
  • Implement data storage and processing using Lakehouse principles, including separation of storage and compute.
  • Work with open table formats (e.g., Apache Iceberg or equivalent) and open file formats (e.g., Parquet) to enable interoperability across engines.
  • Design analytical data models optimized for BI, reporting, and advanced analytics on GCP.
  • Ensure datasets are discoverable, understandable, and trusted by downstream consumers.
  • Implement automated data quality checks and validation rules as part of data pipelines.
  • Contribute to CI/CD pipelines for data workloads, including automated testing and deployment.
  • Mentor junior engineers and support knowledge sharing within the data engineering community.

Requirements

  • 5+ years of experience in data engineering or related roles.
  • Strong hands‑on experience with Google Cloud Platform, including services such as: Cloud Storage, BigQuery, Dataflow / Dataproc, Pub/Sub, Cloud Composer
  • Proficiency in Python and SQL for data processing and transformation.
  • Experience building batch and streaming data pipelines in production environments.
  • Solid understanding of Lakehouse architecture concepts and modern analytics data modeling.
Benefits
  • Enjoy your best years with our retirement savings plan
  • Have peace of mind and body with our health insurance
  • Make yourself a priority with flexible schedules, parental leave and our holiday purchase scheme
  • Drive forward your career through professional development opportunities
  • Achieve your personal goals with our Employee Assistance Programme.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data engineeringPythonSQLbatch data pipelinesstreaming data pipelinesdata processingdata transformationdata quality checksCI/CDanalytical data models
Soft Skills
mentoringknowledge sharing