BT Group

Platform Engineering Professional – Data Engineer

BT Group

full-time

Posted on:

Location Type: Office

Location: Bengaluru • India

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

ApacheAWSBigQueryETLGoogle Cloud PlatformHadoopJavaKafkaKubernetesPySparkPythonScalaSparkSQLSubversionTerraform

About the role

  • Create, develop, and maintain end‑to‑end data pipelines using Ab Initio (GDE, PDL, Conduct>IT, Express>IT)
  • Build scalable batch and streaming workloads using Apache Spark (PySpark/Scala)
  • Develop and orchestrate real-time/near‑real‑time data ingestion flows using Apache NiFi
  • Optimize ETL/ELT pipelines for performance and efficiency
  • Perform tuning and bottleneck analysis for Spark, NiFi, and Ab Initio
  • Deliver demos and knowledge sharing to stakeholders
  • Enhance automated testing and deployments through CI/CD
  • Continuously learn through internal and external training

Requirements

  • Experience building Big Data solutions using Hadoop, GCP, or AWS
  • Strong skills in Scala, Java, Python, Spark, Terraform, Kafka, Kinesis, BigQuery, Dataflow, SQL
  • Solid understanding of Infrastructure as Code
  • Proficiency with Kubernetes and CI/CD practices
  • Familiarity with Confluence, JIRA, and version control (Git/SVN)
  • Ability to convey technical concepts effectively
  • Curiosity and enthusiasm for learning new technologies.
Benefits
  • Flexible working hours
  • Professional development opportunities
  • Opportunity to learn, innovate, and grow
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
Ab InitioApache SparkPySparkScalaApache NiFiETLELTHadoopGCPAWS
Soft Skills
communicationknowledge sharingcuriosityenthusiasm for learning