EXL

Senior Big Data Engineer

EXL

full-time

Posted on:

Location Type: Hybrid

Location: New York CityNew YorkUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $190,000 - $195,000 per year

Job Level

About the role

  • Independently and collaboratively design, develop, and maintain high-performance, cloud-native data solutions and ETL pipelines in complex enterprise environments.
  • Analyze system specifications, business requirements, and data models to build scalable and secure platforms for analytics, reporting, and real-time processing.
  • Architect and implement modern data lake and data warehouse solutions using AWS S3, Glue, and Athena.
  • Develop event-driven and batch data pipelines with Kafka, AWS Lambda, and PySpark.
  • Manage CI/CD workflows using Jenkins, Git, and Terraform.
  • Automate data ingestion, transformation, and provisioning processes, ensuring data quality, lineage, and governance across environments.
  • Collaborate with cross-functional stakeholders to deliver secure, high-quality data products for insurance and BFSI business domains.
  • Contribute to enterprise-level projects, driving innovation and continuous improvement in data platform capabilities.
  • Position may work at various and unanticipated worksites throughout the United States. Telecommuting permitted.

Requirements

  • Requires Master’s degree in information technology, Computer Science, Software Engineering, or related IT field plus Six (6) years of Related professional experience.
  • Six (6) years of experience in designing and developing data pipelines using Spark (PySpark/Scala), Hadoop, Hive, and Kafka.
  • Scripting and programming with Python, Shell Scripting, and Java.
  • Five (5) years of experience with data warehouse and data lake architectures, including data modeling, ETL, and data governance.
  • DevOps tools, including Terraform, Jenkins, and CI/CD pipelines.
  • SQL and NoSQL databases, including PostgreSQL, Oracle, SQL Server, MongoDB, and DynamoDB.
  • Four (4) years of experience in monitoring and observability using Splunk, CloudWatch, or similar tools.
  • Three (3) years of experience in data visualization and reporting tools such as Power BI and Microsoft Fabric.
  • Two (2) years of experience with Agile methodologies, Scrum processes, and collaboration in cross-functional teams.
  • One (1) year of experience in AWS Cloud technologies including Glue, Lambda, Step Functions, Athena, CloudFormation, S3, RDS, and DynamoDB.
Benefits
  • To apply: Send resume and cover letter to us.careers@exlservice.com. Must cite job title and code EXL69 in response. This notice is subject to ExlService.com, LLC's employee referral program. EEO/Minorities/Females/Vets/Disabilities.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data pipelinesETLdata modelingdata governancedata lake architecturedata warehouse architecturescriptingprogrammingmonitoringdata visualization
Soft Skills
collaborationinnovationcontinuous improvementcommunicationcross-functional teamwork
Certifications
Master’s degree in information technologyMaster’s degree in Computer ScienceMaster’s degree in Software Engineering