Senior Big Data Engineer

EXL

Senior Big Data Engineer at EXLService designing high-performance cloud-native data solutions. Collaborating on ETL pipelines and analytics platforms in a hybrid environment.

Posted 4/17/2026full-timeNew York City • New York • 🇺🇸 United StatesSenior💰 $190,000 - $195,000 per yearWebsite

Tech Stack

Tools & technologies

AWSCloudDynamoDBETLHadoopJavaJenkinsKafkaMongoDBNoSQLOraclePostgresPySparkPythonScalaShell ScriptingSparkSplunkSQLTerraform

About the role

Key responsibilities & impact

Independently and collaboratively design, develop, and maintain high-performance, cloud-native data solutions and ETL pipelines in complex enterprise environments.
Analyze system specifications, business requirements, and data models to build scalable and secure platforms for analytics, reporting, and real-time processing.
Architect and implement modern data lake and data warehouse solutions using AWS S3, Glue, and Athena.
Develop event-driven and batch data pipelines with Kafka, AWS Lambda, and PySpark.
Manage CI/CD workflows using Jenkins, Git, and Terraform.
Automate data ingestion, transformation, and provisioning processes, ensuring data quality, lineage, and governance across environments.
Collaborate with cross-functional stakeholders to deliver secure, high-quality data products for insurance and BFSI business domains.
Contribute to enterprise-level projects, driving innovation and continuous improvement in data platform capabilities.
Position may work at various and unanticipated worksites throughout the United States. Telecommuting permitted.

Requirements

What you’ll need

Requires Master’s degree in information technology, Computer Science, Software Engineering, or related IT field plus Six (6) years of Related professional experience.
Six (6) years of experience in designing and developing data pipelines using Spark (PySpark/Scala), Hadoop, Hive, and Kafka.
Scripting and programming with Python, Shell Scripting, and Java.
Five (5) years of experience with data warehouse and data lake architectures, including data modeling, ETL, and data governance.
DevOps tools, including Terraform, Jenkins, and CI/CD pipelines.
SQL and NoSQL databases, including PostgreSQL, Oracle, SQL Server, MongoDB, and DynamoDB.
Four (4) years of experience in monitoring and observability using Splunk, CloudWatch, or similar tools.
Three (3) years of experience in data visualization and reporting tools such as Power BI and Microsoft Fabric.
Two (2) years of experience with Agile methodologies, Scrum processes, and collaboration in cross-functional teams.
One (1) year of experience in AWS Cloud technologies including Glue, Lambda, Step Functions, Athena, CloudFormation, S3, RDS, and DynamoDB.

Benefits

Comp & perks

To apply: Send resume and cover letter to us.careers@exlservice.com. Must cite job title and code EXL69 in response. This notice is subject to ExlService.com, LLC's employee referral program. EEO/Minorities/Females/Vets/Disabilities.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data pipelinesETLdata modelingdata governancedata lake architecturedata warehouse architecturescriptingprogrammingmonitoringdata visualization

Soft Skills

collaborationinnovationcontinuous improvementcommunicationcross-functional teamwork

Certifications

Master’s degree in information technologyMaster’s degree in Computer ScienceMaster’s degree in Software Engineering