
Senior Big Data Engineer
EXL
full-time
Posted on:
Location Type: Hybrid
Location: New York City • New York • United States
Visit company websiteExplore more
Salary
💰 $190,000 - $195,000 per year
Job Level
Tech Stack
About the role
- Independently and collaboratively design, develop, and maintain high-performance, cloud-native data solutions and ETL pipelines in complex enterprise environments.
- Analyze system specifications, business requirements, and data models to build scalable and secure platforms for analytics, reporting, and real-time processing.
- Architect and implement modern data lake and data warehouse solutions using AWS S3, Glue, and Athena.
- Develop event-driven and batch data pipelines with Kafka, AWS Lambda, and PySpark.
- Manage CI/CD workflows using Jenkins, Git, and Terraform.
- Automate data ingestion, transformation, and provisioning processes, ensuring data quality, lineage, and governance across environments.
- Collaborate with cross-functional stakeholders to deliver secure, high-quality data products for insurance and BFSI business domains.
- Contribute to enterprise-level projects, driving innovation and continuous improvement in data platform capabilities.
- Position may work at various and unanticipated worksites throughout the United States. Telecommuting permitted.
Requirements
- Requires Master’s degree in information technology, Computer Science, Software Engineering, or related IT field plus Six (6) years of Related professional experience.
- Six (6) years of experience in designing and developing data pipelines using Spark (PySpark/Scala), Hadoop, Hive, and Kafka.
- Scripting and programming with Python, Shell Scripting, and Java.
- Five (5) years of experience with data warehouse and data lake architectures, including data modeling, ETL, and data governance.
- DevOps tools, including Terraform, Jenkins, and CI/CD pipelines.
- SQL and NoSQL databases, including PostgreSQL, Oracle, SQL Server, MongoDB, and DynamoDB.
- Four (4) years of experience in monitoring and observability using Splunk, CloudWatch, or similar tools.
- Three (3) years of experience in data visualization and reporting tools such as Power BI and Microsoft Fabric.
- Two (2) years of experience with Agile methodologies, Scrum processes, and collaboration in cross-functional teams.
- One (1) year of experience in AWS Cloud technologies including Glue, Lambda, Step Functions, Athena, CloudFormation, S3, RDS, and DynamoDB.
Benefits
- To apply: Send resume and cover letter to us.careers@exlservice.com. Must cite job title and code EXL69 in response. This notice is subject to ExlService.com, LLC's employee referral program. EEO/Minorities/Females/Vets/Disabilities.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data pipelinesETLdata modelingdata governancedata lake architecturedata warehouse architecturescriptingprogrammingmonitoringdata visualization
Soft Skills
collaborationinnovationcontinuous improvementcommunicationcross-functional teamwork
Certifications
Master’s degree in information technologyMaster’s degree in Computer ScienceMaster’s degree in Software Engineering