Data Engineer – Specialist

Vanguard

Data Engineer responsible for designing, developing, and maintaining scalable data pipelines. Requires strong SQL, Python, and cloud platform experience.

Posted 5/5/2026full-timeMalvern • Pennsylvania, Texas • 🇺🇸 United StatesMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

Amazon RedshiftApacheAWSAzureBigQueryCloudETLHadoopKafkaPythonScalaSparkSQL

About the role

Key responsibilities & impact

Develop and maintain scalable ETL (Extract, Transform, Load) processes to efficiently extract data from diverse sources, transform it as required and load it into data warehouses or analytical systems
Design and optimize database architectures and data pipelines to ensure high performance, availability and security while supporting structured and unstructured data
Integrate data from multiple sources, including APIs, third-party services and on-prem/cloud databases to create unified and consistent datasets for analytics and reporting
Collaborate with data scientists, analysts and business stakeholders to understand their data needs, develop data solutions and enable self-service analytics
Develop automated workflows and data processing scripts using Python, Spark, SQL, or other relevant technologies to streamline data ingestion and transformation
Optimize data storage and retrieval strategies in cloud-based data warehouses such as AWS Redshift, Google Big Query, or Azure Synapse, ensuring scalability and cost-efficiency
Maintain and improve data quality by implementing validation frameworks, anomaly detection mechanisms and data cleansing processes
Thoroughly tests code to ensure accuracy and alignment with its intended purpose
Offers tool and data support to business users and team members, ensuring seamless functionality and accessibility
Conducts regression testing for new software releases, identifying issues and collaborating with vendors to resolve them and successfully deploy the software into production

Requirements

What you’ll need

Minimum of three years data analytics, programming, database administration, or data management experience
Undergraduate degree or equivalent combination of training and experience
Strong proficiency in SQL, Python, or Scala for data manipulation, automation and pipeline development
Experience working with big data processing frameworks such as Apache Spark, Hadoop, or Kafka
Hands-on experience with cloud-based data platforms such as AWS (Redshift, Glue), Google Cloud (Big Query, Dataflow), or Azure (Synapse, Data Factory)

Benefits

Comp & perks

Hybrid working model
Continuous learning and development opportunities

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

ETLdata pipelinesdatabase architecturesdata processing scriptsPythonSparkSQLApache SparkHadoopKafka

Soft Skills

collaborationcommunicationproblem-solvingdata quality managementtestingsupport