Data Pipeline Engineer – Computer Science

Carnegie Mellon University

Data Pipeline Engineer at Carnegie Mellon University maintaining data quality and pipeline performance. Collaborating with data scientists to optimize data solutions and ensuring compliance with governance standards.

Posted 5/28/2026part-timeRemote • 🇺🇸 United StatesJuniorWebsite

Tech Stack

Tools & technologies

AirflowApacheCloudLinuxPostgresPythonSQL

About the role

Key responsibilities & impact

Monitor and maintain the health and efficiency of data pipelines
Troubleshoot and perform root cause analysis for data discrepancies and pipeline issues
Communicate with data providers to understand data discrepancies and manage changes in data delivery
Implement fixes and enhancements to improve data quality and pipeline performance
Collaborate with data scientists and analysts to understand data needs and implement effective data solutions
Develop strategies for data validation and quality assurance
Optimize data flow and collection to improve system efficiency
Document and manage data pipeline architectures, including maintenance and update protocols
Use tools such as SQL, version control and CI/CD, containerization, task schedulers, python frameworks, and cloud services for data pipeline management
Ensure compliance with data governance and security standards

Requirements

What you’ll need

Bachelor’s Degree required
Minimum one year of research computing experience required
Basic Linux use and administration: system layout, file permissions, shell, utilities (syslog, cron), diagnostic tools (ps, htop, grep, lsof)
Experience in Apache Airflow, preferably version 3.0
Basic database use, especially in Postgres
Rough script programming (Python, bash)
Team software development (git/GitHub, Jira, code reviews, agile methodologies)
Data analysis: diagnosing and fixing runtime errors and logic bugs; performing basic growth projections to predict future problems; communicating results

Benefits

Comp & perks

comprehensive medical, prescription, dental, and vision insurance
generous retirement savings program with employer contributions
tuition benefits
ample paid time off and observed holidays
life and accidental death and disability insurance
free Pittsburgh Regional Transit bus pass
access to our Family Concierge Team to help navigate childcare needs
fitness center access

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data pipeline managementdata validationdata quality assurancetroubleshootingroot cause analysisdata analysisscript programmingbasic database useLinux administrationApache Airflow

Soft Skills

communicationcollaborationproblem-solvingteamworkdocumentation

Certifications

Bachelor's Degree