Design, build, and maintain analytics-focused data pipelines that ingest, transform, and curate observability data from EDA datacenters
Develop reliable ingestion pipelines for metrics, logs, traces, and hardware health telemetry
Partner with observability engineers to integrate data from tools such as Prometheus, Grafana, Elastic/OpenSearch, and Spark-based platforms
Model and organize data to support exploratory analysis, reliability modeling, forecasting, and long-term trend analysis
Build and optimize batch and streaming workflows that support both near-real-time analytics and historical analysis
Implement data quality checks, validation frameworks, and monitoring
Define data retention, aggregation, and enrichment strategies
Enable self-service analytics by improving data discoverability, documentation, and usability
Collaborate with data scientists and analysts to understand analytical requirements and evolve datasets
Continuously improve pipeline scalability, reliability, and performance

Requirements

MS (preferred) or BS in Computer Science (or equivalent experience) or a related field
10+ years of experience designing, building, and operating large-scale data pipelines and data platforms for distributed systems or infrastructure data
Proficiency in Python and SQL
Experience with distributed data processing frameworks such as Spark
Familiarity with observability and telemetry data, including metrics, logs, traces, and time-series data
Experience designing data models and schemas that support flexible analysis and forecasting
Ability to take ownership of data engineering initiatives and drive them end-to-end in collaboration with multi-functional partners
Experience implementing data quality, validation, and monitoring for analytics pipelines
Strong communication and collaboration skills

Benefits

equity
benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonSQLdata pipelinesdata processing frameworksdata modelsdata schemasdata qualityvalidation frameworksmonitoringbatch and streaming workflows

Soft Skills

communicationcollaborationownershipinitiativeproblem-solvinganalytical thinkingadaptabilityteamworkleadershipinterpersonal skills

Certifications

MS in Computer ScienceBS in Computer Science