Senior Data Engineer

Red Hat

Senior Data Engineer building Snowflake-Databricks pipelines and machine-learning systems for Red Hat’s enterprise open-source software platform. Deploying AI analytics applications, MLOps workflows, containers, and security controls.

Posted 8/4/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $158,309 - $180,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in architecting and implementing high-volume data pipelines using Snowflake and Databricks, along with proficiency in MLOps practices and enterprise security compliance. Capable of managing CI/CD processes and deploying containerized applications in cloud environments.

Highest-signal resume keywords

Snowflake Data Pipeline ArchitectureApache Airflow Workflow OrchestrationDatabricks AdministrationMLOps with MLflowEnterprise Security Compliance Assessments

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PySparkDbtNER Systems DevelopmentXGBoostScikit-learnKerasTransformer ArchitecturesTime-Series ForecastingCI/CD with Git and TektonContainerization with buildah and skopeo

Tools & Technologies

DatabricksAmazon S3Red Hat OpenShiftKubernetesMLflowSonarQubeQualysSplunk

Industry Keywords

MLOpsData EngineeringInformation SecurityCompliance AuditsVulnerability Scanning

Tech Stack

Tools & technologies

AirflowApacheKerasKubernetesOpenShiftPySparkScikit-LearnSplunk

About the role

Key responsibilities & impact

Architect and implement high-volume data pipelines between Snowflake and Databricks using PySpark and dbt
Orchestrate pipeline scheduling, dependencies, monitoring, and automated failure recovery with Apache Airflow
Administer Databricks platforms, including IAM roles, Amazon S3 access, secrets, governance policies, and cluster configurations
Design and deploy vector-based retrieval architecture and AI-driven marketing decision-automation workflows
Operationalize MLOps with MLflow and Lakehouse monitoring
Build NER, predictive, deep learning, and time-series forecasting models
Manage CI/CD pipelines with Git and Tekton
Build and publish container images using buildah and skopeo
Deploy and maintain containerized models and applications on Red Hat OpenShift/Kubernetes
Manage network routes, TLS termination, and high-availability services
Lead enterprise security compliance assessments across 20+ controls
Perform SAST, vulnerability scanning, Privacy Impact Assessments, and STRIDE-based threat modeling
Collaborate with information security teams to remediate vulnerabilities, support compliance audits, and maintain Splunk logging and monitoring

Requirements

What you’ll need

Bachelor's degree in Computer Science or related field and five (5) years of experience, or Master's degree and three (3) years of experience
U.S. or foreign equivalent degree
At least three (3) years of experience architecting high-volume Snowflake-to-Databricks data pipelines using PySpark and dbt
At least three (3) years of experience orchestrating workflows with Apache Airflow, including DAG dependencies, failure recovery, and monitoring
At least three (3) years of experience administering Databricks, Amazon S3 IAM access, platform vaults, OpenShift secrets, governance, and cluster policies
At least three (3) years of experience building NER systems with TextBlob, gensim, and fastText
At least three (3) years of experience developing models with XGBoost and Scikit-learn
At least three (3) years of experience constructing Keras deep learning architectures and time-series forecasting models
At least three (3) years of experience implementing information retrieval systems using Transformer architectures and Transfer Learning
At least three (3) years of experience with MLflow, automated model monitoring, Git, Tekton, buildah, skopeo, and Red Hat OpenShift/Kubernetes
At least three (3) years of experience with enterprise security compliance assessments, SonarQube, Qualys, Privacy Impact Assessments, and STRIDE threat modeling

Benefits

Comp & perks

Remote telecommuting arrangement
Bonus, commission, and/or equity eligibility
Flexible work environments
Reasonable accommodations for job applicants