Senior Workflow Orchestration Engineering Lead – Airflow, Scheduling Platforms

Bank of America

Senior Workflow Orchestration Engineering Lead overseeing development and scaling of Apache Airflow platform. Leading technical direction and providing mentorship to engineering teams in the fintech sector.

Posted 5/13/2026full-timePennington • New Jersey • 🇺🇸 United StatesSenior💰 $106,500 - $173,700 per yearWebsite

Tech Stack

Tools & technologies

AirflowAmazon RedshiftAWSAzureBigQueryCloudFluxGoGoogle Cloud PlatformGrafanaJavaKubernetesNode.jsPrometheusPythonSparkTerraformVault

About the role

Key responsibilities & impact

Designs, develops and is accountable for feature delivery
Applies enterprise standards for solution design, coding and quality
Ensures solution meets product acceptance criteria with minimal technical debt
Guides the team on work breakdown and execution
Works with the Product Owner to ensure that product backlog/requirements are healthy, with clear acceptance criteria
Plays a team lead role (as an individual contributor) and mentors the team
Guides team members with skills and practices (planning and estimation, peer reviews, and other engineering practices)

Requirements

What you’ll need

5–8+ years building/operating data or platform systems
3+ years running Airflow in production at scale (hundreds–thousands of DAGs and high task throughput)
Deep Airflow expertise: DAG design and testing, idempotency, deferrable operators/sensors, dynamic task mapping, task groups, datasets, pools/queues, SLAs, retries/backfills, cross-DAG dependencies
Strong Kubernetes experience running Airflow and supporting services: Helm, autoscaling, node/pod tuning, topology spread, network policies, PDBs, and blue/green or canary strategies.
Automation-first mindset: Terraform, Helm, GitOps (Argo CD/Flux), and CI/CD for platform lifecycle; policy-as-code (OPA/Gatekeeper/Conftest) for DAG, connection, and secrets changes.
Proficiency in Python for authoring operators/hooks/utilities; solid Bash; familiarity with Go or Java is a plus
Observability and SRE practices: Prometheus/Grafana/StatsD, centralized logging, alert design, capacity/throughput modeling, performance tuning
Data platform experience with at least one major cloud (AWS/Azure/GCP) and systems like Snowflake/BigQuery/Redshift, Databricks/Spark, EMR/Dataproc; strong grasp of IAM, VPC networking, and storage (S3/GCS/ADLS)
Security/compliance: SSO/OIDC, RBAC, secrets management (Vault/Secrets Manager), auditing, least-privilege connection management, and change control
Proven incident leadership, runbook creation, and platform roadmap execution; excellent cross-functional communication

Benefits

Comp & perks

industry-leading benefits
access to paid time off
resources and support to our employees

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AirflowKubernetesTerraformGitOpsPythonBashPrometheusGrafanaAWSSnowflake

Soft Skills

team leadmentoringplanningestimationcross-functional communicationincident leadershiprunbook creationexecution