Principal DevOps Engineer

NBCUniversal

Principal DevOps Engineer designing a Kubernetes-native platform at NBC for broadcast production. Leading the development of automated cloud infrastructure and systems integrations.

Posted 7/1/2026full-timeRemote • New York • 🇺🇸 United StatesLead💰 $180,000 - $230,000 per yearWebsite

Tech Stack

Tools & technologies

AWSCloudDNSFluxGoGrafanaKubernetesNode.jsPostgresPrometheusPuppetSQLite

About the role

Key responsibilities & impact

Architect a Kubernetes-native platform that models broadcast infrastructure as custom resources.
Lead the technical strategy leveraging Crossplane compositions and custom Go functions to automate provisioning across multi-account AWS environments and on-prem control rooms.
Design, build, and maintain production-grade Kubernetes operators, controllers, and internal platform APIs in Go.
Actively develop custom Crossplane providers to deeply integrate external enterprise platforms (such as NRCS, Venafi, and Infoblox) into our control plane, managing resource lifecycles and approval workflows.
Lead the design of cloud networking, DNS strategies, and cross-account connectivity across hybrid environments, automating VPC topology and dynamic network routing.
Partner closely with broadcast systems engineers, system integrators, and external vendors to bridge the gap between broadcast hardware and automated infrastructure.
Write RFCs, drive architectural decisions, mentor engineers, and establish high-confidence CI/CD pipelines, testing strategies, and GitHub Actions automation.
Own the platform's authorization model, designing hierarchical RBAC systems, resource identifier schemes, and identity integrations that enforce fine-grained access control.
Drive GitOps-based continuous delivery (Flux, Kustomize, Helm) and manage configuration-as-code for compute fleets using Puppet.
Ensure deep operational visibility by designing comprehensive observability and alerting stacks.
Oversee the integration of remote desktop/VDI connectivity solutions, focusing on session authentication, credential management, and gateway routing.

Requirements

What you’ll need

10+ years of experience designing, building, and operating production infrastructure and cloud-native platforms at enterprise scale.
Strong proficiency in Go (systems-level programming, API servers).
Expert-level knowledge of the Kubernetes ecosystem, including CRD/XRD generation, operators, informers, admission webhooks, and RBAC.
Deep production experience with Crossplane, including composite resources, composition functions, and specifically developing custom Crossplane providers in Go to integrate external enterprise platforms.
Extensive production experience with AWS multi-account architectures, cross-account networking patterns, and identity federation.
Production experience with GitOps tooling, specifically Flux (HelmRelease, Kustomization) or ArgoCD for continuous delivery on Kubernetes.
Hands-on experience with Puppet, including module development, PuppetDB, Hiera, and r10k.
Experience designing REST APIs with middleware patterns and modern authentication (OAuth/JWT).
Keen eye for information security, including cross-account IAM trust chains, least-privilege policies, JWT token lifecycles, and secrets abstraction.
Strong background in designing telemetry platforms using Grafana, Prometheus/Mimir, Loki, OpenTelemetry, and metrics collection agents (Alloy, Prometheus Node Exporter).
Working knowledge of PostgreSQL, SQLite or similar relational databases, encompassing schema design, migrations, and query optimization.
Excellent problem-solving skills with a proven ability to present architectural decisions to executives, engage with vendors, and write clear technical documentation.

Benefits

Comp & perks

Health insurance
Dental insurance
Vision insurance
401(k)
Paid leave
Tuition reimbursement
Variety of discounts and perks

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Go ProgrammingKubernetes OperatorsCrossplane CompositionsAWS NetworkingGitOps (Flux, ArgoCD)Puppet Configuration ManagementREST API DesignInformation Security PracticesTelemetry Platform DesignRelational Database Management (PostgreSQL, SQLite)

Soft Skills

Problem-SolvingTechnical DocumentationMentoring EngineersArchitectural Decision-MakingCollaboration with Vendors