Principal Engineer, Software Development & Production Infrastructure

Palo Alto Networks

Principal Engineer at Palo Alto Networks focusing on building scalable systems for the observability platform. Collaborating globally to innovate and drive the engineering roadmap.

Posted 7/15/2026full-timeRemote • California, Colorado, Florida, Massachusetts, Texas • 🇺🇸 United StatesLead💰 $147,000 - $237,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive experience in high-scale infrastructure and systems architecture, with a strong focus on building resilient backend services using Go. Proficient in managing cloud environments with AWS and GCP, and skilled in implementing Infrastructure as Code using Terraform.

Highest-signal resume keywords

KubernetesGo ProgrammingAWSGCPInfrastructure as Code (Terraform)

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Distributed SystemsBackend DevelopmentSystems ArchitectureDebuggingCAP TheoremEventual ConsistencyDistributed TracingLinux InternalsNetworking ProtocolsResource Isolation

Tools & Technologies

CI/CD PipelinesMicroservicesTelemetry ProcessingDynamic Testing EnvironmentsDeveloper Tooling

Industry Keywords

Production EngineeringHigh-Scale InfrastructureCloud ComputingContainerizationEphemeral Environments

Tech Stack

Tools & technologies

AWSDistributed SystemsGoGoogle Cloud PlatformJavaKubernetesLinuxMicroservicesPythonRustTerraform

About the role

Key responsibilities & impact

Solve complex distributed systems problems at the largest scales in the world.
Scale our production infrastructure and architecture globally using Kubernetes, GCP, and AWS.
Use Go to build and operate highly scalable, resilient backend services.
Develop the internal tools necessary to monitor, alert, and optimize our live production footprint.
Architect & Build: Design high-scale developer tooling, dynamic testing environments, and CI/CD pipelines in a 100% modern, containerized microservices ecosystem.
Infrastructure as Code (IaC): Treat infrastructure as a first-class citizen by defining and managing entire ephemeral environments using declarative IaC (Terraform).
Identify and eliminate systemic bottlenecks across the development lifecycle through architectural changes, advanced tooling, and near-real-time telemetry processing.

Requirements

What you’ll need

8–10+ years of relevant experience in high-scale infrastructure, production engineering, systems architecture, or developer platform roles.
7 + years of experience in at least one backend language (e.g., Go, Python, Java, C++, C#, or Rust).
5 + years of deep expertise building and debugging systems that deal with CAP theorem trade-offs, eventual consistency, and distributed tracing.
Robust experience working with AWS or GCP and navigating Kubernetes clusters.
Deep knowledge of Linux internals, process management, resource isolation, and networking protocols (OSI model, load balancing, service meshes).
A proven track record of estimating complex work effectively, debugging distributed architectures via logs/traces, and proactively identifying design edge cases.

Benefits

Comp & perks

Employee benefits include health insurance, retirement plans, flexible work arrangements, and professional development opportunities.