
Principal Engineer, Data Private Cloud
Wells Fargo
full-time
Posted on:
Location Type: Hybrid
Location: Charlotte • New Jersey • North Carolina • United States
Visit company websiteExplore more
Salary
💰 $159,000 - $305,000 per year
Tech Stack
About the role
- Own the architecture of the enterprise data platform (OpenShift, Kubernetes, modern data stacks)
- Define platform standards for security, scalability, multi-tenancy, and operational excellence
- Lead decisions around compute orchestration (Spark on K8s, YuniKorn), query federation (Trino, Kyuubi), and metadata management (Gravitino, Hive Metastore)
- Design authentication/authorization (Keycloak, AD, Ranger)
- Shape infrastructure strategy and open-source deployment patterns
- Lead Terraform-based IaC and repeatable deployment practices
- Architect networking, ingress, and service mesh configurations
- Oversee PKI, SSL/TLS, and certificate lifecycle management
- Build monitoring and observability strategies (OpenSearch, Prometheus, Grafana)
- Ensure resilience through scheduling, quotas, and capacity planning
- Implement GitOps for declarative deployments
- Provide leadership across: Compute: Spark on K8s, Kyuubi, JupyterHub
- Query/Analytics: Trino, Superset
- Orchestration: Airflow on Kubernetes
- Catalog/Governance: Gravitino, DataHub, Ranger
- Storage: Iceberg, S3/NetApp, PostgreSQL
- Messaging/Search: Kafka, OpenSearch
- Ensure compliance with regulatory requirements (OSFI, SOX, PCI-DSS)
- Implement multi-tenant isolation and robust security boundaries
- Lead security reviews, threat modeling, and remediation
- Partner with Security, Risk, and Compliance teams on audits and controls
Requirements
- 7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
- 5+ years of hands-on experience with Kubernetes in production environments (OpenShift Container Platform strongly preferred)
- Proven track record designing and operating large-scale data platforms in enterprise environments
- Experience in financial services or other highly regulated industries
- Experience with Kubernetes scheduling frameworks (YuniKorn, Volcano) for batch and AI workload optimization
- Contributions to open-source projects in the data or infrastructure
- Experience building and deploying applications with enterprise data sources
- Hands-on experience with transformer architectures and fine-tuning open-source models
- Professional certifications: CKA/CKAD, AWS/Azure/GCP Professional, Terraform Associate
- Experience with GitOps practices (ArgoCD, Flux)
- Background in platform product management or developer experience
Benefits
- Health benefits
- 401(k) Plan
- Paid time off
- Disability benefits
- Life insurance, critical illness insurance, and accident insurance
- Parental leave
- Critical caregiving leave
- Discounts and savings
- Commuter benefits
- Tuition reimbursement
- Scholarships for dependent children
- Adoption reimbursement
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
KubernetesOpenShiftTerraformSparkTrinoKafkaPostgreSQLAirflowJupyterHubIceberg
Soft Skills
leadershipdecision makingcollaborationstrategic planningproblem solvingcommunicationorganizational skillsrisk managementcompliance managementsecurity reviews
Certifications
CKACKADAWS ProfessionalAzure ProfessionalGCP ProfessionalTerraform Associate