Tech Stack
ApacheAWSAzureCloudDockerGrafanaKubernetesMicroservicesPrometheusSparkTerraform
About the role
- Design secure, scalable, and cost-optimized multi-cloud architectures (AWS & Azure) and technology roadmaps
- Define data ingestion, storage, processing strategies (batch + streaming) with full lineage, cataloging, and governance
- Decide on build vs. buy for data/AI pipelines and integrate commercial and open-source tools
- Ensure compliance with ISO 27001, SOC2, GDPR, and CCPA
- Deploy Infrastructure-as-Code (Terraform, Bicep) and implement CI/CD for pipelines and microservices
- Build modern data pipelines (Airbyte, dbt, Apache Spark, Azure Data Factory) and enable production ML/AI (Azure ML, SageMaker)
- Run scalable workloads using Docker, ECS/Fargate, Kubernetes (EKS/AKS)
- Establish monitoring and observability (CloudWatch, Azure Monitor, Prometheus, Grafana)
- Apply security best practices (IAM, secrets management, API gateways, OAuth2, Cognito, Azure AD B2C)
- Lead code reviews, define DevOps standards, drive engineering excellence, and mentor engineers
- Partner with clients and internal teams to shape cloud strategies and ensure feasibility and compliance
Requirements
- Bachelor’s degree in Business, Engineering, IT, or related field (Master’s a plus)
- Proven experience designing cloud & data architectures on AWS and/or Azure
- Strong hands-on DevOps expertise (IaC: Terraform, Bicep; CI/CD: GitHub Actions, Azure DevOps; Kubernetes)
- Experience with modern data engineering tools (Airbyte, dbt, Apache Spark, Azure Data Factory)
- Experience with containers and orchestration (Docker, ECS/Fargate, EKS/AKS)
- Knowledge of observability tools (CloudWatch, Azure Monitor, Prometheus, Grafana)
- Knowledge of security best practices and frameworks (ISO 27001, SOC2) and data privacy regulations (GDPR, CCPA)
- Experience with IAM, secrets management, API gateways, OAuth2, Cognito, Azure AD B2C
- Experience supporting ML/AI model deployment and MLOps (Azure ML, SageMaker)
- Leadership skills to mentor engineers and collaborate with client stakeholders