Ness Digital Engineering

Senior Architect, Kafka

Ness Digital Engineering

full-time

Posted on:

Location Type: Remote

Location: Remote • Illinois, Texas • 🇺🇸 United States

Visit company website
AI Apply
Apply

Job Level

Senior

Tech Stack

AnsibleAWSCloudDNSGradleJavaJenkinsKafkaKubernetesMavenMicroservicesPrometheusPythonRabbitMQSplunkTerraformVaultZookeeper

About the role

  • Setup CI/CD pipeline for application deployment in Kubernetes
  • Setup Confluent Kafka (MRC or CFK) across all the regions in hybrid environment
  • Setup Rancher and downstream Kubernetes clusters in multiple environments and regions
  • Setup IaC pipelines using TFE and Ansible to automate the Kafka cluster deployments
  • Setup IaC pipelines using TFE and Ansible to automate the Rancher and downstream K8 cluster deployments
  • Build new shared infrastructure services for on premises failover environment: S3, Confluent Kafka, Data Store
  • Establish connectivity between new failover shared services and existing shared services: Secret, identity, LDA, DNS, Artifactory, Jenkins, Splunk
  • Automate deployment DR strategy and data replication between Cloud and failover environment for applications and shared services
  • Integrate CI/CD deployment tools and continuously improve DevOps processes
  • Code, test, troubleshoot, debug, and document solutions; use agile development to provision, configure, and monitor shared infrastructure services

Requirements

  • Setup CI/CD pipelines using Jenkins, Artifactory, Confluent CFK, Kubernetes, Vault, SonarQube, GitHub, Terraform, Ansible, Rancher, and Harness
  • Experience deploying applications on Kubernetes using Rancher, Helm Charts and Harness
  • Experience deploying Kafka MRC or CFK
  • Knowledge of monitoring tools like LogicMonitor, Splunk, SignalFX, Prometheus
  • Experience with AWS services and hybrid on‑prem/cloud environments
  • Experience with S3 replication using Cloudian
  • Kubernetes administration: Helm, CRDs, K8s Operators, PVCs, CSI plug-ins, secrets management
  • CFK administration: Kafka Kraft/Zookeeper, Kafka Connect, Kafka monitoring (consumer lag, broker health, topic growth)
  • Kafka cluster management: topics, partitions, brokers, backup solutions, data replication
  • Experience with Rancher RKE2 K8s clusters and orchestration platforms
  • K8s cluster management, monitoring, and operational tools integration
  • Hands-on experience with migrations tools and on-premises data center operations
  • Experience with Terraform Enterprise (TFE) and Ansible for IaC automation
  • Hands-on scripting experience in Python or other languages
  • Experience managing Helm charts and deploying microservices to Kubernetes
  • Intermediate knowledge of development tools like Maven/Gradle and Java
  • Experience with distributed message brokers (Kafka, RabbitMQ, ActiveMQ, Amazon Kinesis)
  • Familiarity with CI/CD deployment tools, techniques, and automation frameworks
  • Good to have: CI/CD pipelines for Flink-based streaming applications

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
CI/CD pipelinesKubernetesConfluent KafkaTerraformAnsibleRancherHelmPythonAWSS3
Creative Chaos

Mobile Architect

Creative Chaos
Senior · Leadfull-time🇺🇸 United States
Posted: 6 hours agoSource: apply.workable.com
AndroidFlutterGradleiOSReactReact Native
Guidehouse

Dynamics 365 Architect

Guidehouse
Mid · Seniorfull-time$106k–$176k / year🇺🇸 United States
Posted: 1 day agoSource: guidehouse.wd1.myworkdayjobs.com
SQL
GEHA Health

Business Architect

GEHA Health
Mid · Seniorfull-time$79k–$99k / year🇺🇸 United States
Posted: 2 days agoSource: geha.wd5.myworkdayjobs.com