qode.world

Senior Data Engineer

qode.world

full-time

Posted on:

Location Type: Hybrid

Location: South Carolina • New York • South Carolina • United States

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

ApacheAWSAzureCloudDockerETLGoogle Cloud PlatformGrafanaJavaKafkaKubernetesPrometheusPythonScalaSparkSplunkSQL

About the role

  • Design, develop, and maintain real-time data pipelines using Apache Kafka.
  • Build scalable stream processing solutions using Kafka Streams, Spark Streaming, or Flink.
  • Develop and optimize ETL/ELT pipelines for large-scale data processing.
  • Integrate streaming pipelines with data lakes, data warehouses, and analytics platforms.
  • Work with cross-functional teams including Data Scientists, Product Managers, and Analysts.
  • Ensure data reliability, scalability, and performance optimization.
  • Implement data governance, monitoring, and alerting for streaming systems.
  • Troubleshoot production issues and optimize streaming architecture.

Requirements

  • 8+ years of experience in Data Engineering.
  • Strong hands-on experience with Apache Kafka / Kafka Streaming.
  • Experience with Python, Java, or Scala.
  • Strong knowledge of real-time streaming architectures.
  • Experience with Spark, Flink, or Kafka Streams.
  • Strong SQL and data modeling skills.
  • Experience working with cloud platforms (AWS, GCP, or Azure).
  • Familiarity with data lake technologies (S3, Delta Lake, Snowflake, etc.).
  • Experience with Databricks or Snowflake.
  • Experience with containerization (Docker, Kubernetes).
  • Knowledge of CI/CD pipelines and DevOps practices.
  • Experience with monitoring tools like Prometheus, Grafana, or Splunk.
  • Experience with event-driven architecture.
  • Experience building high-throughput, low-latency data systems.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
Apache KafkaKafka StreamsSpark StreamingFlinkETLELTSQLPythonJavaScala
Soft Skills
collaborationtroubleshootingoptimizationdata governancemonitoringalerting