Kayzen

Senior Data Engineer/Data Ops

Kayzen

full-time

Posted on:

Location Type: Remote

Location: India

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowCloudHadoopJavaKubernetesNoSQLPythonPyTorchSparkSQLTensorflow

About the role

  • Create innovative solutions for handling peta-bytes of data with billions of rows & joins
  • Program and maintain our data pipelines that fuels our on-premise/cloud data warehouse used to generate and serve our models
  • Maintain and improve our fleet of data servers (the software), making sure they are reliable and able to process our billions of logs and data points
  • Develop and productionize data pipelines for our ML models in both bare-metal and the cloud environment
  • Make suggestions and lead projects to improve our data processing capabilities
  • Contribute to the team enabling us to be always better

Requirements

  • Minimum 5+ yrs of professional experience in creating and maintaining big data pipelines
  • Identifying data related process improvements
  • Maintaining Kubernetes, Hadoop and Spark infrastructure
  • Bachelor's/Master’s degree in a quantitative field of Mathematics, Physics, Computer Science, Machine learning Engineering, Business Analytics, Information Management or related field
  • Knowledge of relevant programming languages (Python, Java, etc)
  • Expert in SQL & NoSQL and big data processing pipelines (we use Python, Spark, Airflow)
  • Proven experience managing data infrastructure that can store and process Petabytes of data (we use Hadoop, Spark)
  • Kubernetes wizard
  • Proven affinity with data
  • Strong analytical and problem-solving skills
  • Ability to translate business requirements into data solutions
  • Excellent stakeholder management skills
  • Previous experience with Clickhouse is a plus
  • Previous experience with ad-tech is a plus
  • Experience with Real time big data processing is a plus
  • General understanding of Machine Learning techniques (Neural Networks, Random Forest, etc.) and ML frameworks (Mlflow, PyTorch, Tensorflow, etc.) is a plus
Benefits
  • Exceptional career growth and learning opportunity
  • A unique opportunity to be part of an experienced team of industry experts and entrepreneurs who bring massive change to the Adtech market
  • Direct, day-to-day work experience with the management
  • A fun, driven, and multinational team located across Germany, India, Argentina, Ukraine, Turkey, the UK and soon more countries
  • A flexible work-from-home arrangement
  • A 500-dollar home-office setup budget
  • A 1000-dollar annual learning and development budget
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
big data pipelinesPythonJavaSQLNoSQLHadoopSparkAirflowKubernetesMachine Learning
Soft Skills
analytical skillsproblem-solving skillsstakeholder managementprocess improvementbusiness requirements translation