PartnerOne

Senior Data Platform Engineer

PartnerOne

full-time

Posted on:

Location Type: Remote

Location: Colombia

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowAmazon RedshiftApacheAWSCloudDistributed SystemsDockerGrafanaJavaKubernetesPrometheusPythonScalaSparkTerraform

About the role

  • Design, build, and maintain core platform infrastructure across **AWS (EKS, EMR, Glue, S3, Terraform)**.
  • **Develop scalable systems** to orchestrate 10,000s of data processing jobs efficiently and reliably.
  • Partner with data and ML teams to deliver robust, **cloud-native environments for** large-scale computation.
  • **Automate infrastructure** provisioning and deployments using Terraform, GitHub Actions, GitLab CI, or Harness.
  • **Optimize** cost, reliability, and performance across clusters, data stores, and compute workloads.
  • **Build tooling and abstractions** to simplify developer workflows and improve platform usability.
  • Implement observability and monitoring best practices using **Prometheus, Grafana, and Dynatrace.**
  • Collaborate cross-functionally to evolve our architecture and scale our data platform to the next level.

Requirements

  • BS in Computer Science, Engineering, or equivalent experience.
  • - 3+ years of experience building and operating distributed systems or data platforms.
  • - Strong proficiency in **Scala, Java, or Python**.
  • - Hands-on experience with **AWS services** (EKS, EMR, Glue, S3, ECR) and **infrastructure-as-code** (Terraform).
  • - Deep understanding of **containerization** (Docker, Kubernetes) and CI/CD pipelines (GitHub, GitLab CI, or Harness).
  • - Solid grasp of cloud networking, resource management, and cost optimization.
  • - Familiarity with **observability tools** (Prometheus, Grafana, Dynatrace, LogDNA/Mezmo).
  • - Excellent problem-solving, communication, and collaboration skills.
  • **Preferred Qualifications**
  • - Experience with **data engineering tools** such as Apache Spark, Databricks, or Airflow.
  • - Knowledge of **modern data storage formats** (Apache Iceberg, Delta Lake) and cloud data warehouses (Snowflake, Redshift).
  • - Familiarity with **ML or AI infrastructure** and data pipelines.
  • - Experience building developer platforms or frameworks used across teams.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
AWSTerraformScalaJavaPythonDockerKubernetesCI/CDApache SparkData Engineering
Soft skills
problem-solvingcommunicationcollaboration