Harness

Staff Software Engineer – Data Platform, Data Ingestion

Harness

full-time

Posted on:

Location Type: Remote

Location: United States

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Lead

Tech Stack

Distributed SystemsETLJavaKafkaMongoDBPostgresPythonSparkTerraform

About the role

  • Collaborate with principal engineers and architects on the design, architecture, and development of this platform.
  • Solve complex challenges related to data streaming, transformation, and managing extremely large-scale data storage.
  • Collaborate closely with various product engineering teams, offering guidance to facilitate their onboarding onto the data platform.
  • Author high level & low level design documents.
  • Design and implement automation of infrastructure setup using helm, terraform and similar technologies.
  • Work alongside Site Reliability Engineers and cross functional teams to diagnose/troubleshoot any production performance related issues

Requirements

  • Bachelor’s or Master’s degree in computer science
  • Minimum 7-12 years of hands-on experience in backend software development, primarily within the data platform domain and with a focus on distributed systems.
  • Hands-on experience building ETL pipelines with technologies like SQLMesh, DBT, or Spark Structured Streaming
  • Hands-on experience with query engines like Trino
  • Deep exposure to OLAP stores like Pinot, Druid, Clickhouse, StarRocks, Snowflake, or Databricks
  • Working experience with open table architecture such as Iceberg, Delta Lake or Hudi.
  • Experience with data streaming technologies like Flink, Spark Streaming, Kafka Streams etc
  • Familiarity with OLTP datastores such as MongoDB, PostgreSQL
  • Experience scaling and operating production data systems at 10K+ QPS
  • Deep working experience with Java and Python
Benefits
  • Competitive salary
  • Comprehensive healthcare benefit
  • Flexible work schedule
  • Quarterly Harness TGIF-Off / 4 days
  • Paid Time Off and Parental Leave
  • Monthly, quarterly, and annual social and team building events
  • Monthly internet reimbursement

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
backend software developmentdata platformdistributed systemsETL pipelinesSQLMeshDBTSpark Structured Streamingquery enginesOLAP storesJava
Soft skills
collaborationproblem-solvingguidancedocumentation
Certifications
Bachelor's degreeMaster's degree