SpotOn

Senior Data Engineer

SpotOn

full-time

Posted on:

Location Type: Hybrid

Location: Chicago • Illinois • Missouri • United States

Visit company website

Explore more

✨ AI Apply
Apply

Salary

💰 $150,000 - $190,000 per year

Job Level

Senior

Tech Stack

AWSCloudDistributed SystemsDockerETLGrafanaJavaScriptKafkaKubernetesMongoDBPostgresPythonSQLTypeScript

About the role

  • Architect, develop, and maintain scalable software solutions for our reporting and analytics platforms.
  • Design and implement data pipelines, ETL processes, and integrations using ClickHouse, Streamkap, PostgreSQL, Snowflake, MongoDB, Kafka, and AWS.
  • Write and Optimize SQL queries that drive merchant reporting outcomes and improve database performance across large-scale, distributed systems.
  • Contribute to defining and refining system architectures, including cloud infrastructure and containerization strategies.
  • Implement robust data observability monitoring, logging, and alerting solutions using tools like Grafana, Metaplane, and OpenTelemetry.
  • Mentor junior and mid-level engineers, promoting technical excellence and best practices.

Requirements

  • 5+ years of professional software and data engineering experience.
  • Proficient in Python; experience with GO and TypeScript or JavaScript is highly beneficial.
  • Extensive experience with databases and data warehouses such as ClickHouse, PostgreSQL, and MongoDB.
  • Strong understanding of real-time data streaming and messaging systems, especially Kafka.
  • Experience designing and implementing robust ETL pipelines and handling large-scale data migrations.
  • Familiarity with cloud services, especially AWS, including IAM roles, S3, RDS, and MSK.
  • Proven ability in performance tuning and optimization for high-volume, low-latency data systems.
  • Experience applying core data observability principles to create a transparent and resilient data platform.
  • Comfortable with containerization technologies such as Docker and orchestration tools like Kubernetes.
  • Strong experience with infrastructure as code (IaC) tools and best practices.
  • Deep understanding of software development best practices, CI/CD pipelines, and DevOps methodologies.
Benefits
  • Competitive salary
  • Offers Equity
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonGOTypeScriptJavaScriptSQLETLdata pipelinesperformance tuningcontainerizationinfrastructure as code
Soft Skills
mentoringtechnical excellencebest practices