Upstart

Senior Data Platform Engineer

Upstart

full-time

Posted on:

Location Type: Remote

Location: Remote • California, Ohio, Texas • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Salary

💰 $163,600 - $226,400 per year

Job Level

Senior

Tech Stack

AirflowAmazon RedshiftAWSDistributed SystemsDockerJenkinsKafkaKubernetesPostgresPythonSparkSQLTerraform

About the role

  • Expand the existing developer tools to support Upstart's various data validation & quality checks by integrating with open-source, 3rd party, and custom data quality solutions.
  • Build a framework to capture Data Lineage and location of critical fields and integrate with Upstart's data catalog solution that informs various data handling rules.
  • Improve data infrastructure uptime and observability.
  • Participate in planning and prioritization by collaborating with stakeholders across the various product verticals and functions (ML, Analytics, Finance, Legal, Privacy, Security) to ensure our architecture aligns with the overall business objectives.
  • Collaborate with Data Governance and Security teams to implement robust privacy requests, data protection mechanisms, access controls, and data lineage.
  • Participate in code reviews and architecture discussions to exchange actionable feedback with peers.
  • Contribute to engineering best practices and mentor junior team members.
  • Help break down complex projects and requirements into sprints.
  • Continuously monitor and improve data platform performance, reliability, and security.
  • Stay up-to-date with emerging technologies and industry best practices in data engineering.
  • Design and ship code independently

Requirements

  • A bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields, with a strong focus on data quality, governance, and data infrastructure.
  • Proficiency in data engineering tech stack; Databricks / PostgreSQL / Python / Spark / Kafka / SQL / AWS / Airflow/ DBT / containers and orchestration (Docker, Kubernetes) and others.
  • Ability to approach problems with first principles thinking, embrace ambiguity, and enjoy collaborative work on complex solutions.
  • Strong foundation in algorithms and data structures and their real-world use cases.
  • Experience and understanding of distributed systems, data architecture design, and big data technologies (e.g., Spark, Kafka, Lakehouse, Databricks).
  • Experience with AWS technologies ( e.g., AWS Lambda, Redshift, RDS, S3, etc.).
  • Knowledge of data quality management, data governance, and data security best practices.
  • Good knowledge of DevOps engineering using Continuous Integration/Delivery tools like Kubernetes, Jenkins, Terraform, etc., thinking about automation, alerting, monitoring, security, and other declarative infrastructure.
  • Ability to explain complex concepts in easy-to-understand ways and navigate environments where problems are not well-defined (and evolve quickly).
Benefits
  • Competitive Compensation (base + bonus & equity)
  • Comprehensive medical, dental, and vision coverage with Health Savings Account contributions from Upstart
  • 401(k) with 100% company match up to $4,500 and immediate vesting and after-tax savings
  • Employee Stock Purchase Plan (ESPP)
  • Life and disability insurance
  • Generous holiday, vacation, sick and safety leave
  • Supportive parental, family care, and military leave programs
  • Annual wellness, technology & ergonomic reimbursement programs
  • Social activities including team events and onsites, all-company updates, employee resource groups (ERGs), and other interest groups such as book clubs, fitness, investing, and volunteering
  • Catered lunches + snacks & drinks when working in offices

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data engineeringdata qualitydata governancedata infrastructurealgorithmsdata structuresdistributed systemsdata architecture designbig data technologiesDevOps engineering
Soft skills
first principles thinkingcollaborative workproblem-solvingmentoringcommunicationadaptabilityplanningprioritizationfeedback exchangecomplex project breakdown