Underdog Fantasy

Data Engineer

Underdog Fantasy

full-time

Posted on:

Origin:  • 🇺🇸 United States

Visit company website
AI Apply
Apply

Salary

💰 $135,000 - $142,000 per year

Job Level

Mid-LevelSenior

Tech Stack

ApacheAWSAzureCloudGoogle Cloud PlatformKafkaPythonSparkSQLTerraform

About the role

  • Develop data pipelines and maintain production quality datasets that support Underdog’s analytics, data science, and marketing teams
  • Design, build, and optimize scalable data platform infrastructure to support batch and real-time data processing and storage in the cloud
  • Collaborate with analytics, data scientists, engineers, and other business stakeholders to understand data requirements and translate them into scalable technical solutions
  • Implement and maintain monitoring, alerting, and logging mechanisms to ensure the health and performance of the pipelines and platforms
  • Perform validation and build data quality checks on production datasets and ensure there are minimal data quality issues
  • Communicate continuously about progress, blockers, and resolution steps to all relevant stakeholders
  • Blend hands-on pipeline development with shaping the future of Underdog’s evolving data platform

Requirements

  • 3+ years of experience building scalable data pipelines in a cloud-native environment (AWS, GCP, or Azure)
  • 2+ years of experience using dbt, Flink, or Spark for data transformations and BI tools such as Sigma or Looker
  • Advanced proficiency with Python and SQL
  • Some experience with streaming data infrastructure such as Apache Kafka, Apache Flink, GCP Datastream or AWS Kinesis
  • Some familiarity with DevOps practices such as CI/CD pipelines, and infrastructure-as-code tools (e.g. Terraform, CDK)
  • Strong ownership mindset; you’re focused on delivering results in a fast-paced, entrepreneurial environment
  • A proactive problem solver who finds and implements opportunities to improve systems and processes
  • Excellent communication skills, with the ability to influence and collaborate effectively across teams
  • This position may require sports betting licensure based on certain state regulations
Citi

Vice President, Data Engineering

Citi
Seniorfull-time🇮🇳 India
Posted: 22 hours agoSource: citi.wd5.myworkdayjobs.com
ApacheAWSAzureCloudDockerGoogle Cloud PlatformHadoopHDFSJavaKafkaKubernetesMapReduce+5 more
Confluent

Senior Customer Success Technical Architect, French Speaker

Confluent
Seniorfull-time$182k–$214k / year🇺🇸 United States
Posted: 8 days agoSource: jobs.ashbyhq.com
ApacheAWSAzureCassandraCloudDistributed SystemsGoGoogle Cloud PlatformHadoopJavaKafkaLinux+3 more
Confluent

Distributed Systems Software Engineer

Confluent
Senior · Leadfull-time$231k–$271k / yearMassachusetts, New York, North Carolina, South Carolina · 🇺🇸 United States
Posted: 16 days agoSource: jobs.ashbyhq.com
ApacheAWSAzureCloudDistributed SystemsGoGoogle Cloud PlatformJavaJavaScriptKafkaMicroservicesPython+1 more
CrowdStrike

Software Engineer - Fusion Platform

CrowdStrike
Mid · Seniorfull-time$120k–$180k / year🇺🇸 United States
Posted: 22 days agoSource: crowdstrike.wd5.myworkdayjobs.com
ApacheAWSAzureCassandraCloudCyber SecurityDistributed SystemsElasticSearchGoGoogle Cloud PlatformJavaKafka+8 more
Sequoia Connect

Databricks Data Engineer

Sequoia Connect
Mid · Seniorfull-time🇲🇽 Mexico
Posted: 18 days agoSource: www.comeet.com
ApacheAWSAzureCloudJavaPythonScalaSparkSQL