Flex

Staff Data Engineer

Flex

full-time

Posted on:

Location: California • 🇺🇸 United States

Visit company website
AI Apply
Apply

Salary

💰 $199,000 - $262,000 per year

Job Level

Lead

Tech Stack

AirflowAWSCassandraETLHadoopJavaKafkaNoSQLPythonSparkSQLTerraform

About the role

  • Design, implement, and maintain high-quality data infrastructure services, including Data Lake, Kafka, Amazon Kinesis, and data access layers
  • Develop robust and efficient DBT models and jobs to support analytics reporting and machine learning modeling
  • Closely collaborate with the Analytics team for data modeling, reporting, and data ingestion
  • Create scalable real-time streaming pipelines and offline ETL pipelines
  • Design, implement, and manage a data warehouse that provides secure access to large datasets
  • Continuously improve data operations by automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability
  • Create engineering documentation for design, runbooks, and best practices
  • Shape the future of finance data platforms to enable Machine Learning and Business Intelligence across the company

Requirements

  • A minimum of 8 years of industry experience in the data infrastructure/data engineering domain
  • A minimum of 8 years of experience with Python and SQL
  • Java experience is a plus
  • A minimum of 4 years of industry experience using DBT
  • A minimum of 4 years of industry experience using Snowflake and its basic features
  • A minimum of 4 years of industry experience using Infrastructure as Code tools, specifically CDK and Terraform
  • Strong written and verbal communication skills for key collaboration
  • Familiarity with AWS services (Lambda, Step Functions, Glue, RDS, EKS, DMS, EMR)
  • Industry experience with big data platforms and tools such as Kafka, Hadoop, Hive, Spark, Cassandra, Airflow
  • Industry experience working with relational and NoSQL databases in a production environment
  • Strong fundamentals in data structures, algorithms, and design patterns
  • Prior experience working on cross-functional teams
  • Experience with CI/CD to improve code stability and code quality
  • Motivated to help other engineers succeed and be effective
  • Comfortable working in an ambiguous, fast-paced, high-growth environment
Woolpert

Cloud Data Engineer

Woolpert
Juniorfull-time$60k–$65k / year🇺🇸 United States
Posted: 2 hours agoSource: boards.greenhouse.io
AzureCloudJavaScriptPythonSQLTableau
General Dynamics Information Technology

Cloud/Data Engineer – TS/SCI with Polygraph

General Dynamics Information Technology
Senior · Leadfull-time$161k–$207k / yearVirginia · 🇺🇸 United States
Posted: 2 hours agoSource: gdit.wd5.myworkdayjobs.com
ApacheAWSCloudSpark
Blizzard Entertainment

Data Engineer

Blizzard Entertainment
Mid · Seniorfull-time$78k–$143k / yearCalifornia · 🇺🇸 United States
Posted: 3 hours agoSource: activision.wd1.myworkdayjobs.com
AirflowAWSAzureBigQueryCloudETLGoogle Cloud PlatformOraclePython
Allata

Data Architect – Databricks

Allata
Mid · Seniorfull-timeTexas · 🇺🇸 United States
Posted: 7 hours agoSource: jobs.lever.co
AirflowAWSAzureCloudETLGrafanaJenkinsMS SQL ServerOraclePostgresPrometheusPySpark+4 more
Capital Technology Group

Data Engineer

Capital Technology Group
Mid · Seniorfull-time$110k–$165k / year🇺🇸 United States
Posted: 8 hours agoSource: boards.greenhouse.io
AirflowAmazon RedshiftBigQueryCloudETLPySparkPythonSparkSQL