Upwork

Lead Data Engineer

Upwork

full-time

Posted on:

Location: 🇺🇸 United States

Visit company website
AI Apply
Apply

Salary

💰 $151,500 - $215,500 per year

Job Level

Senior

Tech Stack

PythonSQL

About the role

  • As a Lead AI Data Engineer on our Data Platform & Services (DPS) team, you’ll combine advanced data engineering expertise with cutting-edge AI practices to deliver production-grade systems that transform how Upwork uses data. You’ll design and deploy agentic frameworks, natural language querying (NLQ) solutions, and LLM evaluation strategies that make insights accessible at scale. This is a chance to deliver visible impact—accelerating decision-making, enabling self-service analytics, and empowering stakeholders across the company.
  • Responsibilities:
  • Design and implement scalable agentic frameworks that coordinate multiple AI agents to deliver accurate and reliable outcomes.
  • Build and optimize natural language query systems that provide intuitive, compliant, and self-service access to enterprise data.
  • Develop and maintain frameworks for evaluating prompts and LLMs, driving measurable improvements in accuracy, resilience, and scalability.
  • Partner with data engineering peers to integrate AI orchestration with existing pipelines using Python, SQL, and Snowflake.
  • Contribute to AI-powered summarization and explanation tools that enhance reporting, insights, and executive decision-making.
  • Collaborate with product, analytics, and business teams to ensure AI solutions align with measurable business goals.
  • What it takes to catch our eye:
  • Proven success delivering AI-powered data systems in production, including hands-on experience with LLMs and prompt engineering.
  • Strong foundation in modern data engineering with expertise in Python, SQL, and platforms such as Snowflake.
  • Ability to design agentic orchestration frameworks that scale across diverse business scenarios.
  • Collaborative problem-solver with excellent communication skills, able to align stakeholders and create clarity across teams.
  • Growth mindset—eager to learn, iterate, and deliver measurable outcomes through applied AI.

Requirements

  • Proven success delivering AI-powered data systems in production, including hands-on experience with LLMs and prompt engineering
  • Strong foundation in modern data engineering with expertise in Python, SQL, and platforms such as Snowflake
  • Ability to design agentic orchestration frameworks that scale across diverse business scenarios
  • Collaborative problem-solver with excellent communication skills, able to align stakeholders and create clarity across teams
  • Growth mindset—eager to learn, iterate, and deliver measurable outcomes through applied AI
Woolpert

Cloud Data Engineer

Woolpert
Juniorfull-time$60k–$65k / year🇺🇸 United States
Posted: 2 hours agoSource: boards.greenhouse.io
AzureCloudJavaScriptPythonSQLTableau
General Dynamics Information Technology

Cloud/Data Engineer – TS/SCI with Polygraph

General Dynamics Information Technology
Senior · Leadfull-time$161k–$207k / yearVirginia · 🇺🇸 United States
Posted: 3 hours agoSource: gdit.wd5.myworkdayjobs.com
ApacheAWSCloudSpark
Blizzard Entertainment

Data Engineer

Blizzard Entertainment
Mid · Seniorfull-time$78k–$143k / yearCalifornia · 🇺🇸 United States
Posted: 3 hours agoSource: activision.wd1.myworkdayjobs.com
AirflowAWSAzureBigQueryCloudETLGoogle Cloud PlatformOraclePython
Allata

Data Architect – Databricks

Allata
Mid · Seniorfull-timeTexas · 🇺🇸 United States
Posted: 7 hours agoSource: jobs.lever.co
AirflowAWSAzureCloudETLGrafanaJenkinsMS SQL ServerOraclePostgresPrometheusPySpark+4 more
Capital Technology Group

Data Engineer

Capital Technology Group
Mid · Seniorfull-time$110k–$165k / year🇺🇸 United States
Posted: 8 hours agoSource: boards.greenhouse.io
AirflowAmazon RedshiftBigQueryCloudETLPySparkPythonSparkSQL