Senior AI Data Engineer

Grace Hill

Senior AI Data Engineer focusing on building AI-first data acquisition and reporting systems. Overseeing resilient web scraping infrastructure and optimizing data flow for analytics and reporting.

Posted 7/1/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $190,000 - $210,000 per yearWebsite

Tech Stack

Tools & technologies

AirflowBigQueryCloudETLGoogle Cloud PlatformPythonSelenium

About the role

Key responsibilities & impact

Own and self-heal our fleet of web scrapers
Keep daily scraping runs stable—monitoring, alerting, retries, and graceful handling of upstream failures
Use LLMs for resilient parsing and entity extraction from messy or changing HTML
Own and optimize the serving layer and the ETL/ELT pipelines feeding our BigQuery warehouse
Build our reporting infrastructure—data models, transformations, and dashboards
Drive data quality through rule-based checks and ML/LLM-based anomaly detection
Build and maintain production-grade MCP servers and agentic workflows

Requirements

What you’ll need

6+ years in data engineering, including ownership of mission-critical production systems
Strong Python with deep experience building, maintaining and debugging scrapers (e.g., Scrapy, Playwright, Selenium, BeautifulSoup)
Hands-on experience building LLM-powered and agentic workflows in production
Proven experience designing reporting/analytics layers—data modeling, transformations (e.g., dbt), and BI tools
Hands-on with the GCP data stack—BigQuery, Cloud Composer (managed Airflow), Cloud Storage, Cloud Run or GKE
A reliability mindset—proven track record owning systems, triaging failures, and being accountable for uptime

Benefits

Comp & perks

health, dental and vision insurance
401K
PTO
life insurance
disability insurance

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Web ScrapingScrapyPlaywrightSeleniumBeautifulSoupData ModelingTransformationsETLELTAnomaly Detection

Soft Skills

Reliability MindsetAccountability