Senior AI Data Engineer

Grace Hill

Senior AI Data Engineer focusing on building AI-first data acquisition and reporting systems. Overseeing resilient web scraping infrastructure and optimizing data flow for analytics and reporting.

Posted 7/1/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $190,000 - $210,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in data engineering with a focus on building and maintaining production systems, including web scrapers and reporting infrastructures. Proficient in leveraging LLMs for data parsing and anomaly detection while ensuring system reliability and uptime.

Highest-signal resume keywords

Data EngineeringPython ProgrammingLLM-Powered WorkflowsGCP Data StackReporting and Analytics Design

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Web ScrapingScrapyPlaywrightSeleniumBeautifulSoupData ModelingTransformationsETLELTAnomaly Detection

Soft Skills

Reliability MindsetAccountability

Tools & Technologies

BigQueryCloud ComposerCloud StorageCloud RunGKE

Industry Keywords

Production SystemsData QualityMonitoringAlertingGraceful Handling

Tech Stack

Tools & technologies

AirflowBigQueryCloudETLGoogle Cloud PlatformPythonSelenium

About the role

Key responsibilities & impact

Own and self-heal our fleet of web scrapers
Keep daily scraping runs stable—monitoring, alerting, retries, and graceful handling of upstream failures
Use LLMs for resilient parsing and entity extraction from messy or changing HTML
Own and optimize the serving layer and the ETL/ELT pipelines feeding our BigQuery warehouse
Build our reporting infrastructure—data models, transformations, and dashboards
Drive data quality through rule-based checks and ML/LLM-based anomaly detection
Build and maintain production-grade MCP servers and agentic workflows

Requirements

What you’ll need

6+ years in data engineering, including ownership of mission-critical production systems
Strong Python with deep experience building, maintaining and debugging scrapers (e.g., Scrapy, Playwright, Selenium, BeautifulSoup)
Hands-on experience building LLM-powered and agentic workflows in production
Proven experience designing reporting/analytics layers—data modeling, transformations (e.g., dbt), and BI tools
Hands-on with the GCP data stack—BigQuery, Cloud Composer (managed Airflow), Cloud Storage, Cloud Run or GKE
A reliability mindset—proven track record owning systems, triaging failures, and being accountable for uptime

Benefits

Comp & perks

health, dental and vision insurance
401K
PTO
life insurance
disability insurance