Data Engineer – Web Scraping, ETL

TechBiz Global

Data Engineer managing web scraping and ETL pipelines for energy markets. Contributing to data infrastructure and collaborating across teams with a focus on quality and performance.

Posted 4/22/2026full-timeRemote • 🇷🇴 RomaniaMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

ETLPostgresPythonSQLTerraform

About the role

Key responsibilities & impact

Monitor and manage overnight scraper and ingestion runs, triaging failures and applying fixes in real time to minimize data gaps before US market open
Verify data completeness and quality across all automated feeds, flagging anomalies and coordinating with the Houston team on persistent issues
Maintain run logs, error documentation, and escalation notes for seamless async handoffs
Build and maintain scrapers, parsers, and ingestion pipelines across a growing set of energy market data domains
Contribute to the design and build-out of our broader ETL infrastructure, including scheduling, orchestration, and error handling
Write transformation logic to clean, normalize, and load raw data into PostgreSQL staging and production tables
Optimize existing pipelines for performance, reliability, and cost efficiency
Help build monitoring dashboards and alerting for pipeline health and data freshness
Document data lineage, schema changes, and pipeline dependencies

Requirements

What you’ll need

3+ years of experience building and maintaining ETL pipelines or data engineering systems
Strong Python skills with experience in web scraping, data parsing, and automation
Proficiency in SQL and experience working with relational databases (PostgreSQL preferred)
Experience with headless browsers, anti-bot mitigation, and scraping resilience patterns
Strong debugging instincts and ability to triage pipeline failures quickly
Clear written communication in English for async collaboration and documentation
Experience with energy, commodities, or financial data pipelines (preferred)
Familiarity with FERC-regulated pipeline data, EIA reporting, or utility/regulatory filings (preferred)
Experience with PostgreSQL-specific features (partitioning, materialized views, JSONB, pg_cron, logical replication)
Familiarity with infrastructure-as-code (Terraform, CloudFormation) or containerized deployments (preferred)
Prior experience working on a distributed team across time zones

Benefits

Comp & perks

Competitive compensation and benefits with room to grow as the team scales
Direct impact on the data infrastructure behind a leading natural gas intelligence platform
A small, senior team where your work is visible and valued from day one
Flexible remote work with clear async workflows
Exposure to the North American energy markets and commodity data at scale

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

ETL pipelinesdata engineeringPythonweb scrapingdata parsingSQLPostgreSQLdebugginginfrastructure-as-codecontainerized deployments

Soft Skills

clear written communicationtriaging failurescollaborationdocumentation