Data Architect – Databricks
Allata
AirflowAWSAzureCloudETLGrafanaJenkinsMS SQL ServerOraclePostgresPrometheusPySpark+4 more
Lead Data Engineer / DBA
IDERA Software
full-time
Posted on:
Location: 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
AirflowAWSEC2ETLPythonSQLTableau
About the role
- Senior technical leader owning design, performance, and scalability of internal data warehouse and production databases.
- Lead data engineering function and mentor junior data engineers.
- Own and manage AWS-based data infrastructure related to the data warehouse and ETL systems, including provisioning, system performance, and cost optimization.
- Design, implement, and maintain end-to-end ETL pipelines for data ingestion, transformation, and integration from internal and third-party systems.
- Optimize queries and indexes for production application databases to ensure fast, reliable access.
- Triage and resolve data integrity issues across the warehouse and source systems.
- Partner with BI analysts and stakeholders to enable high-quality reporting and analytics.
- Support data tooling and BI platforms such as Yellowfin, Tableau, PowerBI and others.
- Ensure secure and performant connectivity between CDATA drivers and data warehouse.
Requirements
- 5+ years of experience in data engineering, data infrastructure, or database administration roles.
- Expert-level SQL skills, with strong experience in relational database performance tuning and optimization.
- Hands-on experience managing AWS infrastructure, including RDS, S3, EC2, and IAM.
- Proven ability to design and maintain scalable, maintainable ETL pipelines and data workflows.
- Experience owning both production and warehouse environments in a high-volume data environment.
- Strong communication and collaboration skills with cross-functional teams.
- Prior experience in a team lead or mentorship capacity over other data engineers (preferred).
- Experience with BI tools like Yellowfin, Tableau, Looker, PowerBI, or equivalent (preferred).
- Familiarity with version-controlled data workflows (e.g., dbt, Airflow) (preferred).
- Knowledge of data security, compliance, and governance best practices (preferred).
- Exposure to scripting languages like Python for ETL tasks and automation (preferred).
