Responsible for designing, building, and maintaining efficient, scalable, and fully automated data pipelines and architectures that support various business needs
Design, develop, and maintain scalable data pipelines to collect, process, and transform data from various sources
Integrate data from multiple sources, ensuring data quality and consistency across the organization
Build and maintain data storage solutions, including data warehouses and data lakes, ensuring optimal performance and reliability
Implement data transformation and enrichment processes to prepare data for analytics and reporting
Leverage cloud technologies, particularly AWS, to optimize and manage data infrastructure
Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions
Create and maintain comprehensive documentation for data pipelines, data models, and related processes
Mentor and guide junior data engineers/analysts on data engineering best practices and industry standards

Requirements

Minimum of 4 years of experience in data engineering or a related field
Strong experience with data pipeline/orchestration and ETL development using tools such as Apache Airflow, Kubernetes, Databricks Workflows or similar
Demonstrated experience in designing highly efficient programs capable of processing terabytes of data
Strong proficiency in SQL and experience with relational databases (e.g., SQLServer, PostgreSQL) and NoSQL databases (e.g., MongoDB, OpenSearch)
Experience with cloud technologies, particularly AWS (e.g., S3, Redshift, Glue, Lambda, Athena)
Proficient in writing data programs in R, Python, Scala, or similar language
Familiarity with big data technologies such as Apache Spark, Databricks, or similar
Familiarity with data visualization tools and data migration methods
Excellent problem-solving skills and attention to detail
Strong communication and interpersonal skills, with the ability to work effectively with diverse teams and stakeholders

Benefits

Equal employment opportunities
Reasonable accommodation for disabilities

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringdata pipelineETL developmentSQLrelational databasesNoSQL databasesdata transformationdata storage solutionsbig data technologiesdata visualization

Soft Skills

problem-solvingattention to detailcommunicationinterpersonal skillsmentoringcollaboration