
Data Engineer II
IEHP
full-time
Posted on:
Location Type: Hybrid
Location: Rancho Cucamonga • California • United States
Visit company websiteExplore more
Salary
💰 $104,042 - $137,842 per year
About the role
- Design and develop data warehouse Extraction, Transformation and Loading (ETL) solutions using Microsoft SQL Server Integration Services (SSIS), Azure Data Factory, Synapse Analytics, Az Data Bricks, PySpark ETL.
- Develop and implement data collection processes in conjunction with the data warehouse.
- Source data from legacy systems supporting a centralized data warehouse and reporting platform.
- Develop technical solutions to meet the requirements for Data Warehouse, BI & Analytics.
- Work with Informaticists and Analysts to translate analytic requirements into technical solutions.
- Collaborate and contribute to data integration strategies and visions.
- Create and maintain optimal data pipeline architectures based on micro services based on platform and application requirements.
- Work closely with the Data Engineering team, BI & Analytics team, Data Warehouse Architect, and Data Systems Architect to design data and analytics solutions to increase the usability, completeness, and accuracy of enterprise data.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Analyze user requirements and translate user requirements into database requirements and implement them in database code.
- Provide detailed analysis of data issues, data mapping, and the process for automation and enhancement of data quality.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement process improvements: automating manual pipeline processes, optimizing data ingestion and consumption, re-designing infrastructure for greater scalability, micro services, and others as applicable.
- Create, maintain, and optimize SQL queries and routines.
- Analyze potential data quality issues to determine the root cause and create effective solutions.
- Develop, adopt, and enforce Data Warehouse and ETL standards and architecture.
- Monitor and support ETL processes ensuring integrity and proper integration of all data sources.
- Facilitate problem management and communication among data architects, managers, informaticists and analysts.
- Perform development activities such as source to target mapping validations, identify, document and execute unit test cases/scripts, peer and lead code reviews per code review checklist and document test and review results.
- Provide ongoing proactive technical support for ETL and data warehouse system to ensure business continuity.
- Perform any other duties as required to ensure Health Plan operations and department business needs are successful.
Requirements
- Four (4) years of relevant work experience.
- Experience and knowledge in logical, rational, dimensional, and physical data modeling.
- Background in database systems along with a strong knowledge of SQL.
- Experience with Orchestration tools, Azure DevOps, and CI/CD.
- Intermediate experience with the following tools and technologies: Azure Data Catalogue / Purview, Azure Cloud, Databricks, Power BI, Dataflows, Power Query, Azure Cosmos, Azure Monitor, PowerShell.
- Python Development experience using PySpark, Spark, Hadoop, Kubernetes, and RDMIS is highly desired.
- Bachelor's degree from an accredited institution required.
- Master’s degree from an accredited institution preferred.
- Azure Data Engineering Certification is preferred.
Benefits
- Competitive salary.
- Hybrid schedule.
- State of the art fitness center on-site.
- Medical Insurance with Dental and Vision.
- Life, short-term, and long-term disability options.
- Career advancement opportunities and professional development.
- Wellness programs that promote a healthy work-life balance.
- Flexible Spending Account – Health Care/Childcare.
- CalPERS retirement 457(b) option with a contribution match.
- Paid life insurance for employees.
- Pet care insurance.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLdata modelingSQLdata pipeline architecturedata quality analysisdata mappingdata integrationPythonPySparkAzure DevOps
Soft Skills
collaborationcommunicationproblem managementtechnical supportanalytical skills
Certifications
Azure Data Engineering CertificationBachelor's degreeMaster's degree