Senior Data Engineer
SCA Pharma
AzureETLPythonSQL
Data Engineer II
CareSource
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $70,800 - $113,200 per year
Job Level
Mid-LevelSenior
Tech Stack
AzureETLPySparkPythonSQL
About the role
- Support and maintain operational availability and accuracy of enterprise data
- Work within an interdisciplinary group to develop, test, and deliver data solutions to business stakeholders
- Perform analysis and research to support and/or develop data transformation and workflows
- Collaborate with SMEs to develop business rules that measure and assure data quality; facilitating discussions with end users and data modelers
- Lead efforts to quantify and qualify reported data quality issues; develop and report program metrics to demonstrate progress and compliance
- Sets day-to-day objectives and delivers job responsibilities that may vary outside typical norms or practices.
- Work consists of tasks that are occasionally not routine and often works independently and is required to apply discretion within established operational boundaries and procedures.
Requirements
- Bachelor’s degree in Computer Science or related field or equivalent years of relevant work experience
- A minimum of three (3) years of experience designing and developing ETL and/or BI solutions
- Demonstrable experience in all stages of definition, design, implementation, testing and deployment of complex database, ETL, BI and Analytical solutions
- Proven experience in Azure DataBricks, Azure Data Factory
- Proven experience in Python, PySpark
- Proven ability to write complex SQL queries
- Proven ability developing medium to complex data quality profiling or metadata analysis processes with an industry leading tool
- Ability to manage multiple medium to large scale projects while demonstrating a sense of urgency
- Solid understanding of data management and governance concepts, especially data quality and metadata management
- Proven understanding of relational database theory
- Ability to establish effective working relationships with stakeholders at all different levels
- Effective problem-solving skills with attention to detail
- Strong interpersonal skills including excellent written and verbal communication skills; listening and critical thinking
- Ability to effectively prioritize and execute tasks while working both independently and in a team-oriented, collaborative environment.
Benefits
- health insurance
- retirement plans
- paid time off
- flexible work arrangements
- professional development
- bonuses
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETLBI solutionsAzure DataBricksAzure Data FactoryPythonPySparkSQLdata quality profilingmetadata analysisdatabase design
Soft skills
problem-solvingattention to detailinterpersonal skillswritten communicationverbal communicationlisteningcritical thinkingprioritizationexecutioncollaboration
Certifications
Bachelor’s degree in Computer Science
