Design, build and maintain robust & scalable data pipelines to feed descriptive analytics and predictive analytics use cases.
Construct meaningful data assets sourced from structured, semi structured, and unstructured data.
Ensure data quality, accuracy and integrity of the data assets created.
Automate the data pipelines end to end.
Participate in data modeling and schema design.
Work closely with business stakeholders and data scientists to understand the business process and data needs to translate them into an effective data solution.
Collaborate with Stakeholders, Analysts, and Data Scientists to understand the data requirements & deliver optimal solutions (Training, Testing, and Live Scoring).
Collaborate with cross-functional teams to identify the right data sources for the use cases.
Perform data discovery and analysis on various data sources.
Find and tell the compelling narrative of the data that aligns to the intended audience.
Create and maintain Data Dictionary for the data pipelines.
Participate in code reviews and documentation efforts to maintain high-quality code and data documentation.

Requirements

Bachelor’s degree in STEM related field or equivalent
At least 5 years of experience in Data/Feature/ML Engineering or similar role
Strong understanding of engineering principles, best practices, and software development life cycle
Proficiency in SQL, Python, PySpark and bash scripts
Knowledge of Databricks
Experience with the design and development of ETL/ELT process
Experience working in a Data warehouse
Strong analytical and problem-solving skills
Excellent communication and collaboration skills to work across multiple groups within the organization
Nice to Haves: Experience in the insurance industry, Experience working with Data Science, Experience working with/creating point-in-time data assets, Experience with Databricks Workflows, Experience with AWS Tools and Services

Benefits

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

SQLPythonPySparkbash scriptsETLELTdata modelingdata analysisdata qualitydata integrity

analytical skillsproblem-solving skillscommunication skillscollaboration skills

Bachelor’s degree in STEM