Collaborates with business stakeholders to determine functional and non-functional requirements for new software and/or applications.
Provide Data / ML and AI platform recommended business workflow, understanding requirements, and helping each project team to document them.
Develop Data Modernization capabilities that adheres to the project roadmap to enable Insurance Carrier to migrate data computing to cloud using cloud native data / ML and AI assets, tools and capabilities.
Designs and supports the medallion data architecture, strategic and operational reporting; ensures development efforts are carried out using a consistent and quality driven approach.
Provide hands-on Data / ML & A.I. support that includes code and framework development.
Provides hands on technical support, guidance and coaching to Data / ML and A.I. developers.
Oversees progress of development team to ensure consistency with initial design. Also ensures the software meets all requirements of quality, security, modifiability, extensibility, etc.
Building Databricks Delta Lake based Lakehouse using PySpark Jobs, Databricks Workflows, Unity Catalog, Delta Sharing, Serverless computing and Medallion architecture.
Demonstrate expertise in implementing data security best practices to safeguard sensitive information within Databricks.

Requirements

Bachelor's Degree in Computer Science or related
A minimum of five years of cloud-based services relevant to data engineering, data storage, data processing, data warehousing, real-time streaming, and serverless computing.
Three or more years engineering data pipelines, governance, and AI/ML support.
Excellent programming and debugging skills in Python.
Strong hands-on experience with PySpark to build efficient data transformation and validation logic (preferred)
MDM Platform Informatica, Lake Fusion, Verato and BI Reporting (Cognos, Power BI, Tableau, Qlik, Sigma) or similar working knowledge and certifications around are preferred
Strong commercial property & casualty (P&C) insurance knowledge preferred
Databricks/Spark Certified preferable

Benefits

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringdata storagedata processingdata warehousingreal-time streamingserverless computingprogrammingdebuggingPythonPySpark

Soft Skills

collaborationguidancecoachingoversightquality assurance

Certifications

Databricks/Spark Certified