Principal Vector Data Engineer
Johnson & Johnson
PythonPyTorchScikit-LearnTensorflow
Job Level
Senior
Tech Stack
AirflowApacheCloudDistributed SystemsElasticSearchETLMS SQL Server.NETNoSQLPySparkPythonSparkSQLVault
About the role
- Shift is the leading AI platform for insurance. Shift combines generative, agentic, and predictive AI to transform underwriting, claims, and fraud and risk - driving operational efficiency, exceptional customer experiences and measurable business impact. Trusted by the world's leading insurers, Shift delivers AI when and where it matters most, at scale and with proven results. Our culture is built on innovation, trust, and a drive to transform the insurance industry through our SaaS platform. Our Engineering team lies at the core of the value we offer to our customers. We solve complex problems not only within our squads but also by working collaboratively with other teams across the organization. We’re reshaping the way data drives decision-making by building powerful, scalable software and data platforms. Build and maintain high-performance data pipelines, contributing to a robust data and application architecture. Collaborate closely with cross-functional teams including Data Scientists, Engineers, and Product Managers to deliver impactful solutions. Operate and enhance our data infrastructure, ensuring seamless data movement across platforms. Support the evaluation and integration of tools that empower engineering and data science teams.
Requirements
- 5+ years of experience in software development or data engineering in cloud-based environments Strong programming skills in C# .NET and Python, with a solid grasp of OOP principles Proficiency in data transformation and processing tools (e.g. PySpark, dbt) Experience designing scalable and robust data platforms Familiarity with data modeling techniques (e.g., star schema, data vault) Experience with distributed data systems and Database optimization Comfortable working with NoSQL data stores and SQL Server Experience in ETL processes and orchestration tools like Apache Airflow etc A passion for continuous learning, mentoring, and solving complex problems Excellent communication skills in English
