Mastery Level Skills AI Data Engineering leader responsible for a large portfolio (e.g. LOB) or across LOBs
AI data Engineering lead responsible for Implementing end-to-end AI data pipelines bringing structured, semi-structured and unstructured data together supporting AI and Agentic solutions.
Real-Time Data Streaming: Design, build and maintain scalable real-time data pipelines for efficient ingestion, processing, and delivery.
Drive best practices in AI data engineering by establishing standardized processes, promoting cutting-edge technologies, and ensuring data quality and compliance across the enterprise.
Data and Analytics Management: Oversee the design, development, and maintenance of data pipelines, data warehouses, data lakes and reporting systems.
Expertise in data engineering practices, knowledge of AI technologies, and the ability to lead cross-functional teams.
Expertise in real-time data streaming, agentic frameworks, Data APIs, vector stores, and RAG architectures, self-serve analytics and AI.
Drive efficiency and Productivity: Identify and champion developer productivity improvements across the end-to-end data management lifecycle. This includes researching and implementing innovative solutions such as AI-driven auto-generation of data pipelines, advanced DevOps practices for data and automated data quality frameworks.
Technology Evaluation & Adoption: Stay current with emerging trends in data engineering and AI/ML, design prototypes and conduct experiments, and recommend innovative tools and technologies to enhance data capabilities enabling business strategy.
Data Governance, Stewardship and Quality: Define and implement robust data management frameworks to ensure successful adoption of Enterprise Data Governance and Data Quality practices.
Budget Management: Effectively manage the budget and financials for the portfolio. Develop deep partnerships and alignment with the portfolio and agile value stream frameworks. Experience with Agile at Scale and iterative development through cross-functional teams. Partners with Technology, Data, AI Platform, ML Ops and Architecture teams to influence technology, data, platform and tooling strategy.
Requirements
12 years in data engineering, data management and building large-scale data ecosystems.
Bachelor's or Master’s degree in Computer Science, Data Science or a related field.
3+ years of AI/ML experience
Proven strategic and innovative thinker with a track record of enabling transformative data capabilities.
Mastery level data engineering and architecture skills, including deep expertise in data architecture patterns, data warehouse, data integration, data lakes, data domains, data products, business intelligence, and cloud technology capabilities.
Technical expertise in LLMs, AI platforms, prompt engineering, LLM optimization, Retrieval-Augmented Generation (RAG) architectures and vector database technologies (Vertex AI, Postgres, OpenSearch, Pinecone etc.).
Strong experience with GCP, Vertex AI or AWS required.
Experience in multi cloud environment.
Experience in Lang chain, AI agents, Vertex AI and Google Agent ecosystem.
Strong experience with the design and development of complex data ecosystems leveraging next-generation cloud technology stack across AWS or GCP Cloud and Snowflake.
Exceptional presentation and verbal/written communication skills; must be able to communicate effectively at all levels across the organization.
Ability to lead successfully in a lean, agile, and fast-paced organization, leveraging Scaled Agile principles and ways of working.
Excellent negotiation, influencing, and conflict resolution skills; adept at building strong cross-functional relationships.
Preferred experience in the Property & Casualty insurance industry.
Benefits
Bonuses
Long-term incentives
On-the-spot recognition
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringdata managementAI/MLdata architecturedata warehousedata integrationdata lakesbusiness intelligencecloud technologyprompt engineering
Soft skills
strategic thinkinginnovative thinkingpresentation skillsverbal communicationwritten communicationleadershipnegotiationinfluencingconflict resolutionrelationship building
Certifications
Bachelor's degree in Computer ScienceMaster’s degree in Data Science