Principal Software Engineer – GenAI

Duck Creek Technologies

Principal Software Engineer at Duck Creek Technologies, driving advanced AI-powered solutions across multiple initiatives. Designing and implementing high-performing systems and mentoring engineering teams.

Posted 4/25/2026full-timeBoston • California, Massachusetts, South Carolina • 🇺🇸 United StatesLead💰 $136,100 - $219,600 per yearWebsite

Tech Stack

Tools & technologies

AnsibleAssemblyCloudDistributed SystemsJavaKafkaMicroservices.NETPythonTerraformTypeScript

About the role

Key responsibilities & impact

Drive the technical vision and execution of advanced AI-powered solutions across multiple initiatives
Design and implement scalable, secure, and high-performing systems that leverage large language models (LLMs), retrieval-augmented generation (RAG), and AI-driven services
Lead technical strategy for GenAI-based products and platforms, ensuring alignment with enterprise architecture and business goals
Own the design and implementation of the AI orchestration runtime, including agent workflows, context assembly, tool invocation, policy enforcement, and execution control
Build platform-level capabilities for observability, evaluation, auditability, and cost management across AI workloads
Design and implement core AI services, including model orchestration, inference pipelines, and standardized prompt and configuration patterns
Collaborate with data scientists and ML engineers to integrate LLMs and fine-tuned models into production systems
Enable product teams to deliver AI capabilities without reinventing orchestration, governance, or runtime infrastructure
Architect and deliver solutions for high-complexity Agile stories across multiple domains, ensuring scalability and resilience
Mentor and guide engineers on modern AI development practices, including distributed systems, model deployment, and performance optimization
Ensure compliance and security in AI solutions, including data privacy, responsible AI principles, and model governance
Debug and resolve complex issues in distributed AI systems, ensuring minimal downtime and high availability
Champion CI/CD and MLOps practices for continuous delivery of AI features and models
Participate in hiring and talent development for the GenAI team.

Requirements

What you’ll need

Bachelor’s degree, or higher education level, or its foreign equivalent, in Computer Science, Computer Information Sciences, and/or related field
Total Work Experience: 7+ years (software development), 5+ years of strategic leadership experience
Expertise in AI/ML systems: LLM integration, RAG pipelines, vector databases, and prompting strategies
Experience with LLM evaluation frameworks (e.g., RAGAS, LangSmith evaluations, custom benchmarks)
Hands-on experience with agent frameworks, workflow orchestration, and LLM runtime systems (e.g., LangGraph, Agent Development Kit, Agent Framework, or similar), including tool use, memory, evaluation, and governance
Expert of scalable, resilient, modern, cloud-native microservice development with Java, .NET, Python, or Typescript
Experience building monitoring, alerting, and observability for maintaining high customer SLAs for SaaS delivered products
Experience in regulated industries (financial services, insurance, healthcare) preferred
Experience with CQRS, event-driven architecture, and Kafka
Experience with Terraform/Ansible or other IaC platforms
Experience with cost controls and usage attribution of model execution
Knowledge of data security, compliance, and responsible AI principles
Experience in Cloud platforms and cloud-native architectures, including Serverless
Proven experience building multi-agent systems with planning, tool calling, and state management
Expert with CI/CD to deliver software enhancements to customers with full automation
Expert in distributed software patterns, such as DDD, microservices, serverless, and event-driven architecture.

Benefits

Comp & perks

Flexible work environment
Medical, dental, vision, life and disability insurance
401(k) Retirement Plan
Flexible Spending & Health Savings Account
Paid holidays, vacation, and volunteer time
Employee assistance program and other benefits.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AI systemsLLM integrationRAG pipelinesvector databasesJava.NETPythonTypescriptCI/CDMLOps

Soft Skills

strategic leadershipmentoringcollaborationproblem-solvingcommunication

Certifications

Bachelor’s degree in Computer ScienceMaster’s degree in Computer Science