Research Engineer

• Design structured experiments with real controls and statistical rigor
• Build regression test coverage so we know when a global prompt change is breaking things across workflows we didn't expect
• Create a pipeline of validated, high-confidence improvements engineering can pull from instead of building on faith
• Work with the team to prioritize what actually gets shipped based on what the experiments say
• Own prompt design across Mia's agent workflows - multi-turn, voice-first, healthcare context
• Stay current on what's coming out in prompting research, and agent architecture, and bring back ideas worth testing
• Prototype new approaches locally before anything touches production
• Be the person the Product team comes to when they're stuck on a prompting problem
• Work closely with our Product and Engineering teams - understand where Mia is struggling and help decide what's worth experimenting on
• Translate experiment results into clear recommendations people can actually act on
• Build out evaluation templates and frameworks so this doesn't live only in your head

Prompting & AI Agent Research Engineer

• Lead the technical design and buildout of legal technology pilots and production-ready solutions across practice areas, including Harvey workflows, document automation templates, low-code tools, and custom-developed workflow applications.
• Translate attorney and business requirements into practical technical designs, process maps, data requirements, and implementation plans.
• Build and maintain solutions in approved legal AI, document automation, workflow, and knowledge platforms, including Harvey, Microsoft 365/Copilot or other general-purpose AI tools (ChatGPT, Claude, etc), and other firm-approved systems.
• Partner with custom developers to design and deliver hybrid buy/build solutions, including API integrations, data flows, automation logic, user interfaces, and reporting components.
• Collaborate with product owners to prioritize use cases, define success criteria, and transition pilots into governed, supportable solutions.
• Act as the technical liaison between vendors, internal developers, IT, practice groups, and business teams.
• Provide architecture guidance and hands-on configuration and implementation for key tools and systems, with attention to security, confidentiality, scalability, and maintainability.
• Maintain technical documentation, solution inventories, implementation notes, and reusable design patterns; support knowledge transfer and training.
• Evaluate emerging legal technology and AI capabilities and identify where vendor functionality, firm-built components, or a combined approach can improve attorney workflows.
• Support continuous improvement of attorney- and client-facing workflows through testing, QA, performance tuning, adoption feedback, and process optimization.
• Provide Level 2 support for deployed solutions, including troubleshooting escalated issues, root cause analysis, and coordination with vendors or internal developers for resolution.
• Develop and maintain comprehensive technical documentation, including solution architecture diagrams, configuration guides, user manuals, and runbooks to support ongoing maintenance and future enhancements.

Senior Practice Innovation Engineer

• Lead adversarial testing of AI by designing, scoping, and executing red team assessments against our AI ecosystem using a risk-based prioritization approach to discover and address vulnerabilities before they can be exploited.
• Innovate in AI attack techniques by combining cutting-edge academic research with proven offensive security methods to establish new Tactics, Techniques, and Procedures, and operationalize emerging research to keep assessments aligned with the state of the art.
• Build and scale security tooling using an automation-first philosophy, driving initiatives to shift security testing left by sharing purpose-built tools with AI security stakeholders across Engineering, Research, and Ethics.
• Serve as a strategic partner across the company, providing an offensive security perspective to guide product development, support corporate governance, and contribute to policies such as Salesforce's Generative AI Security Standard.

Adversarial AI, Research Engineer

• Provide senior-level leadership in the deployment, integration, and operationalization of innovative transportation technologies
• Translate research, policy, and emerging technologies into real-world implementation
• Serve as a key execution leader for innovation-focused initiatives
• Ensure successful delivery of funded projects from concept through deployment
• Provide leadership in the planning, implementation, and evaluation of technology deployments
• Guide multidisciplinary teams through all phases of delivery
• Support development and execution of innovation pipelines
• Prepare and deliver clear, actionable reports and presentations for sponsors, stakeholders, and leadership

Senior Research Engineer

• Build & Deploy Product Analytics Infrastructure: Design and implement scalable data pipelines and analytics systems that transform customer feedback and product traces into actionable insights across AI-powered legal products.
• Enable AI Evaluation at Scale: Build data workflows to enable the deployment of automated evaluation metrics as production analytics to continuously track product quality, detect errors, and alert teams to regressions before they impact customers.
• Establish Data Governance & Quality Standards: Develop technical governance infrastructure for manual and automated review of AI product data, particularly for small and medium law firms, ensuring data quality, security, and compliance.
• Drive Metric Development: Analyze product traces and customer feedback to identify quality issues and patterns that inform the development of new evaluation metrics and feed into product roadmap decisions.
• Support Cross-Functional Teams: Partner closely with Product Scientists, Research Engineers, and Subject Matter Experts to implement configurations, build reporting dashboards, and create self-service tools for metric implementation.
• Advance AI Evaluation Best Practices: Contribute to the development and scaling of automated evaluation capabilities and establish best practices for AI evaluation and analytics across Thomson Reuters pillars (Legal, Tax & Accounting, and Reuters News).

See all jobs on JobTailor

Prompting & AI Agent Research Engineer

Senior Practice Innovation Engineer

Adversarial AI, Research Engineer

Senior Research Engineer

Research Engineer – Data & Analytics, ML-Enabled Systems