Tech Stack
AWSAzureJavaJavaScriptPythonPyTorchReactTypeScript
About the role
- Design and Build Advanced Agentic AI Systems: Develop and orchestrate multi-agent AI workflows for tasks like automated code review, test generation, CI/CD, and full development lifecycle optimization using frameworks like LangGraph and AutoGen
- Ensure smooth integration of these agentic systems with existing developer tools
- Data Engineering and Evaluation: Work with large-scale code datasets, developer interaction data, and multi-modal assets (code, docs, UI) from integrated productivity tools
- Build evaluation frameworks and benchmarks for agentic systems using A/B testing and tools such as AgentBench and Langfuse
- Modeling and Agentic Intelligence: Create statistical models to analyze developer behavior, optimize workflows, and measure productivity with clear KPIs
- Deploy models to production, ensuring alignment with responsible AI practices and Autodesk governance standards
- Mentor junior engineers on best practices in AI and software development
Requirements
- MS/PhD in Computer Science, Machine Learning, or related field
- 5+ years experience in ML, with focus on NLP, code intelligence, or developer tools
- Strong expertise in Python, PyTorch, Transformers, and related ML frameworks
- Hands-on experience with Large Language Models and code generation models
- Deep knowledge of AI evaluation methods and code-specific metrics
- Strong background in statistical analysis, A/B testing, and experimental design
- Proven track record delivering end-to-end ML solutions, from research to production
- Experience with developer productivity and workflow optimization frameworks
- Background in software engineering or close collaboration with dev teams (preferred)
- Familiarity with Git, GitHub/GitLab APIs, CI/CD pipelines (preferred)
- Understanding of developer experience and HCI principles (preferred)
- Experience with vector databases, embeddings for code search and similarity (preferred)
- Proficiency in multiple languages (Java, C++, Python) (preferred)
- Hands-on experience with agentic AI frameworks and evaluation tools (preferred)
- Knowledge of code analysis tools (e.g., AST parsing, Tree-sitter) (preferred)
- Contributions to research or open-source projects in code intelligence or productivity (preferred)
- Experience with Azure AI Foundry/ML or AWS ML platforms (preferred)
- Passionate about improving developer productivity through AI innovation
- Thrives in ambiguous, fast-evolving environments
- Strong collaborator and problem-solver, curious and experimental by nature
- Committed to continuous learning and pushing the boundaries of AI and developer tools