Senior Analyst, Agentic AI
The AES Corporation
AzureCloudGoogle Cloud PlatformPythonPyTorchTensorflow
Job Level
Mid-LevelSenior
Tech Stack
AssemblyCloudPython
About the role
- Build and implement automated quality assurance best practices to ensure reliability and performance of our AI systems
- Design and develop robust context systems that determine how AI systems store, recall, and utilize information during tasks and conversations
- Develop and maintain analytics and data models that underpin scalable and high-performing AI products
- Integrate specialized knowledge and workflows to tailor AI interactions for industries such as IT, healthcare, or finance
- Analyze AI system outputs and user feedback to identify areas for improvement and refine context and prompt strategies
- Create and maintain comprehensive documentation of prompt design patterns and context engineering best practices
- Partner with diverse teams to align context strategies with project goals and seamlessly integrate AI capabilities into products and workflows
Requirements
- 5 to 8 years of problem-solving experience on complex systems
- Proven track record of solving challenging problems
- Excellent analytical, critical thinking, and problem-solving skills
- Strong programming skills in Python with knowledge of NLP concepts
- Experience with LLM evaluation
- Hands-on experience in programming LLMs
- Familiarity with zero-shot, role-playing, and chain-of-thought prompting techniques
- Ability to collaborate effectively within cross-functional teams
- Willingness to continuously learn and adapt in evolving AI landscape
- Preferred: contribution to LLM-related open-source projects
- Preferred: AI model training experiences
- Preferred: Experience shipping LLM applications
