Test and refine prompts to improve the accuracy, clarity, and consistency of AI generated responses.
Run AI model evaluations to identify errors, hallucinations, and output inconsistencies.
Apply analytical reasoning to understand business requirements and translate them into effective prompt structures.
Work with large datasets to analyze AI behavior trends, evaluation results, and performance metrics.
Troubleshoot and fix minor code issues (typically in Python) when workflows or automation break.
Use Git for version control, prompt management, and maintaining clean change history.
Review task instructions and ensure prompts align with expected business rules.
Monitor AI agent behavior to ensure performance targets and quality standards are met.
Document prompt variations, test results, data findings, and recommended improvements.

Requirements

Associate or bachelor’s degree in Business, Data Science, AI, Computer Science, or a related field
Basic experience with Python, data manipulation, and scripting to write or debug code as necessary
Experience with Git or similar version control tools
Ability to work with large structured and unstructured datasets
Familiarity with generative AI tools (ChatGPT, Claude, Gemini, etc.) is required.
Excellent written communication skills, especially when documenting findings or prompt adjustments.

Benefits

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Pythondata manipulationscriptingAI model evaluationprompt engineeringtroubleshootingdata analysisperformance metricsversion controlgenerative AI

Soft Skills

analytical reasoningwritten communicationattention to detail

Certifications

Associate degreeBachelor's degree