In All Media

Artificial Intelligence

• Select, fine-tune, or deploy LLMs for product-specific needs
• Design and optimize RAG architectures with observability and vector search integration
• Implement and monitor prompt versioning using version control and CI/CD pipelines
• Track and analyze key metrics: hallucination rate, grounding score, latency, token cost
• Detect and mitigate bias in prompts (cultural, gender, linguistic)
• Support red teaming activities to assess model robustness and safety
• Collaborate with MLOps and platform teams to deploy models in production environments
• Promote internal standards for LLMOps, prompt governance, and model observability
• Ensure model reliability, safety, and auditability through prompt monitoring and secure deployment workflows

LLM / Prompt Engineer

Risk

• Design and run an end-to-end AI Risk Management program aligned to NIST AI RMF 1.0 and ISO/IEC 42001
• Maintain a central inventory of in-house and third-party AI systems and a risk register covering bias/fairness, robustness, privacy/PII, resilience, misuse, hallucinations, data leakage, drift, and security risks
• Operate the identify → assess → treat → accept → post-deployment monitoring lifecycle; implement telemetry, logging, guardrails, alerts, and issue handling
• Define policies, standards, control objectives, and evidence mapping to NIST AI RMF and ISO/IEC 42001 clauses; cross-reference ISO/IEC 23894
• Coordinate red teaming and assurance (safety, fairness/bias, privacy, jailbreak/prompt-injection testing); arrange independent validation for high-risk models
• Integrate AI risk reviews for vendors and align with CISO and Legal/Privacy; cross-walk to OCC 2011-12/SR 11-7 for financial institutions
• Ensure AI controls and documentation consider U.S. state privacy regimes (e.g., CCPA/CPRA, Colorado CPA)
• Prepare for EU AI Act deployer duties: risk management, data governance, logging, human oversight, post-market monitoring, incident reporting
• Run committees, publish dashboards and executive reports, and deliver role-based enablement and training

LLM / Prompt Engineer

AI Risk and Governance Specialist