Gen AI Enterprise Architect – AVP

EXL

Design and deploy enterprise-grade AI solutions (LLMs, RAG, agents) by selecting appropriate models. Lead technical strategies across the standard 7-layer GenAI stack, ensuring scalability and security.

Posted 7/16/2026full-time🇺🇸 United StatesLead💰 $160,000 - $190,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in System Design and Architecture for Generative AI, with a strong focus on Model Selection, Tuning, and LLMOps. Proven ability to integrate AI solutions while ensuring data protection and providing strategic leadership in client consulting.

Highest-signal resume keywords

Generative AI System ArchitectureNLP ExpertisePython ProgrammingLLMOps StandardsClient-Facing Communication

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Model SelectionDeep Learning FrameworksData EncryptionRole-Based Access ControlAI Services on AWSVector DatabasesEmbedding TechniquesCI/CD ImplementationObservability ToolsOrchestration Tools

Soft Skills

Exceptional CommunicationStakeholder CollaborationRequirements Gathering

Tools & Technologies

DatadogSplunkPrometheusLangChainAutogenGPT-4PineconeMilvus

Industry Keywords

AI GovernanceData ProtectionMachine LearningSoftware EngineeringConsulting Experience

Tech Stack

Tools & technologies

AWSAzureCloudGoogle Cloud PlatformPrometheusPythonPyTorchSplunkTensorflow

About the role

Key responsibilities & impact

**System Design & Architecture:** Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
**Model Selection & Tuning:** Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
**LLMOps, Observability & Pipelines:** Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
**Integration & Data Protection:** Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
**Strategic Leadership:** Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
**Client Consulting:** Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints.

Requirements

What you’ll need

**Consulting Skills:** Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
**Technical Expertise:** Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
**Cloud & Data Systems:** Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
**Qualifications:** Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience.

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account EXL Website LinkedIn All Job Openings 10,000+ employees 💰 $2M Venture Round on 2015-01 Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Gen AI Enterprise Architect – AVP 🔥 1 hour ago 🏢🏡 null – Hybrid 💵 $160k - $190k / year ⏰ Full Time 🔴 Lead 🤖 AI Engineer AWS Azure Cloud Google Cloud Platform Prometheus Python PyTorch Splunk Tensorflow Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
**System Design & Architecture:** Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
**Model Selection & Tuning:** Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
**LLMOps, Observability & Pipelines:** Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
**Integration & Data Protection:** Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
**Strategic Leadership:** Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
**Client Consulting:** Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints. 🎯 Requirements
**Consulting Skills:** Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
**Technical Expertise:** Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
**Cloud & Data Systems:** Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
**Qualifications:** Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Principal AI Engineer – Agentic AI 🔥 2 hours ago Navy Federal Credit Union 10,000+ employees Website LinkedIn All Job Openings Principal AI Engineer responsible for driving AI adoption at Navy Federal Credit Union. Leading the development and implementation of AI-driven solutions in a collaborative environment. 🏢🏡 Vienna – Hybrid ⏰ Full Time 🔴 Lead 🤖 AI Engineer 🦅 H1B Visa Sponsor Azure Python Staff Software Engineer – AI 🔥 21 hours ago Cloudera 1001 - 5000 🏢 Enterprise ☁️ SaaS 🤖 Artificial Intelligence Website LinkedIn All Job Openings Software Engineer joining Cloudera’s Enterprise AI Platform team. Developing and delivering a scalable AI and machine learning platform with cross-functional collaboration. 🏢🏡 Austin – Hybrid 💰 $4.1M Venture Round on 2013-01 ⏰ Full Time 🔴 Lead 🤖 AI Engineer 🦅 H1B Visa Sponsor Distributed Systems GRPC Java JavaScript Kubernetes Microservices Node.js Python SQL Go Principal Software Engineer – Vehicle AI 🔥 22 hours ago General Motors 10,000+ employees 🚗 Transport ⚡ Energy 🏢 Enterprise Website LinkedIn All Job Openings Principal Software Engineer in Vehicle AI designing and deploying high-performance AI software solutions. Leading architectural efforts and mentoring engineers for cutting-edge automotive applications. 🏢🏡 Mountain View – Hybrid 💵 $216.4k - $331.6k / year 💰 $500M Grant on 2024-07 ⏰ Full Time 🔴 Lead 🤖 AI Engineer 🦅 H1B Visa Sponsor Android C++ Linux Python RTOS Generative AI Platform Manager – Vice President 🕒 Yesterday State Street 10,000+ employees 💸 Finance 💳 Fintech 🏦 Banking Website LinkedIn All Job Openings VP overseeing the design and delivery of enterprise Generative AI platform with a focus on AWS and Azure. Responsibilities include architecture, governance, and leadership across multiple teams. 🏢🏡 Burlington – Hybrid 💵 $120k - $202.5k / year ⏰ Full Time 🔴 Lead 🤖 AI Engineer 🦅 H1B Visa Sponsor AWS Azure Cloud Grafana Python Terraform TypeScript Unity Vice President, Generative AI Platform Manager 🕒 Yesterday State Street 10,000+ employees 💸 Finance 💳 Fintech 🏦 Banking Website LinkedIn All Job Openings VP leading the design and delivery of an enterprise Generative AI platform at State Street. Overseeing strategic initiatives across AWS, Azure, and Databricks to optimize AI solutions. 🏢🏡 Boston – Hybrid 💵 $120k - $202.5k / year ⏰ Full Time 🔴 Lead 🤖 AI Engineer 🦅 H1B Visa Sponsor AWS Azure Cloud Unity View More AI Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs