Prompt Systems Engineer

Noodle

Product Manager at Noodle enhancing learning experiences with AI-powered products. Seeking to elevate operational efficiency for educational institution partners and internal teams.

Posted 5/27/2026full-timeRemote • 🇺🇸 United StatesJuniorMid-Level💰 $115,000 - $130,000 per yearWebsite

Tech Stack

Tools & technologies

JavaScriptPython

About the role

Key responsibilities & impact

Write, iterate, and maintain system prompts and instruction sets for Noodle’s AI agents across the student journey
Translate complex educational and operational requirements into clear, reliable agent behavior — including persona definition, tone, scope constraints, fallback handling, and multi-turn conversation logic
Design prompt architectures for multi-step and chained agent workflows, including RAG-augmented agents that draw from program-specific knowledge bases
Collaborate with the engineering team to configure and deploy agents through Noodle’s AI orchestration platform, including primary prompts, secondary context, knowledge base attachments, and embed definitions
Create the learner experiences defined by “three-way” chat between the learner, a campus or Noodle support staff member, and that staff member’s AI assistant
Build and maintain evaluation frameworks to measure agent accuracy, tone, hallucination rate, task completion, and alignment with rubric-based learning objectives
Use Langfuse (Noodle’s LLM observability platform) to monitor prompt performance in production, identify regressions, and prioritize prompt improvements
Design red-teaming and adversarial testing protocols to surface edge cases and failure modes before agents reach students
Establish prompt versioning practices and maintain a library of tested, reusable prompt components
Partner with Noodle teammates and university stakeholders to design, build, and test agents — translating learning objectives, operational flows, rubric assessments, and more into prompt-level agent instructions
Work with enrollment and student success teams to tune companion agents for specific programs and university partner contexts
Contribute prompt engineering guidelines and best practices documentation for internal teams who configure their own agents on Noodle’s AI orchestration platform
Stay current with model capability changes across OpenAI, Anthropic, and other providers integrated into Noodle’s stack, and proactively surface opportunities or risks
Perform other duties as assigned

Requirements

What you’ll need

2+ years of experience designing and iterating on prompts for LLM-powered applications in a production environment
Deep familiarity with prompt patterns: few-shot examples, chain-of-thought, system vs. user roles, output formatting constraints, tool-use prompting, and RAG integration
Strong written communication — you can write clearly, precisely, and persuasively, because that’s the core of the job
Experience building and running prompt evaluations: defining metrics, writing test cases, and interpreting results to make improvement decisions
Comfort working across disciplines — you can hold a conversation with an engineer about context windows and with a faculty member about Bloom’s Taxonomy
Experience with LLM observability tools (Langfuse, Weights & Biases, or similar)
Familiarity with LTI (Learning Tools Interoperability) and how AI tools plug into LMS platforms like Moodle, Canvas, or Instructure
Experience with voice agents or multimodal prompting
Comfort reading and writing basic code (JavaScript, Python) to support prompt automation and testing pipelines
Knowledge of OpenAI, Anthropic, or other model provider APIs
Ability to thrive in ambiguity and iterate quickly based on user feedback
Ability to work effectively in dynamic, rapidly changing, team-based environment

Benefits

Comp & perks

Work from our beautiful NYC office OR the comfort of your home office!
Computer and charger on us!
401(k) with company match, plus equity opportunities
Medical, dental, and vision insurance for you and your family (including mental health benefits like Headspace and Talkspace)
Employer-paid life and disability insurance
Optional voluntary coverage, including supplemental life, accident, critical illness, and hospital insurance
Health Savings Account (HSA), Flexible Spending Accounts (FSA), and commuter benefits
Pre-tax benefit options that help you save on eligible healthcare, dependent care, and commuting expenses
Employee Assistance Program (EAP)
Paid parental leave
Wellness initiatives and resources
Free subscription to the Calm app
Employee discount program
4 weeks of paid vacation + 10 paid holidays + paid sick leave
Monthly mobile connectivity stipend
Annual education stipend for lifelong learning
Growth opportunities - we pride ourselves on creating environments where employees can be themselves and grow within and around the company

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

prompt engineeringLLM-powered applicationsprompt evaluationfew-shot exampleschain-of-thoughtoutput formatting constraintsRAG integrationbasic codingJavaScriptPython

Soft Skills

strong written communicationcomfort working across disciplinesability to thrive in ambiguityability to iterate quicklyteam collaboration