Applied AI Engineer – Agent Reliability

PulseRise Technologies

AI Engineer focused on agent reliability at a pre-seed AI startup for entertainment. Building high-performance agent systems for the global entertainment and creator economy.

Posted 5/1/2026full-timeRemote • 🇧🇷 BrazilMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

DjangoGrafanaPython

About the role

Key responsibilities & impact

Instrument agents with trace-level observability (Langfuse or equivalent)
Build evaluation datasets from production traffic
Design and operate scoring pipelines (quality + robustness scoring)
Stand up and operate Braintrust or equivalent evaluation framework
Build feedback loops from eval → prompt → architecture → re-evaluation
Implement DSPy / DPO optimization as system matures
Partner with technical leadership on reliability-sensitive architecture decisions
Own dev → test → deploy → on-call sustain for your workstream

Requirements

What you’ll need

Real production experience with non-deterministic LLM systems (NOT side projects)
Experience building or operating evaluation pipelines
Strong Python backend (FastAPI / Django / Celery)
Observability experience (Langfuse / Grafana / Loki or equivalent)
Experience owning systems end-to-end
Async communication skills + fluent English
Based in LATAM

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account PulseRise Technologies Website LinkedIn All Job Openings 1 - 10 employees Founded 2025 🤝 B2B 🎯 Recruiter 🔒 Cybersecurity B2B
Recruitment
Cybersecurity PulseRise Technologies is an international IT services and outstaffing firm that builds and manages remote tech teams for clients across EMEA, LATAM, and the USA. They provide staff and team augmentation, software and web development, cloud & DevOps engineering, multilingual technical support, cybersecurity services, and specialized staffing for FinTech and trading platforms, along with creative and UX/UI design studios and private-label mobile app development. PulseRise focuses on connecting IT professionals with companies to accelerate delivery, ensure regulatory compliance, and keep operations scalable and cost-efficient. Applied AI Engineer – Agent Reliability 🔥 3 minutes ago 🇧🇷 Brazil – Remote ⏰ Full Time 🟡 Mid-level 🟠 Senior 🤖 AI Engineer Django Grafana Python Apply Now Find Hiring Managers Customize resume for this job Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Instrument agents with trace-level observability (Langfuse or equivalent)
Build evaluation datasets from production traffic
Design and operate scoring pipelines (quality + robustness scoring)
Stand up and operate Braintrust or equivalent evaluation framework
Build feedback loops from eval → prompt → architecture → re-evaluation
Implement DSPy / DPO optimization as system matures
Partner with technical leadership on reliability-sensitive architecture decisions
Own dev → test → deploy → on-call sustain for your workstream 🎯 Requirements
Real production experience with non-deterministic LLM systems (NOT side projects)
Experience building or operating evaluation pipelines
Strong Python backend (FastAPI / Django / Celery)
Observability experience (Langfuse / Grafana / Loki or equivalent)
Experience owning systems end-to-end
Async communication skills + fluent English
Based in LATAM Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Full Stack AI Engineer 🕒 2 days ago Jobs for Humanity 11 - 50 🤝 B2B 📚 Education 🎯 Recruiter Website LinkedIn All Job Openings Full Stack AI Engineer designing and shipping AI-powered products for real estate management. Involving in frontend, backend, and AI/ML integrations across the application stack. 🇧🇷 Brazil – Remote ⏰ Full Time 🟡 Mid-level 🟠 Senior 🤖 AI Engineer AWS Azure Cloud Google Cloud Platform JavaScript Microservices Next.js Node.js Python React TypeScript Go IT Sales — AI Platform 🕒 3 days ago Global Tech Holding 11 - 50 Website LinkedIn All Job Openings Sales role focusing on technology, AI solutions, and marketing in a dynamic environment. Responsible for client outreach, relationship management, and software sales across diverse clients. 🇧🇷 Brazil – Remote ⏰ Full Time 🟡 Mid-level 🟠 Senior 🤖 AI Engineer 🗣️🇧🇷🇵🇹 Portuguese Required AI Architect, AWS 🕒 April 22 CI&T 5001 - 10000 🤖 Artificial Intelligence ☁️ SaaS Website LinkedIn All Job Openings AI Architect (AWS) developing innovative AI-driven products at CI&T. Managing Agile teams and implementing frameworks like LangChain and LangGraph. 🇧🇷 Brazil – Remote 💰 $5.5M Venture Round on 2014-04 ⏰ Full Time 🟡 Mid-level 🟠 Senior 🤖 AI Engineer 🗣️🇧🇷🇵🇹 Portuguese Required AWS EC2 Flask Java Python Spring Spring Boot SpringBoot Senior AI Engineer – Marketing 🕒 April 21 Sezzle 201 - 500 💳 Fintech 👥 B2C 🛍️ eCommerce Website LinkedIn All Job Openings Sr. AI Engineer responsible for machine learning solutions at Sezzle, revolutionizing the shopping experience. Designing scalable infrastructure and collaborating on AI-driven features for diverse market applications. 🇧🇷 Brazil – Remote 💵 $50k - $120k / year ⏰ Full Time 🟠 Senior 🤖 AI Engineer Apache AWS Cloud Docker Grafana Kafka Kubernetes Prometheus Python Spark SQL Go AI Engineer II – Marketing 🕒 April 21 Sezzle 201 - 500 💳 Fintech 👥 B2C 🛍️ eCommerce Website LinkedIn All Job Openings AI Engineer II developing AI-powered platforms for Sezzle's marketing team in a fast-paced environment. Collaborating with product, engineering, and operations teams on innovative AI-driven capabilities. 🇧🇷 Brazil – Remote 💵 $3.3k - $6k / month ⏰ Full Time 🟡 Mid-level 🟠 Senior 🤖 AI Engineer Distributed Systems Python React SQL View More AI Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonFastAPIDjangoCeleryDSPyDPO optimizationevaluation pipelinesscoring pipelinestrace-level observabilitynon-deterministic LLM systems

Soft Skills

async communicationfluent English