Software Engineer, AI Systems

EdReports.org

Lead engineer developing AI systems for EdReports' AI-powered products, translating user needs into scalable systems. Collaborate with product managers and designers on the Review Process Innovation team.

Posted 5/7/2026full-timeRemote • 🇺🇸 United StatesSeniorLead💰 $119,981 - $179,971 per yearWebsite

Tech Stack

Tools & technologies

AWSCloud

About the role

Key responsibilities & impact

Partner closely with product managers and subject matter experts to deeply understand the review process, user needs and pain points, and translate them into technical solutions.
Design and implement AI-powered system components, including building data ingestion pipelines, implementing retrieval systems to surface relevant content, designing prompt workflows, and coordinating multi-step interactions between LLMs and external tools.
Build internal tools and interfaces that enable users to interact with AI-generated outputs, including reviewing evidence, refining results, and contributing to final output.
Develop and optimize data pipelines and storage systems to support large, multi-modal curriculum datasets (e.g., long-form PDFs, web content, and embedded media), including metadata tagging and efficient retrieval.
Define and implement evaluation approaches (e.g., human-in-the-loop review, benchmarking, and output validation) to assess the quality, accuracy, and bias of AI-generated outputs.
Rapidly prototype and iterate on AI-driven features, balancing experimentation with production-grade engineering.
Develop and maintain systems, ensuring robust performance and adherence to web accessibility standards, security best practices, data privacy standards, and ethical technology use, especially when exploring AI applications.
Contribute high-quality, maintainable code, including documentation, to ensure code quality across the organization’s systems.
Provide strategic technical recommendations to leadership, aligning innovations with organizational goals.
Contribute to evolving team priorities and organizational needs, adapting approaches while maintaining clear ownership of outcomes and responsibilities.

Requirements

What you’ll need

Passion for EdReports’ mission and vision, our core values, and our commitment to Diversity, Belonging, Inclusion, and Equity.
7+ years of professional experience in software development or AI systems development; a related advanced degree (e.g., MS or PhD in Computer Science or a related field) may substitute for up to 2 years of experience.
Experience building production systems using LLM APIs, including retrieval-augmented generation (RAG), prompt design, and orchestration frameworks.
Experience working with data retrieval systems, search infrastructure, or information retrieval concepts.
Expertise in scalable, secure web systems, with significant experience in cloud platforms such as Google Cloud or AWS.
Experience with automated testing frameworks and CI/CD pipelines.
Strong product mindset, with experience delivering user-centered features in collaboration with product and design teams.
Exceptional communication skills, with a proven ability to convey complex technical concepts to non-technical stakeholders.
Bachelor’s degree in Computer Science, Web Development, or a related field, or equivalent professional experience.
Residency in and authorization to work in the United States.

Benefits

Comp & perks

Unlimited Discretionary Time Off (DTO) and Sick Time,
21 days of paid holidays and office closure days in 2026,
Monthly Communications Reimbursement,
Initial home office and technology setup stipend,
EdReports pays for 90% of health care for both the employee and their immediate family,
401k that new hires become eligible for after six months of employment (includes safe harbor, employer match, etc.).

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AI systems developmentdata ingestion pipelinesretrieval systemsprompt designdata pipelinesmetadata taggingautomated testing frameworksCI/CD pipelinesweb accessibility standardssecure web systems

Soft Skills

communication skillsproduct mindsetcollaborationadaptabilityownership of outcomes

Certifications

Bachelor’s degree in Computer ScienceMaster’s degree in Computer SciencePhD in Computer Science