Code for America

Principal AI Application Engineer

Code for America

full-time

Posted on:

Location Type: Remote

Location: CaliforniaUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $143,884 - $176,138 per year

Job Level

About the role

  • Build and ship high-impact experiments (e.g., digital lockers or AI-augmented procurement tools) to expand the "impact possibilities frontier."
  • Translate vague policy objectives into robust, working systems.
  • Identify when to use LLMs, agentic orchestration, or RAG patterns versus simple rules engines or traditional ML models.
  • Collaborate with policy and domain experts to co-design civic-sector benchmarks, translating complex regulatory requirements into automated evaluation pipelines that rigorously measure model performance.
  • Identify and define new opportunity spaces by translating emerging policy, technology, and user needs into actionable technical bets.
  • Architect foundational tools, including declarative task specifications and agentic data layers.
  • Design infrastructure that respects public sector constraints, focusing on portability and explainability.
  • Build data layers that interoperate with legacy systems (COBOL, SQL, etc.) to deliver modern value without multi-year migrations.
  • Establish Code for America as a leader in responsible AI through external thought leadership, including publications, talks, and open-source contributions.
  • Share demos and earned insights internally to help the organization iterate toward better standards and internal use cases of responsible AI.
  • Document architectural decisions, successes, and failures to create a blueprint for responsible AI in government.
  • Drive alignment across engineering, product, policy, and program teams to ensure solutions are technically sound, policy-compliant, and operationally viable.
  • Partner with and mentor fellow engineers through hands-on code reviews and technical guidance, ensuring the team stays grounded in best practices for responsible AI.
  • Maintain system health through rigorous, hands-on code reviews and the development of shared utilities.
  • Ensure craftsmanship and system explainability for the vulnerable populations we serve.

Requirements

  • 7+ years of experience in high-ownership environments (former technical founders encouraged); ability to take a vague objective to a finished system.
  • Hands-on experience building with LLMs, agentic orchestration, and RAG patterns, with the pragmatism to know when not to use them.
  • Ability to think in "primitives" and "capabilities," preferring modular, reusable frameworks over bespoke scripts.
  • Passion for bias detection, harm mitigations, and building systems that are explainable to the people they serve.
  • Mastery of Git, Linux, CI/CD, Infrastructure as Code(Terraform), and container-based workflows.
  • A critical eye toward the limitations of AI, especially "black box" logic in high-stakes public services.
  • Demonstrated ability to influence technical direction and drive alignment across teams without formal authority.
Benefits
  • Laptop provided
  • A one-time $700 payment for remote environment setup; $200 stipend (in first paycheck) and up to $500 reimbursement, in accordance with our equipment policy
  • Cell phone and/or internet reimbursement of $50 per month
  • $500 annual (per calendar year) stipend towards professional development; prorated at time of hire
  • Up to $500 of professional development funds can be rolled over each year, up to a maximum of $1000
  • Training / guidance for staff required to utilize AI as part of their role, plus opportunities for employees to gain AI-related skills to support job and career growth
  • Employees receive a 100% employer match on the first 3% of contributions.
  • Employees with 3+ years of service receive an additional 50% match on contributions between 3% and 5%, for a maximum employer contribution of 5%
  • At least one no cost health insurance option for full-time employees for employee-only coverage
  • A minimum of 80% of the cost of dependent coverage
  • Code for America employees may work remotely across the US
  • Open personal time off (subject to manager approval), a minimum of 14 paid holidays, and an org-wide closure from Christmas Day through New Year's Day
  • Paid sick time; up to 96 hours annually
  • 17 weeks of paid parental and family leave
  • 3 weeks of paid sabbatical after 5 years of service
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
LLMsagentic orchestrationRAG patternsdeclarative task specificationsdata layersCOBOLSQLGitLinuxInfrastructure as Code
Soft Skills
collaborationmentorshipinfluencecritical thinkingproblem-solvingcommunicationalignmentpassion for bias detectionpragmatismcraftsmanship