Principal Software Engineer – Backend AI Engineer

Red Hat

Principal Software Engineer designing scalable backend services while integrating AI-driven features at Red Hat. Leading the technical direction and collaboration on complex product enhancements.

Posted 4/17/2026full-timeRaleigh • Massachusetts, North Carolina • 🇺🇸 United StatesLead💰 $148,540 - $245,050 per yearWebsite

Tech Stack

Tools & technologies

AWSAzureCloudDistributed SystemsDjangoFlaskGraphQLJavaScriptKubernetesMicroservicesMongoDBNoSQLOpenShiftPostgresPythonRedisSQL

About the role

Key responsibilities & impact

Lead the design and implementation of highly scalable, resilient backend services using Python, ensuring best practices in microservices and distributed systems
Drive the strategy for API development, designing and maintaining high-performance RESTful and GraphQL endpoints that support complex frontend and internal requirements
Architect and optimize database schemas (SQL and NoSQL), ensuring data integrity, performance tuning, and efficient query design for high-traffic applications
Design and deploy AI-driven features, focusing on LLM orchestration and Agentic workflows (e.g., automated reasoning, tool-calling) to solve real-world engineering problems
Lead deep-dive debugging sessions and performance audits across the stack, from the database layer to the application logic
Proactively utilize and experiment with AI-assisted tools (code generation, intelligent suggestions) to accelerate development cycles and improve code quality across the team
Partner with Product Managers to translate Requests for Enhancement (RFEs) into technical specifications and lead the implementation of complex, multi-sprint features

Requirements

What you’ll need

Mastery of Python and its ecosystem (e.g., FastAPI, Django, Flask), with a focus on writing clean, maintainable, and asynchronous code
Deep expertise in building and consuming REST and GraphQL APIs; experience with API versioning, security (OAuth/JWT), and documentation
Advanced knowledge of relational databases (e.g., PostgreSQL) and NoSQL solutions (e.g., Redis, MongoDB), including indexing, migration strategies, and optimization
Comfortable with cloud-native technologies (Kubernetes, OpenShift, or AWS/Azure)
Practical experience integrating Large Language Models and building Retrieval-Augmented Generation (RAG) pipelines
Familiarity with creating AI Agents that can perform tasks, use tools, and maintain state within a software ecosystem
A foundational understanding of Machine Learning principles to effectively collaborate with data science teams
Mastery of Git and advanced branching/merging strategies
Proven ability to lead in an Agile environment, providing technical direction during sprint planning and code reviews
A high degree of care in handling confidential customer information in accordance with privacy laws and corporate policies
Strong awareness of modern JS to facilitate seamless backend-to-frontend integration

Benefits

Comp & perks

Comprehensive medical, dental, and vision coverage
Flexible Spending Account - healthcare and dependent care
Health Savings Account - high deductible medical plan
Retirement 401(k) with employer match
Paid time off and holidays
Paid parental leave plans for all new parents
Leave benefits including disability, paid family medical leave, and paid military leave
Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonFastAPIDjangoFlaskREST APIsGraphQL APIsPostgreSQLRedisMongoDBMachine Learning

Soft Skills

leadershipcollaborationtechnical directionattention to detailAgile methodology