Software Engineer III – Gen AI Inferencing

Bank of America

. Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements .

Posted 5/6/2026full-timeAddison • North Carolina, Texas • 🇺🇸 United StatesMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

AngularAnsibleJavaJenkinsMongoDBPythonReactRedisScalaUnix

About the role

Key responsibilities & impact

Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
Designs, develops, and modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Mentors other software engineers and coach team on Continuous Integration and Continuous Development (CI-CD) practices and automating tool stack
Executes story refinement, definition of requirements, and estimating work necessary to realize a story through the delivery lifecycle
Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
Automates manual release activities
Designs, develops, and maintains automated test suites (integration, regression, performance)
Utilizes multiple architectural components (across data, application, business) in design and development of client requirements
Manage multiple priorities, and simultaneously engage with multiple teams.
Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
Be vocal and actively participate in all session with business stakeholders and agile teams.
Collaborate with product teams, data analysts and data scientists to design and build solutions.

Requirements

What you’ll need

5+ years OOP in Python/Scala/Java programming experience with expert level development skills.
Bachelors degree in Engineering ,computer Science ,IT,C omputer application or job related field required.
Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem.
Hands on experience building frameworks using MLOps, Fine – Tuning techniques, Inference Frameworks.
Experience with deploying models using vLLM/Triton Inference Server in containers in production with automation.
Performs Continuous Integration and Continuous Development (CI-CD) activities.
Performance Tuning those models and deployment to provide higher throughput.
Track record of maintaining large scale Python/Unix based systems.
Hands on experience and knowledge generative AI RAG process for various use cases, including chunking, embedding, retrieval, reranking and summarization.
Hands-on experience in application development in one or more areas MongoDB, Redis, Angular/React Frameworks, Containerization, Building API based application leveraging FAST API services, JWT Integration, API Gateway.
Develop efficient utilities, automation frameworks, data science platforms that can be utilized across multiple Data Science teams for AI/ML and GenAI work.
Working in large sized teams that collaboratively develop on a shared multi-repo codebase using IDEs (e.g. VS Code rather than Jupyter Notebooks), Continuous Integration (CI), Continuous Deployment (CD) and Continuous Testing.
Strong automation, scripting, and Python development skills.
Hands-on DevOps experience with one or more of the following enterprise development tools: Version Control (GIT/Bitbucket), Build Orchestration (Jenkins), Code Quality (SonarQube and pytest Unit Testing), Artifact Management (Artifactory) and Deployment (Ansible).

Benefits

Comp & perks

affordable, competitive and flexible benefits

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

OOPPythonScalaJavaAI/MLMLOpsPerformance TuningMongoDBRedisAPI Development

Soft Skills

mentoringcollaborationcommunicationprioritizationagile methodologyproblem-solvingcoachingstakeholder engagementteamworkadaptability

Certifications

Bachelor's degree in EngineeringBachelor's degree in Computer ScienceBachelor's degree in ITBachelor's degree in Computer Application