Software Engineer III – Gen AI Inferencing

Bank of America

. Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements .

Posted 5/6/2026full-timeAddison • North Carolina, Texas • 🇺🇸 United StatesMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

AngularAnsibleJavaJenkinsMongoDBPythonReactRedisScalaUnix

About the role

Key responsibilities & impact

Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
Designs, develops, and modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Mentors other software engineers and coach team on Continuous Integration and Continuous Development (CI-CD) practices and automating tool stack
Executes story refinement, definition of requirements, and estimating work necessary to realize a story through the delivery lifecycle
Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
Automates manual release activities
Designs, develops, and maintains automated test suites (integration, regression, performance)
Support multiple platforms and line of business for data science and GenAI use cases.
Utilizes multiple architectural components (across data, application, business) in design and development of client requirements.
Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
Manage multiple priorities, and simultaneously engage with multiple teams.
Be vocal and actively participate in all session with business stakeholders and agile teams.
Collaborate with product teams, data analysts and data scientists to design and build solutions

Requirements

What you’ll need

5+ years OOP in Python/Scala/Java programming experience with expert level development skills.
Bachelor's degree in Engineering, Computer Science, IT, Computer Application or job related field required
Experience with Model Serving platform i.e. AI/ML/GenAI Lifecycle Management and Development and its Ecosystem.
Hands on experience building frameworks using MLOps, Fine – Tuning techniques, Inference Frameworks
Track record of maintaining large scale Python/Unix based systems.
Hands on experience and knowledge generative AI RAG process for various use cases, including chunking, embedding, retrieval, reranking and summarization.
Hands-on experience in application development in one or more areas MongoDB, Redis, Angular/React Frameworks, Containerization, Building API based application leveraging FAST API services, JWT Integration, API Gateway.
Develop efficient utilities, automation frameworks, data science platforms that can be utilized across multiple Data Science teams for AI/ML and GenAI work.
Working in large sized teams that collaboratively develop on a shared multi-repo codebase using IDEs (e.g. VS Code rather than Jupyter Notebooks), Continuous Integration (CI), Continuous Deployment (CD) and Continuous Testing
Strong automation, scripting, and Python development skills.
Hands-on DevOps experience with one or more of the following enterprise development tools: Version Control (GIT/Bitbucket), Build Orchestration (Jenkins), Code Quality (SonarQube and pytest Unit Testing), Artifact Management (Artifactory) and Deployment (Ansible).

Benefits

Comp & perks

health insurance
retirement plans
paid time off
flexible work arrangements
professional development
wellness programs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

OOPPythonScalaJavaMLOpsFine-Tuning techniquesInference FrameworksAPI developmentAutomation frameworksData science platforms

Soft Skills

mentoringcollaborationcommunicationprioritizationagile methodologystakeholder engagementteam coachingproblem-solvingrisk mitigationstory refinement

Certifications

Bachelor's degree in EngineeringBachelor's degree in Computer ScienceBachelor's degree in ITBachelor's degree in Computer Application