Salary
💰 $115,000 - $230,000 per year
Tech Stack
AirflowAWSAzureCassandraCloudJavaKafkaKubernetesMongoDBOpen SourcePostgresPythonRayRedisSDLCSpark
About the role
- Own design, development and maintenance of high-performance, durable and scalable platform components powering end-to-end GenAI agentic workflows (agent building & deployment, prompt management, workflow orchestration, MCP registry).
- Contribute to selection, evaluation, and implementation of software platforms, tools, and frameworks, balancing build vs. buy and maintainability.
- Collaborate with cross-functional teams (data scientists, ML engineers, software engineers, product managers, designers) to gather requirements, define project scope and prioritize feature backlogs.
- Establish pragmatic technical visions and roadmaps balancing business outcomes, product release timelines and engineering excellence.
- Assist in planning and estimation of software development projects, ensuring efficient allocation of resources and timely delivery.
- Mentor and guide junior engineers via code reviews and design sessions, fostering collaborative, high-performance team culture and elevating AI engineering best practices.
Requirements
- 5+ years of professional software development experience with at least two general-purpose programming languages such as Java, C++, Python or C#.
- 4+ years of experience designing and building AIML platform and systems utilizing open-source/cloud-agnostic components (elastic search, Qdrant, Snowflake, Kafka, PostgreSQL, MongoDB, Cassandra, Spark, Ray, Airflow, Temporal, Redis).
- 3+ years’ experience managing end-to-end software development life cycle (version control, CI/CD pipelines, Kubernetes, testing, monitoring & alerting, production support).
- 3+ years’ experience building training, finetuning, real-time/batch inferencing and evaluation systems for AIML models and LLMs, especially utilizing GPU-powered infrastructure.
- Bachelor’s degree or above in Computer Science, Engineering, Statistics or related field.
- Experience with cloud providers such as Azure and AWS (preferred).
- 2+ years’ experience building conversational experiences and agentic workflows leveraging open source LLMs (Llama, Mistral, Claude) (preferred).
- Experience with LLM observability software such as Langsmith, Arize Phoenix (preferred).
- Experience building LLM-based AI agent workflows via no-code/low-code and traditional high-code environments (preferred).
- Strong communication and problem-solving skills.
- GEICO will consider sponsoring a new qualified applicant for employment authorization for this position.