
Senior NLP Engineer, LLM
Social Discovery Group
full-time
Posted on:
Location Type: Remote
Location: Serbia
Visit company websiteExplore more
Job Level
Tech Stack
About the role
- Conduct experiments with LLMs and evaluate different architectures and techniques (SFT, RLHF, Adapters, etc.) to improve conversational AI quality;
- Develop and maintain robust evaluation frameworks to assess model performance, accuracy, and user satisfaction using offline and online metrics;
- Optimize models for inference, improving speed, efficiency, and scalability for production environments;
- Fine-tune and adapt large language models using approaches such as LoRA, QLoRA, prompt/prefix tuning, and instruction tuning;
- Collaborate closely with Data Scientists, Software Engineers, and Product Managers to integrate AI solutions into the product pipeline;
- Participate in improving deployment and inference stack, including evaluation of serving frameworks such as vLLM and SGLang.
Requirements
- Strong hands-on experience with LLM fine-tuning and adaptation techniques such as SFT, LoRA, QLoRA and etc.
- Practical experience in training and improving NLP / LLM models, not only integrating third-party APIs or building RAG pipelines;
- Deep understanding of Machine Learning, Deep Learning, and classical NLP concepts;
- Experience with transformer-based architectures and modern NLP/LLM model development workflows;
- Understanding of model evaluation methodologies, offline/online metrics, and experimentation frameworks;
- Experience with inference optimization, quantization, and deployment/serving frameworks such as vLLM, SGLang, or similar;
- Strong Python skills and practical experience with ML frameworks such as PyTorch, Transformers, NumPy, Pandas, Scikit-learn;
- Good understanding of software engineering best practices and production-oriented development mindset;
- English level B2+.
Benefits
- REMOTE OPPORTUNITY to work full-time;
- Vacation 28 calendar days per year;
- 7 wellness days per year (time off) that can be used to deal with household issues, to lie down and recover without taking sick leave;
- Bonuses up to $5000 for recommending successful applicants for positions in the company;
- 50% payment for professional training, international conferences, and meetings;
- Corporate discount for English lessons;
- Health benefits. According to the paychecks, if you are not eligible for corporate medical insurance, the company will compensate you with up to $ 1,000 gross per year per employee. This can be spent on self-purchase of health insurance or on doctor’s fees for yourself and close relatives (spouse, children);
- Workplace organization. The company provides all employees with an equipped workplace and all the necessary equipment (table, armchair, wifi, etc.) in our offices or co-working locations. In the other locations, the company provides reimbursement of workplace costs up to $ 1000 gross once every 3 years, according to the paychecks. This money can be spent on the rent of the co-working room, on equipping the working place at home (desk, chair, Internet, etc.) during those 3 years;
- Internal gamified gratitude system: receive bonuses from colleagues and exchange them for our merchandise, team building activities, massage certificates, etc.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
LLM fine-tuningSFTLoRAQLoRANLP model trainingMachine LearningDeep Learningtransformer-based architecturesinference optimizationquantization
Soft Skills
collaborationcommunicationproblem-solvingadaptabilitycritical thinking