LILT AI

AI Benchmark Engineer – Native Language Specialist, Serbian

LILT AI

contract

Posted on:

Location Type: Remote

Location: Serbia

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

PythonShell Scripting

About the role

  • Evaluating Coding Agents.
  • Build realistic task environments using datasets and files in your native language.
  • Finding failure points where AI does not work, in your native language
  • Support the development of robust solutions and write reliable verifier scripts.
  • Analyze execution logs and calibrate task difficulty.
  • Participate in a rigorous human quality control process alongside automated checks to ensure fairness and accuracy.

Requirements

  • 5+ years of industry experience in software engineering.
  • Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
  • Native or near-native fluency in Serbian, with a deep understanding of its grammar, register, and phrasing rules.
  • High English proficiency.
  • Strong proficiency in Python, standard shell scripting, and data processing.
  • Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
  • Deep technical understanding of multilingual text processing pitfalls, including Encoding/decoding robustness and Unicode normalization, Locale-dependent conventions (collation, casing, non-Gregorian dates), Text I/O, toolchain interoperability, and safe string operations.
  • Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
Benefits
  • Freelance opportunity
  • Earn money
  • Have fun
  • Advance human knowledge
  • Work on diverse projects from anywhere, any time you want.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
Pythonshell scriptingdata processingmultilingual text processingEncoding/decoding robustnessUnicode normalizationLocale-dependent conventionsText I/Otoolchain interoperabilitysafe string operations
Soft Skills
leadershipcommunicationanalytical skillsattention to detailproblem-solving