Quantexa

Lead Data Engineer

Quantexa

full-time

Posted on:

Origin:  • 🇲🇾 Malaysia

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzureCloudDockerElasticSearchGradleHadoopJavaJenkinsPythonScalaSpark

About the role

  • Lead, support, and mentor a team of junior data engineers within an agile framework
  • Write defensive, fault tolerant and efficient code for production level data processing systems
  • Configure and deploy Quantexa’s software using tools such as Spark, Hadoop, Scala, Elasticsearch, on private and public clouds (Google Cloud, Azure, AWS)
  • Articulate technical concepts to non-technical audiences and act as a trusted source of knowledge to clients
  • Collaborate with solution architects and R&D engineers to champion solutions and standards for complex big data challenges
  • Manage, transform, and cleanse high volume data to solve business problems including fraud, financial crime, data management, risk and customer intelligence

Requirements

  • At least five years of industry experience in a data engineering role or engineering equivalent
  • At least 2 years of experience acting in a lead role within a data or software engineering team
  • Proficiency in Scala, Java, Python, or a programming language associated with data engineering
  • Expertise building and deploying production level data processing batch systems maintained by application support teams
  • Familiarity with modern development tooling (e.g. Git, Gradle, Nexus)
  • Experience with DevOps automation tools (e.g. Jenkins, Docker, Bash scripting)
  • Strong technical communication ability with demonstrable experience of working in rapidly changing client environments
  • Knowledge of testing libraries (such as ScalaTest) and understanding of different test types (unit, integration)
  • Applicants must be authorized to work for any employer in Canada