Tech Stack
AWSAzureCloudDockerElasticSearchGradleHadoopJavaJenkinsPythonScalaSpark
About the role
- Lead, support, and mentor a team of junior data engineers within an agile framework
- Write defensive, fault tolerant and efficient code for production level data processing systems
- Configure and deploy Quantexa’s software using Spark, Hadoop, Scala, Elasticsearch on private and public clouds (Google Cloud, Microsoft Azure, AWS)
- Manage, transform, and cleanse high-volume data to solve business problems across fraud, financial crime, data management, risk and customer intelligence
- Engage with business teams and clients to break down requirements into technical tasks
- Work hands-on as a programmer while supporting other engineers
- Articulate technical concepts to non-technical audiences to aid decision-making
- Collaborate with solution architects and R&D engineers to champion solutions, promote knowledge sharing and ensure best practices
Requirements
- At least five years of industry experience in a data engineering role or engineering equivalent
- At least 2 years of experience acting in a lead role within a data or software engineering team
- Proficiency in Scala, Java, Python, or a programming language associated with data engineering (primary language Scala)
- Expertise building and deploying production level data processing batch systems maintained by application support teams
- Appreciation of operationally stable systems and ability to streamline development, release, and operations
- Experience with modern development tooling (e.g. Git, Gradle, Nexus)
- Experience with DevOps and automation tools (e.g. Jenkins, Docker) and Bash scripting
- Familiarity with version-controlled development processes
- Strong technical communication ability with demonstrable experience of working in rapidly changing client environments
- Knowledge of testing libraries (such as ScalaTest) and understanding of different test types (unit, integration) with examples
- Valid Secret-level government security clearance (current or within the past 12 months) mandatory
- Authorization to work for any employer in Canada
- Nice to have: experience mentoring and up-skilling team members or acting as a technical line manager
- Nice to have: passion for expanding the business and leading initiatives