FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Specialist Support Engineer – DataOps
Absa GroupSpecialist Support Engineer for DataOps at Absa Bank, managing application support and team mentoring. Focused on optimising and building data pipelines with a Big Data environment.
Tech Stack
Tools & technologiesApacheCloudHadoopHDFSJavaKafkaLinuxMapReducePythonScalaSparkSQL
About the role
Key responsibilities & impact- Manage an assigned team through day-to-day support tasks
- Oversee development plans for the team and provide mentorship to the team
- Provide guidance and peer review
- Support pipelines end to end
- Build and deploy enhancements and new developments or new data pipelines
- Identify and drive optimisation opportunities across the environment
- Manage the handover of new applications ensuring that required standards and practices are met
- Improvement on recovery time in case of prod failures
- Test prototypes and oversee handover to the Data Operations teams
- Attend and contribute to regular team and User meetings
- Responsible for the actual coding or programming of Hadoop applications
- High-speed querying
Requirements
What you’ll need- 3+ years’ experience working in Big data environment, optimising and building big data pipelines, architectures and data sets with e.g. Java, Scala, Python, Hadoop, Apache Spark and Kafka
- Minimum one year experience with Scala programming language
- Minimum one year experience managing a team
- Cross domain knowledge
- Familiarity with Hadoop ecosystem and its components
- Good knowledge of the concepts of Hadoop
- Solid experience in a working environment in Big Data development utilising SQL or Python
- Experience in Big Data development using Spark
- Experience in Hadoop, HDFS and MapReduce
- Experience in database design, development and data modelling
- Good knowledge in back-end programming, specifically java
- Experience with development in a Linux environment and its basic commands
- Understanding of Cloud technologies and migration techniques
- Understanding of data streaming and the intersection of batch and real time data
- Ability to write reliable, manageable, and high-performance code
- Should have basic knowledge of SQL, database structures, principles, and theories
- Knowledge of workflow/schedulers
- Strong collaboration and communication skills
- Strong analytical and problem-solving skills
- Experience in Quality Assurance
- Experience in Stakeholder Management
- Experience in Testing
Benefits
Comp & perks- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
JavaScalaPythonHadoopApache SparkKafkaSQLHDFSMapReduceLinux
Soft Skills
mentorshipcollaborationcommunicationanalytical skillsproblem-solvingstakeholder managementquality assurance