Salary
💰 $67,449 - $183,322 per year
Tech Stack
ApacheAWSDockerETLIoTJavaLinuxPythonSparkSplunkTypeScriptVMware
About the role
- The Software Engineer shall be responsible for developing, and maintaining scalable real-time ETL (Extract, Transform, Load) pipelines using Apache Storm and Java to process large-scale data streams.
- In this role, the Software Engineer shall be a member of a team that is responsible for transforming raw data into actionable insights by ensuring high performance, availability, and reliability of the HPC organization’s data feeds.
Requirements
- Experience using the Linux CLI
- Experience developing scripts using Bash/Python
- Recent software development experience with Java in a Linux environment
- Familiarity with real-time streaming concepts, distributed computing fundamentals, and big data ecosystems such as Apache Storm, Apache Flink, Apache Spark, or Apache NiFi
- Experience with CI/CD concepts, principles, methodologies, and tools such as GitLab CI
- Experience with containerization technologies such as Docker
- Experience with the Atlassian Tool Suite (JIRA, Confluence)