Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs
Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
Contribute to ground-breaking innovation and apply the state-of-the-art technologies
As a key member of the team, you will contribute to all aspects of the software lifecycle: design, experimentation, implementation and testing
Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment
Own end-to-end delivery of substantial features or subsystems
Promote a positive, inclusive, and collaborative engineering culture
Identify and resolve root causes of complex production issues
Provide constructive feedback and mentorship to junior engineers
Requirements
Bachelor in computer science or similar quantitative field, or equivalent experience
5+ years of professional programming in Scala, Python, and etc.
3+ years of big data development experience with technical stacks like Spark, Flink, Airflow, Singlestore, Kafka and AWS big data technologies
Deep understanding of data modeling, distributed systems, and performance optimization
Knowledge of system, application design and architecture
Experience of building industry level high available and scalable service
Passion about technologies, and openness to interdisciplinary work
Excellent communication and collaboration skills
Hands-on experience with Databricks for development and deployment of data pipelines (preferred)
Experience with data governance, compliance, or observability tooling (preferred)
Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, Spinnaker, IAM, ALB, and etc. (preferred)
Experience with Snowflake, Kinesis, lambda etc. (preferred)
Experience in MicroService framework like Spring Boot, Spring Cloud, FastAPI, NestJS etc. (preferred)
Benefits
A bonus and/or long-term incentive units may be provided as part of the compensation package
Full range of medical, financial, and/or other benefits
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.