Salary
💰 $155,656 - $225,160 per year
Tech Stack
ApacheAWSEC2NoSQLPythonSparkSQL
About the role
- Design and implement scalable and efficient data architectures, meeting data needs from data scientists, engineers and business partners
- Identify and implement improvements to system’s cost efficiency, reducing data storage and processing costs
- Model structured & unstructured data and own data models at a high level; act as a data consultant for partner teams
- Champion best practices on system usages and hold high-quality code standards
- Participate in the team’s oncall rotation, helping solve timely reliability incidents
- Design and scale data lake, data pipelines, distributed query engines, experimentation framework, and dashboards
- Improve system reliability, create/improve tooling, and promote correct use of data across the company
- Optimize, enhance or re-design company’s data architecture/pipelines to support next generation data initiatives
Requirements
- Availability for meetings and impromptu communication during Quora's “coordination hours" (Mon-Fri: 9am-3pm Pacific Time)
- 4+ years of experience working in Data Infrastructure
- Flexibility for working and owning different Data Engineering systems
- Operational mindset with ability to do Problem diagnosis, Root cause analysis, Performance tuning and Incident Management
- Proficiency in Python and SQL query design
- Proficiency with big data processing frameworks, like: Hive, Spark and Trino
- Experience building data-intensive applications (high velocity/high volume)
- Experience with SQL/NoSQL data store & data lake operations
- Participate in the team’s oncall rotation (availability for incidents)
- Preferred: Hands-on experience with AWS technologies like S3, EC2, RDS, EKS, or in Apache Iceberg
- Preferred: Flexible and positive team player with good interpersonal skills