
Data Engineer
Mercari, Inc.
full-time
Posted on:
Location Type: Remote
Location: California • United States
Visit company websiteExplore more
Salary
💰 $210,746 - $240,000 per year
Tech Stack
About the role
- Design, build, and operate ETL pipelines at scale
- Automate processes related to data products and machine learning products
- Design data structure for data products
- Build knowledge graphs, flow charts, and system diagrams for problem analysis
- Develop and operate API/tools related to data products and machine learning products
- Provide technical solutions using Big Data technologies and create technical design documents
- Design and develop Data Platform using Python, Spark, and BigQuery
- Build Devops platform for Continuous Integration/Continuous deployment stack for ETL applications teams
- Profile, debug, and optimize apps
Requirements
- Bachelor of Science degree in Computer Science or closely related field of study
- Five (5) years of experience as a Data Engineer, Data Specialist, or related occupation
- Five (5) years of experience in Confluence
- Five (5) years of experience in JIRA
- Five (5) years of experience in GIT
- Five (5) years of experience with CI/CD pipelines
- Five (5) years of experience with Agile methodologies
- Five (5) years of experience in Java
- Five (5) years of experience in Python
- Five (5) years of experience in Data Modeling or Data Warehouse
- Five (5) years of experience with ETL: Apache Airflow
- Five (5) years of experience with Container: Docker or Kubernetes
- Five (5) years of experience with API: gRPC, Tensorflow Serving, or Flask (REST)
- Five (5) years of experience with Database: MySQL, Postgres, Oracle, SqlServer, or Google Spanner
- Five (5) years of experience with Distributed Processing: Apache Beam or Apache Spark
- Five (5) years of experience with Machine Learning: Tensorflow, Keras, or Scikit-Learn, etc.
- Five (5) years of experience with Cloud: Google Cloud (BigQuery, Google Dataflow, or Google Dataproc, etc.)
Benefits
- Flexibility: Work remote from anywhere in the US and receive flexible time off
- Wellbeing: Top-notch insurance plans, best-in-class new parent offerings and access to mind and body wellness apps
- Growth: As we grow, your career opportunities grow, we provide access to new tools, technologies and learning opportunities
- Comprehensive and total rewards: We provide a strong financial foundation and rewards that go beyond the paycheck
- Teamwork: We are each other's biggest fans- we celebrate from virtual coffee breaks to recognition programs
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLdata modelingdata warehousePythonSparkBigQueryApache AirflowDockerKubernetesMachine Learning
Soft Skills
problem analysistechnical solutionsautomationdebuggingoptimization
Certifications
Bachelor of Science in Computer Science