
Senior Data Engineer
Walmart
full-time
Posted on:
Location Type: Office
Location: Sunnyvale • California • United States
Visit company websiteExplore more
Salary
💰 $117,000 - $234,000 per year
Job Level
About the role
- Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide
- Drive value from data
- Interact with Sams Club engineering teams across geographies to leverage expertise
- Engage with Product Management and Business to drive the agenda, set your priorities and deliver awesome product features
- Identify right open source tools to deliver product features by performing research, POC/Pilot and/or interacting with various open source forums
- Develop and/or Contribute to add features that enable adoption of data across Sams Club
- Deploy and monitor products on Cloud platforms
- Develop and implement best-in-class monitoring processes
- Guide the team technically for end to end solution Lifecycle.
Requirements
- 4 - 6 years of Big data development experience
- 2 - 3 Years of Experience in GCP/Azure cloud platforms
- Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development
- Architect, Design, develop, implement and tune distributed data processing pipelines that process large volume of data
- Proven experience in data modeling and design, with a strong understanding of data architecture principles and best practices
- Exposure to Data Governance ( Data Quality, Metadata Management, Security, etc.)
- Expertise in using tools such as JUnit, TestNG, or PyUnit to write and execute unit tests
- Experience with CI/CD pipelines to automate testing processes
- Experience with Java, Scala and/or Python to write data pipelines and data processing layers
- Demonstrates expertise in writing complex, highly-optimized queries across large data sets
- Proven working expertise with Big Data Technologies Spark Scala/PySpark, and SQL
- Knowledge and experience in Kafka, Spark Streaming, Druid and Presto.
Benefits
- Health benefits include medical, vision and dental coverage
- Financial benefits include 401(k), stock purchase and company-paid life insurance
- Paid time off benefits include PTO, parental leave, family care leave, bereavement, jury duty, and voting
- Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more
- Live Better U is a company paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Big Data developmentdata pipeline developmentdata modelingdata architecturedata governanceJavaScalaPythonSQLSpark
Soft Skills
interpersonal skillstechnical guidancecollaborationprioritizationcommunication