Salary
💰 $136,000 - $204,000 per year
Tech Stack
AWSETLPythonSparkSQL
About the role
- Work independently with limited supervision to design, develop, test, validate, deploy, monitor, and maintain data pipelines as prioritized by the business including creating and updating system documentation and training materials
- Understand, re-architect, and migrate pipelines from previous tooling
- Coordinate and communicate development activities with other team members, infrastructure personnel, vendors and management
- Contribute input to the data strategy and provide feedback to help ensure we are aligned with user needs
- Promote data as an asset
- Create patterns and identify opportunities to deploy existing solutions in other business areas
- Follow defined change control and compliance procedures associated with software development, including all required documentation and governance standards
- Apply data management principles to ensure appropriate governance and accuracy of data
- Solve difficult, complex problems
- Ensure high quality, reliable data
- Partner with our security team and closely follow defined security standards
Requirements
- 10+ years of data experience
- Experience in Databricks, AWS environment and services, databases and database management, Python, Spark, SQL, object-oriented programming, and ETL frameworks
- Experience architecting and creating data pipelines
- Experience in data modeling
- Experience in software development and programming concepts/techniques
- Experience with all aspects of the software development lifecycle methodology and project management concepts
- Experience developing information, conducting meetings and making presentations
- Experience coordinating with and training other project members
- Experience with infrastructure technologies and the ability to understand/communicate impacts resulting from development activities
- Positive attitude and a strong commitment to delivering quality work
- Proven ability to engage, advise, and communicate complex technical concepts clearly and effectively—both in writing and verbally—to stakeholders at all levels, including management and peers.