Senior Data Platform Engineer
Inspiren
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $180,000 - $200,000 per year
Job Level
Senior
Tech Stack
AWSCloudETLKafka
About the role
- Collaborate with engineering, data science, ML, data engineering, and product analytics teams to understand and shape the future needs of our data platform and infrastructure.
- Define, drive, and implement the future live ingestion layer of data into our data platform (e.g. Kafka, Kinesis).
- Define and evolve standards for storage, compute, data management, provenance, and orchestration.
- Monitor current and forecast future infrastructure needs and costs based on business requirements.
- Implement and manage role-based access management.
- Design and implement reusable tooling and frameworks for data consumers (e.g., data quality monitoring frameworks, templated pipelines, foolproof backfilling capabilities).
Requirements
- Bachelor's or Master's degree in Computer Science, or a related engineering field.
- 5+ years of experience in data infrastructure, platform engineering, data engineering, or similar.
- Demonstrated hands-on experience with Databricks. AWS experience is a plus but not required.
- Expertise in modern data warehouse and lakehouse architectures.
- Expertise in modern ETL technologies and building and supporting data pipelines at scale.
- Familiarity with access control, data governance, and security.
- Demonstrated experience of reliability, observability, and monitoring of infrastructure and systems.
- Experience building and maintaining data platforms with a wide variety of stakeholders/users with a diversity of technical expertises.
- Demonstrated ability to scale cloud-based data workloads, whilst optimizing and monitoring cost.
- Excellent verbal and written communication skills, with the ability to convey complex ideas clearly.
- Comfortable working in a fast-paced, dynamic environment and adapting to changing priorities.
Benefits
- medical
- dental
- vision
- Flexible PTO
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data infrastructureplatform engineeringdata engineeringDatabricksdata warehouse architecturelakehouse architectureETL technologiesdata pipelinesrole-based access managementdata quality monitoring
Soft skills
communicationcollaborationadaptabilityproblem-solvingstakeholder managementreliabilityobservabilitymonitoringorganizational skillsability to convey complex ideas
Certifications
Bachelor's degree in Computer ScienceMaster's degree in Computer Science