Principal Software Engineer – Data Engineering, Cloud
Three Ventures Technology, Inc.
full-time
Posted on:
Location Type: Remote
Location: Remote • California • 🇺🇸 United States
Visit company websiteSalary
💰 $150,000 - $300,000 per year
Job Level
Lead
Tech Stack
AirflowApacheAWSAzureCloudKafkaKubernetesNoSQLOpen SourcePython
About the role
- Architect, design, and maintain high quality code in Python
- Design data pipelines that can consume from various systems in different shapes and sizes, including but not limited to Kafka, sensors, real time streams, and data lakes
- Be well versed in AWS, Azure, container based applications, and Kubernetes
- Work on different types of data engineering workloads, such as incremental, delta, and single source of truth patterns
- Review and approve PRs across services and SDKs with deep context and constructive feedback
- Rapidly prototype, scaffold systems, and break down complex architectures into modular subsystems and micro-services
- Lead and foster a high code quality culture within the organization, while carefully implementing software design patterns, messaging patterns and architectures
- Own technical strategy for scalable cloud infrastructure across AWS, Azure and multi-cloud setups
- Contribute to decision making on "build vs buy," especially around open source and commercial tools
- Build integrations and abstractions around customers’ legacy business systems such as SAP and GIS
- Help create and deploy modern data pipelines, APIs and SDKs
- Drive automation first thinking across environments, pipelines, and deployments
- Maintain high quality, reliable data engineering pipelines
- Actively participate in customer engagements, translating feedback into product and platform improvements
- Build tools and interfaces with UX sensitivity, working with the product design team focusing on user centric business software
- Mentor junior engineers in multiple time zones and collaborate cross functionally with product, data science, and customer success teams
- Create low latency, high throughput systems
Requirements
- 8+ years of full time software engineering experience, including in staff, lead, or architect level roles
- Deep experience with cloud native architecture and developing applications on Cloud, especially on AWS (must be hands on) and Azure
- Well versed in Databricks, Delta Lake, Apache Kafka, Airflow, and DAGs
- Strong Python skills preferred, experience in multiple programming languages highly valued
- Experience with containers, CI/CD pipelines, and modern cloud tooling
- Demonstrated ability to design and ship cloud applications at scale with low latency, auto-scaling, and request routing capabilities
- Familiarity with SDK development, API design (both consuming and building), and schema-less DBs
- Comfortable navigating both relational and NoSQL database architectures
- Track record of building high quality, open source or enterprise grade software
- Background working in high caliber tech companies or open source centric environments (e.g., Databricks, Hugging Face, Replicate)
- Solid understanding of software design patterns, cloud architectures and messaging patterns.
Benefits
- Health insurance
- 401(k) plan
- Paid time off
- Remote work options
- Professional development
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
Pythoncloud native architectureDatabricksDelta LakeApache KafkaAirflowCI/CD pipelinesSDK developmentAPI designNoSQL databases
Soft skills
leadershipmentoringcollaborationcustomer engagementcommunicationfeedback translationcode quality cultureproblem solvingorganizational skillscross-functional teamwork