Tech Stack
AWSAzureCloudGoogle Cloud PlatformHadoopKafkaSparkSQL
About the role
- Develops and maintains scalable data pipelines
- Collaborate with business teams to improve data models that feed business intelligence tools
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available
- Performs data analysis required to troubleshoot data-related issues and assist in the resolution of data issues
- Works closely with all business units and engineering teams to develop a strategy for long term data platform architecture
- Take ownership of your code, and ensure that the acceptance criteria is verified before sending the ticket to QA
- Implement data lake/data warehouse on various cloud providers (AWS, Azure, GCP)
- Produce detailed documentation related to the data pipeline, including design, development, and deployment details
- Designs data integrations and data quality framework
- Develop and maintain strategies on data security and data governance
Requirements
- Available to work core hours aligned with CST (Central Standard Time)
- 5+ years of data engineering experience
- Experience with multiple cloud platforms (AWS, Azure, GCP)
- Experience with DBT (Data Build Tool)
- Advanced working SQL knowledge and experience working with relational databases as well as working familiarity with a variety of databases
- Strong analytic skills related to working with unstructured datasets
- Experience with big data tools: Hadoop, Spark, Kafka
- Experience with Data Modeling
- Some understanding of Machine Learning
- Comfortable with Data Modeling, BI Tools, Reporting, Dashboards, and Data Analytics
- A successful history of manipulating, processing, and extracting value from large disconnected datasets
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
- Remote Work Opportunities
- Flexible Work Hours
- Unlimited PTO
- Competitive Salaries
- Health + Dental + Vision + Life Insurance
- Long Term disability + 401k Match
- Professional Development Opportunities
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringdata pipelinesdata analysisdata modelingSQLHadoopSparkKafkaDBTmachine learning
Soft skills
analytical skillscollaborationownershiptroubleshootingcommunicationdocumentationstrategic thinkingproblem-solvingattention to detailadaptability