FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.

Senior Data Engineer
Ventures LabSenior Data Engineer responsible for designing and building data infrastructure in iGaming and Fintech. Collaborate with cross-functional teams to ensure reliable data processing and analysis.
Tech Stack
Tools & technologiesAirflowApacheAWSCloudDockerETLGrafanaKafkaKubernetesPrometheusPythonSQLTerraform
About the role
Key responsibilities & impact- Design and implement robust, scalable data architecture to support the collection, storage, and processing of large volumes of igaming and customer data
- Build and maintain efficient ETL and ELT processes to ensure seamless data ingestion from multiple sources into our data lake, DWH, and final consumers
- Create and maintain well-structured data models that ensure accuracy, integrity, and optimal performance for analytical use cases following Kimball best practices
- Collaborate with cross-functional teams to integrate data across systems, with several types of integration as API, Kafka, DB extractions, Webscrapping, Email, etc.
- Develop and manage real-time data pipelines using streaming technologies (e.g., Kafka) to support time-sensitive use cases
- Enforce data governance policies and best practices, ensuring high standards for data quality, security, and regulatory compliance
- Continuously monitor, troubleshoot, and optimize data pipelines, queries, and infrastructure for speed, efficiency, and reliability
- Support and expand production-grade orchestration workflows using Apache Airflow
- Set up and maintain monitoring, alerting, and observability for data pipelines and systems using tools like Elementary, Datadog, Prometheus, or Grafana
- Develop and maintain CI/CD pipelines for data projects using Bitbucket Pipelines or GitHub Actions, ensuring streamlined deployment and testing processes
- Follow best practices in Git-based version control and work collaboratively in a modern DevOps environment.
Requirements
What you’ll need- 5+ years of experience with Python, preferably including 2+ years working with Airflow
- 5+ years of experience with SQL in big data environments, preferably including 2+ years with dbt
- 4+ years in cloud environments, preferably with 2+ years each in Snowflake and AWS
- 2+ years of experience with data streaming platforms, preferably on Kafka
- 2+ years of hands-on experience with containerization (Docker, Kubernetes)
- 3+ years managing CI/CD pipelines, ideally using Bitbucket Pipelines or GitHub Actions
- Deep understanding of data governance, data quality, and data lineage principles
- Proficient in using monitoring and alerting tools such as Datadog, Prometheus, or Grafana
- Solid experience with version control tools (Git) and IaaS (e.g., Terraform)
- Strong communication and problem-solving skills, with a proactive and self-driven attitude.
Benefits
Comp & perks- Competitive salary synonymous with skills and experience
- Performance and bonus structure dependent on achievement of set targets and personal performance
- The opportunity to making a real impact at a time of rapid growth
- Consultancy B2B contract on a full time basis with 25 days PTO
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonSQLETLELTdata modelingdata governancedata qualitydata lineageCI/CDcontainerization
Soft Skills
communicationproblem-solvingproactiveself-driven