Tide

Lead Data Engineer, Snowflake/DBT

Tide

full-time

Posted on:

Location Type: Hybrid

Location: Bengaluru • 🇮🇳 India

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AirflowApacheAWSETLPythonSQL

About the role

  • Building and running the data pipelines and services required to support business functions, reports and dashboards
  • Developing end to end ETL/ELT Pipelines working with Data Analysts of business Function
  • Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture
  • Mentoring other Junior Engineers in the Team and being a go-to expert for data technologies
  • Providing on the ground troubleshooting and diagnosis to architecture and design challenges
  • Troubleshooting and resolving technical issues as they arise and looking for ways of improving pipeline delivery
  • Translating business requirements into technical requirements, including entities to model, DBT models, timings, tests and reports
  • Owning the delivery of data models and reports end to end
  • Performing exploratory data analysis to identify data quality issues early and implement tests to prevent them
  • Working with Data Analysts to ensure data feeds are optimised and available (including Change Capture and delta loading approaches)
  • Discovering, transforming, testing, deploying and documenting data sources
  • Applying, helping define, and championing data warehouse governance: data quality, testing, coding best practices, and peer review
  • Building Looker Dashboards for use cases if required

Requirements

  • You have 7+ years of extensive development experience using snowflake or similar data warehouse technology
  • You have working experience with dbt and other technologies of the modern data stack, such as Snowflake, Apache Airflow, Fivetran, AWS, git, Looker
  • You have experience in agile processes, such as SCRUM
  • You have extensive experience in writing advanced SQL statements and performance tuning them
  • You have experience in Data Ingestion techniques using custom or SAAS tool like fivetran
  • You have experience in data modelling and can optimise existing/new data models
  • You have experience in data mining, data warehouse solutions, and ETL, and using databases in a business environment with large-scale, complex datasets
  • You have experience architecting analytical databases (in Data Mesh architecture) is added advantage
  • You have experience working in agile cross-functional delivery team
  • You have high development standards, especially for code quality, code reviews, unit testing, continuous integration and deployment
  • You have strong technical documentation skills and the ability to be clear and precise with business users
  • You have business-level of English and good communication skills
  • You have basic understanding of various systems across the AWS platform ( Good to have )
  • Preferably, you have worked in a digitally native company, ideally fintech
  • Experience with python, governance tool (e.g. Atlan, Alation, Collibra) or data quality tool (e.g. Great Expectations, Monte Carlo, Soda) will be added advantage
Benefits
  • Make work, work for you! We are embracing new ways of working and support flexible working arrangements. With our Working Out of Office (WOO) policy our colleagues can work remotely from home or anywhere in their assigned Indian state. Additionally, you can work from a different country or Indian state for 90 days of the year.
  • Competitive salary
  • Self & Family Health Insurance
  • Term & Life Insurance
  • OPD Benefits
  • Mental wellbeing through Plumm
  • Learning & Development Budget
  • WFH Setup allowance
  • 15 days of Privilege leaves
  • 12 days of Casual leaves
  • 12 days of Sick leaves
  • 3 paid days off for volunteering or L&D activities
  • Stock Options

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
ETLELTSQLdata modelingdata miningdata qualitydata governanceperformance tuningdata ingestiondata analysis
Soft skills
mentoringtroubleshootingcommunicationtechnical documentationagile processesteam collaborationproblem-solvingattention to detailleadershipbusiness analysis