Data Engineering Manager
Trajector
AirflowAmazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonSQL
Data Architect
Billigence
contract
Posted on:
Location Type: Remote
Location: Remote • 🇮🇳 India
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
AirflowAWSAzureCloudETLMatillionPythonSQLTableauTerraform
About the role
- Design and implement end-to-end data architecture leveraging Snowflake and Matillion for data ingestion, transformation, and storage.
- Define and maintain data modeling standards, data flows, and architecture best practices (dimensional, normalized, star/snowflake schemas).
- Lead the evaluation and adoption of tools in the modern data stack, ensuring alignment with business goals and future scalability.
- Collaborate with data engineers, analysts, and stakeholders to define data requirements and create robust data pipelines.
- Ensure data security, access controls, and compliance with governance frameworks (e.g., GDPR, HIPAA, SOC 2).
- Optimize performance of Snowflake through clustering, caching, query tuning, and cost management.
- Oversee data integration strategies from multiple sources (APIs, databases, flat files, third-party platforms).
- Establish data quality and metadata management practices across platforms.
- Act as a subject matter expert and provide guidance on Matillion orchestration, reusable job frameworks, and job performance optimization.
Requirements
- 5+ years of experience in data engineering, architecture, or similar roles.
- Proven expertise with Snowflake (multi-cluster warehouse design, role-based access, data sharing, etc.).
- Strong experience designing and implementing pipelines with Matillion ETL.
- Proficient in data modeling and building scalable cloud data platforms.
- Deep understanding of ELT/ETL design patterns and orchestration principles.
- Strong SQL and scripting (e.g., Python or Bash) skills.
- Hands-on experience with cloud platforms (preferably AWS or Azure).
- Familiar with CI/CD, version control (Git), and infrastructure-as-code (e.g., Terraform, CloudFormation).
- Preferred: Experience with dbt, Airflow, or other orchestration and transformation tools.
- Preferred: Knowledge of BI/reporting tools (e.g., Power BI, Tableau, Looker).
- Preferred: Familiarity with data governance and data catalog solutions (e.g., Alation, Collibra, Atlan).
- Preferred: Background in supporting machine learning platforms and real-time data pipelines.
- Preferred: Industry experience in finance, healthcare, retail.
Benefits
- Remote work (India)
- Contractor employment
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data architecturedata modelingdata ingestiondata transformationdata storageSQLPythonBashELTETL
Soft skills
collaborationleadershipcommunicationproblem-solvingsubject matter expertise
