Irth Solutions

Senior Data Architect

Irth Solutions

full-time

Posted on:

Location Type: Remote

Location: India

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AWSAzureCloudGoogle Cloud PlatformPySparkPythonScalaSparkSQLUnity

About the role

  • Design the enterprise architecture for the Databricks Lakehouse, including medallion architecture (Bronze, Silver, Gold) and semantic layers.
  • Develop multi-cloud data ingestion and consolidation strategies across AWS, Azure, GCP, and on-prem systems.
  • Define standards for data lineage, metadata management, data quality, CDC/SCD, streaming, and batch ingestion.
  • Establish enterprise data governance frameworks, including classification, cataloging (Unity Catalog), retention, and security policies.
  • Ensure compliance with global regulatory standards such as GDPR, PIPEDA, Australian Privacy Act, and SOC 2.
  • Architect scalable, reliable, and cost-efficient solutions to support analytics, reporting, GIS, and AI/ML workloads.
  • Create architecture documentation, standards, and best practices.
  • Collaborate with data engineering teams to implement pipelines, Delta Lake storage, and Databricks workflows.
  • Provide technical leadership, architectural guidance, and code reviews.
  • Ensure consistent architecture implementation across products, tenants, and cloud environments.
  • Work with DevOps teams on infrastructure, networking, identity management, and CI/CD integration.
  • Establish monitoring, observability, and operational governance processes.
  • Define and enforce security policies including RBAC/ABAC, encryption, and audit logging.
  • Integrate enterprise metadata and lineage using Unity Catalog and Purview.
  • Ensure compliance with data residency, regulatory, and cloud-specific requirements.
  • Develop standards for data retention, archival, and disaster recovery.
  • Design architecture supporting BI tools such as Power BI and Databricks SQL.
  • Enable advanced analytics, predictive modeling, geospatial analytics, and AI/ML use cases.
  • Establish semantic modeling standards to ensure consistent business definitions across products.
  • Serve as a subject matter expert in Databricks Lakehouse and multi-cloud data architecture.
  • Mentor engineering teams on data modeling, governance, and scalable architecture practices.
  • Collaborate with product teams and stakeholders to translate business requirements into technical solutions.
  • Participate in architectural governance, vendor evaluations, and roadmap planning.

Requirements

  • 8+ years of experience in data architecture, data engineering, or platform architecture, including 3+ years in a senior or leadership role.
  • Strong expertise in Databricks (preferably Azure), including Delta Lake, Unity Catalog, SQL Warehouses, and Lakehouse architecture.
  • Experience designing multi-cloud or hybrid architectures across AWS, Azure, and GCP.
  • Expertise in medallion architecture, metadata management, and enterprise data governance.
  • Advanced SQL skills and experience with Python, Scala, PySpark, or Spark SQL.
  • Experience with CDC, SCD Type 1/2, streaming pipelines, and batch processing.
  • Strong knowledge of security, compliance, encryption, and data governance standards.
  • Excellent documentation, communication, and architectural design skills.
  • Experience integrating Unity Catalog with Purview or similar metadata tools.
  • Knowledge of AI/ML, geospatial analytics, or predictive modeling platforms.
  • Experience with Power BI semantic modeling or enterprise BI architecture.
  • Experience in regulated or multi-tenant data environments.
  • Relevant certifications such as Databricks Architect, Azure Data Architect, or AWS/GCP certifications.
  • Bachelor’s or master’s degree in computer science, Software Engineering, or a related field, or equivalent professional experience.
Benefits
  • Being an integral part of a dynamic, growing company that is well respected in its industry.
  • Competitive pay based on experience.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
DatabricksDelta LakeUnity CatalogSQLPythonScalaPySparkSpark SQLCDCSCD
Soft Skills
technical leadershiparchitectural guidancedocumentationcommunicationmentoringcollaborationproblem-solvingdesign skillsorganizational skillsstakeholder engagement
Certifications
Databricks ArchitectAzure Data ArchitectAWS certificationsGCP certifications