Deeplight AI

Data Architect

Deeplight AI

full-time

Posted on:

Location Type: Hybrid

Location: Abu Dhabi • 🇦🇪 United Arab Emirates

Visit company website
✨ AI Apply
Apply

Job Level

SeniorLead

Tech Stack

ApacheAWSSpark

About the role

  • Design and enforce Medallion Architecture for the Lakehouse.
  • Drive architectural decision-making through SAF/ARB architecture forums.
  • Lead design for all Data Factory squads working on data initiatives.
  • Define standards for Apache Iceberg tables, including partitioning strategy, schema evolution, time travel and snapshot retention, and table optimization schedules.
  • Establish data modeling standards (e.g., dimensional modeling for Gold layer, SCD2, naming conventions, metadata management).
  • Define lineage standards leveraging OpenMetadata.
  • Coordinate with platform teams on Iceberg-related activities.
  • Collaborate with Data Quality leads to implement validation rules.
  • Proactively manage escalations and communicate progress with senior stakeholders.
  • Provide guidance to Glue Data Engineers.
  • Establish code review processes and best practices.
  • Create reusable design patterns and templates for consistency.

Requirements

  • data architecture roles, ideally 10 years+ with at least 3 years in Lakehouse implementations.
  • Lakehouse architecture (S3, Iceberg, Glue, Spark).
  • schema evolution, partitioning strategies, and table optimization in Iceberg.
  • defining metadata management, lineage, and data quality frameworks.
  • Medallion architecture and data modeling principles.
  • leading architectural forums and influence decision-making.
  • AWS services (S3, Glue, Athena, EMR).
  • Apache Iceberg, Spark.
  • OpenMetadata, or similar lineage tools.
  • automating work / repetitive tasks.
  • communicating and stakeholder management.
  • working collaboratively across multiple squads and teams.
  • working in a fast-paced environment and deliver aggressive migration targets.
  • working with Jira and agile way of working.
Benefits
  • Competitive salary and performance bonuses
  • Comprehensive health insurance
  • Professional development and certification support
  • Opportunity to work on cutting-edge AI projects
  • Flexible working arrangements
  • Career advancement opportunities in a rapidly growing AI company

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data architectureLakehouse architectureschema evolutionpartitioning strategiestable optimizationmetadata managementdata quality frameworksApache IcebergSparkMedallion architecture
Soft skills
stakeholder managementcommunicationcollaborationleadershipinfluence decision-makingproactive managementescalation managementguidancecreating reusable design patternsworking in a fast-paced environment