Miratech

Data Engineer, Azure Databricks

Miratech

full-time

Posted on:

Location Type: Remote

Location: Spain

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AzureCloudETLPySparkSparkSQLSSIS

About the role

  • Design, develop, and maintain data pipelines using Azure Databricks
  • Build and optimize data transformations using PySpark and SQL in Databricks
  • Implement and maintain Lakehouse architectures using Delta Lake
  • Develop ETL/ELT pipelines orchestrated through Azure Data Factory
  • Integrate data from multiple sources into the data platform and analytical layers
  • Design and maintain data models and data warehouse structures for analytics
  • Ensure data quality, scalability, and performance of large-scale data processing pipelines
  • Collaborate with BI teams to support Power BI and reporting platforms
  • Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required
  • Contribute to the design of modern cloud-based data architectures

Requirements

  • 3+ years of experience in Data Engineering or Data Warehouse development
  • Strong experience with Azure Databricks
  • Experience developing data pipelines using PySpark and Spark SQL
  • Solid understanding of distributed data processing and big data concepts
  • Experience working with Delta Lake and Lakehouse architectures
  • Strong SQL skills and experience with SQL Server relational databases
  • Experience building data pipelines using Azure Data Factory
  • Experience handling large datasets and performance optimization
  • Nice to have Experience with Spark optimization techniques (partitioning, caching, cluster tuning)
  • Experience with structured streaming in Databricks
  • Knowledge of CI/CD pipelines for data platforms (Azure Devops)
  • Familiarity with Power BI
  • Experience in migrating from traditional ETL process to cloud architectures
Benefits
  • Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
  • Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
  • Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
  • Growth Mindset : reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
  • Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
  • Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
  • Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data pipelinesPySparkSQLDelta LakeETLELTdata modelingdata warehousingbig datastructured streaming