Bailey Abbott

Data Engineer

• Represent Bailey Abbott, sharing your skills and knowledge to help deliver projects for our clients
• Develop and maintain ETL (Extract, Transform, Load) pipelines to ingest, process, and transform data within our Microsoft Azure-based data lake, utilising Azure Data Factory
• Design and implement efficient data models and schemas in Azure to ensure data quality and reliability, integrating Azure Purview for data governance
• Utilise your proficiency in SQL and NoSQL databases to optimise data storage and retrieval in Azure environments
• Leverage big data technologies such as Apache Spark, Hadoop, or Azure HDInsight to process and analyse large datasets
• Collaborate with data scientists, analysts, and stakeholders to understand business requirements and deliver valuable data solutions tailored for Azure ecosystems
• Write high-quality, scalable code in languages such as Python, Java, or Scala to support Azure-based data engineering tasks
• Continuously monitor, troubleshoot, and optimise data pipelines in Azure for performance and reliability
• Stay up-to-date with industry best practices and emerging technologies in the Azure landscape to drive innovation in our data platform

Senior Data Engineer