Affinity Outsourcing Limited

Data Scientist

• Designing and building the data Ingestion Pipeline
• Designing, building and maintain large, complex data processing pipelines using Databricks and Azure Data Factory in Azure to meet enterprise Data requirements
• Providing operational and functional support on creating, storing, managing, and maintaining enterprise data
• Identifying, designing, and implement internal process improvements
• Building the infrastructure required for extraction, transformation, and loading of data from a wide variety of cloud and on-premises data sources
• Working with stakeholders including to assist with data-related technical issues and support their data infrastructure needs
• Working closely with data architecture, data governance and data analytics teams to ensure pipelines adhere to enterprise standards, usability, and performance

ADF Lead, Data Bricks, Snowflake