Senior Associate – Azure Data Engineer
PwC
AzureCloudETLPySparkPythonScalaSQLTableau
Senior Associate – Azure Data Engineer
PwC
full-time
Posted on:
Location Type: Office
Location: Bengaluru • 🇮🇳 India
Visit company websiteJob Level
Senior
Tech Stack
AzureCloudETLPySparkPythonScalaSQLTableau
About the role
- Requirement gathering and analysis
- Design and implement data pipelines using Microsoft Fabric & Databricks
- Extract, transform, and load (ETL) data from various sources into Azure Data Lake Storage
- Work with different databases like Synapse, SQL DB, Snowflake
- Implement data security and governance measures
- Monitor and optimize data pipelines for performance and efficiency
- Troubleshoot and resolve data engineering issues
- Provide optimized solutions for data engineering problems
- Ability to work with a variety of sources: Relational DB, API, File System, Realtime streams, CDC
- Strong knowledge on Databricks, Delta tables
- Ensure alignment with overall system architecture and data flow
Requirements
- 5–8 years of experience in Data Engineering or related roles
- Years of experience required: 4-8 Years (posting contains both ranges)
- Hands-on experience in Microsoft Fabric
- Hands-on experience in Azure Databricks
- Proficiency in PySpark for data processing and scripting
- Strong command over Python & SQL – writing complex queries, performance tuning, etc.
- Experience working with Azure Data Lake Storage
- Experience with Data Warehouse concepts (dimensional modeling, star/snowflake schemas)
- Experience with databases like Synapse, SQL DB, Snowflake
- Hands on experience in performance tuning & optimization on Databricks & MS Fabric
- Understanding CI/CD practices in a data engineering context
- Exposure to BI tools like Power BI, Tableau, or Looker
- Excellent problem-solving and communication skills
- Good to have: Azure DevOps, Scala or other distributed processing frameworks
- Familiarity with data security and compliance in the cloud
- Experience in leading a development team
- Education: B.E.(B.Tech)/M.E/M.Tech (Bachelor/Master of Engineering)
Benefits
- We reward your contributions
- Support your wellbeing
- Inclusive benefits
- Flexibility programmes
- Mentorship
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringETLdata pipelinesPySparkPythonSQLperformance tuningdata warehouse conceptsDelta tablesdata security
Soft skills
problem-solvingcommunicationleadership
Certifications
B.E.B.TechM.E.M.Tech
