Senior Data Engineer
Nova
AirflowAWSAzureBigQueryCloudETLGoogle Cloud PlatformPySparkPythonRDBMSSQLTableau
Senior Associate – Azure Data Engineer
PwC
full-time
Posted on:
Location Type: Office
Location: Kolkata • 🇮🇳 India
Visit company websiteJob Level
Senior
Tech Stack
AzureETLPySparkPythonScalaSQLTableau
About the role
- Requirement gathering and analysis
- Design and implement data pipelines using Microsoft Fabric & Databricks
- Extract, transform, and load (ETL) data from various sources into Azure Data Lake Storage
- Work with databases like Synapse, SQL DB, Snowflake
- Implement data security and governance measures
- Monitor and optimize data pipelines for performance and efficiency
- Troubleshoot and resolve data engineering issues
- Provide optimized solutions for data engineering problems
- Work with a variety of sources: relational DBs, APIs, file systems, real-time streams, CDC
- Ensure alignment with overall system architecture and data flow
- Collaborate with teams and potentially lead development efforts
Requirements
- 5–8 years of experience in Data Engineering or related roles
- Hands-on experience in Microsoft Fabric
- Hands-on experience in Azure Databricks
- Proficiency in PySpark for data processing and scripting
- Strong command over Python & SQL – writing complex queries, performance tuning
- Experience working with Azure Data Lake Storage
- Experience with Data Warehouse concepts (dimensional modeling, star/snowflake schemas)
- Experience with databases like Synapse, SQL DB, Snowflake
- Experience designing and implementing data pipelines using Microsoft Fabric & Databricks
- Experience with ETL and Azure Data Factory (ADF)
- Hands on experience in performance tuning & optimization on Databricks & MS Fabric
- Understanding of CI/CD practices in a data engineering context
- Exposure to BI tools like Power BI, Tableau, or Looker
- Ability to work with various sources: relational DB, API, file systems, realtime streams, CDC
- Strong knowledge on Databricks, Delta tables
- Excellent problem-solving and communication skills
- Good to have: Azure DevOps, Scala or other distributed processing frameworks, data security and compliance, experience leading a development team
- Education: B.E.(B.Tech)/M.E/M.Tech (Bachelor/Master of Engineering)
Benefits
- Reward your contributions
- Support your wellbeing
- Inclusive benefits
- Flexibility programmes
- Mentorship that will help you thrive in work and life
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringMicrosoft FabricAzure DatabricksPySparkPythonSQLETLAzure Data Lake StorageData Warehouseperformance tuning
Soft skills
problem-solvingcommunicationcollaborationleadership
Certifications
B.E.B.TechM.E.M.Tech
Similar jobs on JobTailor
Senior Analyst – Brand Analytics
AstraZeneca
PySparkPythonSparkSQLTableau
Data Modeler, Business Analyst
Parkar Digital
AWSAzureBigQueryCassandraCloudETLNoSQLOraclePythonRDBMSSQL
Senior Data Engineer
Checkr, Inc.
AWSCloudETLKafkaMongoDBNoSQLPySparkPythonSpark
Data Science Associate Director
Amgen
AzureCloudPythonSQLTableau