
Principal Data Engineer – Azure Cloud, PySpark, Databricks, Data Factory
Syneos Health
full-time
Posted on:
Location Type: Hybrid
Location: India
Visit company websiteExplore more
Job Level
About the role
- Provide technical leadership and guidance to teams and clients throughout the solution lifecycle
- Troubleshoot and resolve complex issues related to Cloud based Data Lake and Data Mesh environments
- Stay current with emerging technologies and trends and recommend best practices
- Design, develop, and implement scalable and secure cloud solutions for Big Data Platforms interfacing with API, file, SQL databases
- Architect and optimize data pipelines using distributed cloud computing to ensure that they support high volume / high velocity data streams and are scalable to meet growth expectations
- Develop guidelines and plans for performance tuning of a Big Data /NoSQL environment with underlying impact analysis of distributed jobs to enhance data processing, analytics, and machine learning capabilities
- Implement a mixed batch/near-real time architecture to analyze, index, and publish data for applications
- Develop and implement strategies for data governance, security, and compliance
- Create and maintain comprehensive documentation for solution designs, configurations, and best practices
- Provide training and support to clients and internal teams on solution architecture
- Engage with clients to understand their business needs and deliver tailored cloud solutions
- Conduct presentations, demos, and workshops to showcase Data Lake Capabilities
Requirements
- Bachelor’s degree in computer science, Engineering, or a related field; advanced degree preferred
- Strong experience with Azure Cloud, PySpark, Databricks and Data Factory
- SME in cloud engineering or solution architecture with a focus on Azure and related capabilities
- Demonstrated ability to engage both developers and business partners to achieve target outcomes
- Experience with DevOps and best practices for Coding in a distributed Cloud environment
- Command of Data Movement, Analysis, Modeling best practices
- Excellent written and verbal communications;
- Solid written and oral presentation skills
- Excellent problem-solving skills, strong communication abilities, and the ability to work collaboratively in a team environment
- Demonstrated ability to define business use cases and measure / communicate proposed project benefits
Benefits
- Career development and progression
- Supportive and engaged line management
- Technical and therapeutic area training
- Peer recognition
- Total rewards program
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
cloud solutionsBig Data platformsdata pipelinesperformance tuningdata governancedata securitydata compliancedata analysisdata modelingmachine learning
Soft skills
technical leadershipproblem-solvingcommunicationcollaborationpresentation skillsclient engagementtrainingguidancedocumentationbusiness analysis
Certifications
Bachelor’s degreeadvanced degree preferred