Senior Big Data Engineer
IQVIA
full-time
Posted on:
Location Type: Remote
Location: India
Visit company websiteExplore more
Job Level
About the role
- Ability to oversee and guide junior and mid-level engineers, providing technical direction and mentoring to support their growth
- Delegating tasks effectively, ensuring clarity of expectations and alignment with delivery goals
- Ownership for the delivery of assigned workstreams, ensuring quality, timeliness, and accountability across the team
- Build pipelines for processing big amount of medical data
- Participate in analysis, system design, development, deployment and maintenance
- Conduct peer code reviews
- Contribute to the definition and adoption of technical standards
- Create comprehensive automated unit and integration tests
Requirements
- Bachelor’s Degree in Information Technology, Software Engineering, Computer Science, Mathematics, or another related field
- 6+ years of the following language: SQL, Python, Scala
- 6+ years of experience in data engineering
- Strong understanding of Databricks platform
- Experience with Big Data Batch processing and Azure Cloud Services
- Practical knowledge of Apache Spark ecosystem, including Delta and Parquet data formats
- Experience with complex ETL design and implementation
- Experience with data analysis, data profiling, data integration, data quality, data warehousing, data reporting
- Experience with CI/CD automation processes and tools such as Jenkins/GitLab
- Familiarity with AI-powered productivity tools such as Copilot or Cursor
- Experience working in an Agile environment
- Experience with database design and modelling
- Previous experience with healthcare or pharmaceutical data would be an advantage
- Knowledge of algorithms & design patterns and how to apply them effectively
- Experience with large data volume (TBs’) processing
Benefits
- Work in a company with offices in over 100 countries around the world
- Listed on the American stock exchange (NYSE)
- Multi-terabyte databases
- Quarterly work planning - goals and progress review every 90 days
- Technical training
- Possibility to participate in technical conferences within the country
- Favorable employment conditions and benefits
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
SQLPythonScaladata engineeringDatabricksBig Data Batch processingAzure Cloud ServicesApache SparkETL designdata warehousing
Soft skills
mentoringdelegationaccountabilitytechnical directioncommunicationteam collaborationproblem-solvingleadershiptask managementquality assurance
Certifications
Bachelor’s Degree in Information TechnologyBachelor’s Degree in Software EngineeringBachelor’s Degree in Computer ScienceBachelor’s Degree in Mathematics