Data Engineer
ATS Corporation
full-time
Posted on:
Location Type: Office
Location: Bangalore • India
Visit company websiteExplore more
Job Level
About the role
- Design, build, and maintain high-quality data pipelines on the Databricks platform
- Maintain high standards of data quality, integrity, and security
- Track, monitor and report on platform compute costs
- Tune and optimize Databricks jobs and Spark configurations
- Integrate Databricks with other cloud services
- Monitor the performance of data pipelines and troubleshoot issues
- Implement best practices for data governance and security
Requirements
- Experience: 1 - 5 years
- Proficiency in data engineering principles
- Advanced coding skills in Python, SQL, and Scala
- Hands-on experience with the Databricks platform
- Familiarity with the Azure Cloud platform
- Knowledge of the Gold Medallion architecture
- Experience in data ingestion, transformation, and loading processes (ETL/ELT)
- Knowledge of data governance and security best practices
Benefits
- Professional development opportunities
- Work-life balance
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonSQLScalaDatabricksAzure CloudETLELTdata engineering principlesdata ingestiondata transformation
Soft skills
data qualitydata integritydata securitytroubleshootingmonitoringreportingoptimizationbest practices