Data Engineer
Software Mind
AirflowAmazon RedshiftApacheAWSAzureBigQueryCloudETLGoogle Cloud PlatformHadoopJavaKafka+5 more
Senior Data Engineer
Udacity Marketing
full-time
Posted on:
Location Type: Hybrid
Location: Noida • 🇮🇳 India
Visit company websiteJob Level
Senior
Tech Stack
AirflowAmazon RedshiftApacheAWSCloudPostgresPythonScalaSparkSQL
About the role
- Design and develop infrastructure and tools for the systems powering all of Udacity’s data, analytics and reporting
- Work with analysts to generalize the data points behind their work to form multi-dimensional data stores
- Building out the lakehouse for analytics, machine learning and AI use cases with strong focus on accuracy and reliability using technologies such as Spark, Airflow, dbt and Iceberg on AWS
- Work with stakeholders from other departments and successfully translating their requirements to engineering solutions
- Champion and thought leader of effective agile software development practice and producing high quality readable code
- Collaborate as part of a global Data Team of Software Engineers, Data Analysts and Data Scientists; operate on a cloud-native environment on AWS using Apache Spark, Airflow, Postgres and Redshift
Requirements
- BS or MS in Computer Science, MIS or related degrees
- 6+ years of experience working in the software industry, with at least 3 of which in data engineering
- Solid understanding and experience practicing Agile software development methodologies such as test driven development
- Good understanding in the principles of building robust data processing pipeline and track record of putting them in practice
- Proven ability to trace, identify and resolve issue in data, infrastructure and code
- Hands-on experience working with Apache Spark, cloud data storage and relational databases
- Hands-on experience working on cloud platforms, preferably AWS
- Proficiency in Python, Scala and SQL
- Experience working with generative AI is desired
- Experience working with US or Europe based remote teams is a strong plus
- Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States
Benefits
- At Udacity, we offer you the flexibility of working from home. We also have in-person collaboration spaces in Mountain View, Cairo, Dubai and Noida and continue to build opportunities for team members to connect in person
- Flexible working hours
- Paid time off
- Comprehensive medical insurance coverage for you and your dependents
- Employee wellness resources and initiatives (access to wellness platforms like Headspace)
- Quarterly wellness day off
- Personalized career development
- Unlimited access to Udacity Nanodegrees
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonScalaSQLApache SparkAirflowdbtIcebergdata processing pipelinecloud data storagerelational databases
Soft skills
collaborationcommunicationproblem-solvingstakeholder managementagile software developmentleadershiptranslating requirementsteamworkthought leadershipadaptability
Certifications
BS in Computer ScienceMS in Computer ScienceMIS degree
Similar jobs on JobTailor
Manager, Data and Analytics Engineer, AI and Data Analytics
Pfizer
AirflowAmazon RedshiftAWSAzureCloudETLHadoopJavaMicroservicesPostgresPythonScala+3 more
Data Engineer
ELEKS
AirflowAmazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonScalaSparkSQL
Staff Software Engineer, Data Engineering
Docker, Inc
AirflowAmazon RedshiftApacheAWSAzureCloudDockerGoogle Cloud PlatformKubernetesPythonSQL
Data Engineer
Oddball
AirflowAmazon RedshiftApacheAWSAzureBigQueryCloudETLGoogle Cloud PlatformInformaticaOraclePostgres+3 more