Sr Manager, Platform Software Engineering
LegitScript
AirflowApacheAWSCloudETLKafkaSeleniumSpark
Data Engineering Manager, Apache NiFi, Python, PySpark, Hadoop, Cloudera, Airflow
TASC
full-time
Posted on:
Location Type: Office
Location: Pune • 🇮🇳 India
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
AirflowApacheAWSAzureCloudHadoopJ2EEJavaJenkinsMicroservicesOraclePySparkPythonScalaSDLCSparkSpringSQL
About the role
- Manage multiple scrum teams of software developers and testers to deliver quality software
- Lead definition, development and delivery of major cross-department initiatives
- Provide technical leadership and enforce software development standards in the Big Data space
- Collaborate with product and architecture teams on product definition and technical design
- Ensure projects are staffed, trained and managed within manpower and budget guidelines
- Drive deliveries for implementing, documenting, testing, maintaining and supporting applications
- Develop high quality, secure, scalable solutions and scalable data pipelines using Spark, Scala/Python/Java on Hadoop or object storage like MinIO
- Work across on-premises and cloud environments (AWS, Azure, Databricks)
- Use and guide teams on databases (Oracle, Netezza) and strong SQL practices
- Implement and guide use of SDLC tools: Git, CI/CD (Jenkins), Checkmarx, test automation
- Participate in Agile/Scrum activities including creating user stories and sprint planning
- Support internal and external users, perform production incident management and on-call escalation
- Document application components and create support and training materials for Mastercard QA processes
Requirements
- Experience managing multiple scrum teams of software developers and testers
- Technical leadership in Big Data technologies and engineering principles
- Hands-on experience with Apache NiFi, Python, PySpark, Spark, Scala, Java
- Experience with Hadoop and Cloudera platforms
- Experience with Airflow
- Experience working across on-premises and cloud environments (AWS, Azure, Databricks)
- Experience designing and developing scalable data pipelines and data-driven applications
- Strong SQL skills and experience with Oracle and Netezza
- Familiarity with object storage like MinIO
- Experience with Git, CI/CD pipelines (Jenkins), security scanning (Checkmarx), and test automation
- Proficient in Agile/Scrum practices, including creating user stories and sprint ceremonies
- Experience with J2EE, JDBC, Spring/Spring framework, and microservices (good to have)
- Ability to integrate content via APIs, JSON, XML, and RSS
- Experience with production incident management and on-call support rotations
- Strong communication, leadership, coaching, performance management, and decision-making skills
- Detail-oriented, proactive, able to work under pressure and manage staffing and budgets
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
Big DataSparkScalaPythonJavaHadoopSQLApache NiFiAirflowmicroservices
Soft skills
leadershipcommunicationcoachingperformance managementdecision-makingdetail-orientedproactiveability to work under pressurestaffing managementbudget management
Similar jobs on JobTailor
Software Engineer II, Furnishing Platform
Affirm
AirflowApacheAWSAzureCloudETLGoogle Cloud PlatformJavaKotlinPythonSparkSQL
Director, Data Engineering
Vimeo
AirflowApacheCloudKafkaSparkSQLTerraformUnity
Data Engineer
InfraCloud Technologies
AirflowApacheAWSAzureCloudETLGoogle Cloud PlatformIoTKafkaMongoDBPySparkPython+3 more
Senior Staff Data Engineer
SecurityScorecard
AirflowApacheAWSCyber SecurityDockerJavaJenkinsKafkaPostgresPythonRedisScala+3 more