InfraCloud Technologies

Software Engineer

• Contribute fixes and enhancements to the Apache Spark open-source project.
• Upgrade and maintain compatibility with newer Spark releases.
• Optimize Spark internals for performance, scalability, and reliability.
• Design and develop distributed data processing solutions.
• Debug complex Spark-related performance and stability issues.
• Collaborate with product and platform teams on architecture and technical initiatives.

Spark Developer

QA Engineer

• Perform manual and automated testing of Spark jobs, Spark SQL queries, and ETL pipelines.
• Execute functional, scalability, and performance testing for Spark workloads.
• Set up and manage Spark clusters on Standalone, YARN, Kubernetes, Mesos, Databricks, EMR, and Dataproc.
• Conduct benchmarking, validation, and performance analysis of Spark applications.
• Identify bottlenecks and troubleshoot distributed system issues.
• Lead QA initiatives and mentor team members.

Senior Spark QA Engineer

Engineering Manager

• Lead end-to-end project delivery from planning to execution
• Communicate effectively with clients, stakeholders, and internal teams
• Drive technical discussions around system architecture, scalability, and delivery
• Balance client expectations, project priorities, and team bandwidth effectively
• Mentor and guide team members while ensuring healthy work-life balance
• Continuously learn and stay updated with evolving technologies and industry practices
• Track milestones, risks, dependencies, and project schedules proactively
• Create and maintain regular project status reports and delivery metrics
• Establish efficient technical and operational processes for teams
• Provide accurate effort estimations and prioritize tasks across modules and teams
• Build strong feedback loops with internal and external stakeholders
• Drive key initiatives with organization-wide impact across teams and functions
• Improve reporting, operational efficiency, and delivery management practices.