Software Development Specialist
Experian
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇧🇷 Brazil
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
AWSKubernetesLinuxPySparkPythonShell ScriptingSpark
About the role
- Provide technical leadership for the development of data engineering solutions, serving as a reference point for the team
- Design and implement robust, scalable data pipelines in distributed environments
- Ensure best practices for architecture, security, version control, and data monitoring
- Collaborate with multidisciplinary teams (Data Quality, Data Governance, Software Engineering)
- Drive the evolution of the data platform by proposing continuous improvements and innovations
- Mentor junior data engineers and contribute to the team's technical growth
Requirements
- Advanced experience with Spark (preferably PySpark)
- Strong proficiency with AWS, including services such as S3, Glue, EMR, Lambda, IAM, among others
- Solid knowledge of EKS (Kubernetes on AWS) for orchestrating workloads
- Proficiency in Python with a focus on data engineering
- Familiarity with Linux environments, shell scripting, and automation
- Experience with version control tools (Git), CI/CD, and observability (monitoring/logs)
Benefits
- Diverse and inclusive culture
- Work-life balance
- Professional development
- Recognition and rewards
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
SparkPySparkAWSS3GlueEMRLambdaIAMPythonLinux
Soft skills
technical leadershipcollaborationmentoringcontinuous improvementinnovation