Senior PySpark Developer
UltraCon Consultoria
full-time
Posted on:
Location Type: Office
Location: São Paulo • Brazil
Visit company websiteExplore more
Job Level
About the role
- Develop and maintain data pipelines using PySpark
- Perform transformations on large volumes of data in distributed environments
- Integrate data flows with Object Storage solutions
- Work with Oracle databases for ingestion, querying, and data persistence
- Ensure quality, consistency, and integrity of processed data
- Optimize Spark job performance and processing routines
- Collaborate with data, architecture, and business teams to understand requirements
- Document processes, data flows, and technical decisions
Requirements
- Strong experience with Python applied to data engineering
- Advanced experience with Apache Spark and PySpark
- Experience in large-scale data transformation and processing projects
- Experience with Object Storage (reading, writing, and organizing data)
- Knowledge of Oracle Database (queries, basic modeling, integration)
- Experience building end-to-end data pipelines
Benefits
- Availability to work on weekends, occasionally for go-lives
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonPySparkApache Sparkdata transformationdata processingObject StorageOracle Databasedata pipelinesdata ingestiondata querying
Soft Skills
collaborationdocumentationproblem-solvingcommunication