Senior Data Engineer
OLX Group
full-time
Posted on:
Location Type: Remote
Location: Portugal
Visit company websiteExplore more
Job Level
About the role
- Enable efficient consumption of domain data as a product by delivering and promoting strategically designed actionable datasets and data models
- Build, maintain, and improve rock-solid data pipelines using a broad range of technologies like AWS Redshift, Trino, Spark, Airflow, and Kafka streaming for real-time processing
- Build data pipelines in our Lakehouse using Medallion architecture
- Support teams without data engineers in building decentralised data solutions and product integrations, for example, around DynamoDB
- Act as a data ambassador, promoting the value of data and our data platform among engineering teams and enabling cooperation
- Cooperate with product teams to streamline source data so that data is cleaner earlier in the process.
- Follow and promote data mesh principles around decentralised data ownership and ‘data as a product’
- Enforce privacy and security standards (privacy by design)
- Increase data literacy of the engineering organisation by hosting training and mentoring other engineers (both less experienced data engineers and software engineers)
Requirements
- +5 years of experience building complex data pipelines, including extracting and processing data from external sources via API or real-time streaming tools
- Entrepreneurial spirit and ability to think creatively; highly driven and self-motivated
- Master of SQL language regardless of the underlying data technology. Writes efficient, easy-to-read, and crisp SQL code.
- Knowledge of real-time data processing frameworks, such as Apache Kafka, AWS Kinesis or Apache Flink
- Experience with Medallion architecture
- Knowledge of Lakehouse architectures and Apache Iceberg format.
- Experience with designing for scale and data growth in terms of storage and performance
- Business and product understanding (why over what) and the ability to deal with ambiguity
- Consistent track record of successful data projects delivered
- Potential to build rock-solid Python applications - writes understandable and maintainable code
- Experience with cloud data technologies (AWS, GCP, or Azure Cloud), such as Redshift, Athena, Spark
- Knowledge and curiosity about other big data technologies and tools
- Experience with analytics and defining metrics
- Experience with measuring data quality
- Excellent written and verbal proficiency in English
- You must be based in Portugal
Benefits
- Permanent contract
- Salary + annual bonus up to 15% of your annual gross salary
- Work with and impact all OLX services in Europe
- Train and conference budget and free access to Udemy courses
- Health insurance and life insurance
- MacBook Pro along with the necessary accessories to make your work comfortable
- 100% remote work (and the possibility to work from our offices in Lisbon)
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data pipelinesSQLreal-time data processingMedallion architectureLakehouse architectureApache KafkaAWS RedshiftApache FlinkPythondata quality measurement
Soft skills
entrepreneurial spiritcreativityself-motivationbusiness understandingdealing with ambiguitymentoringdata literacy promotioncommunicationcollaborationleadership