Big Data Engineer – Lisbon, Porto
Minor Hotels Europe and Americas
full-time
Posted on:
Location Type: Hybrid
Location: Lisbon • Portugal
Visit company websiteExplore more
About the role
- Analyse functional specifications and translate them into technical requirements.
- Work with stakeholders to define user needs for new or enhanced data and software solutions.
- Identify and assess the most appropriate data sources in terms of functional scope, frequency, and quality.
- Design technical solutions and perform feasibility studies to validate approaches.
- Propose and validate solution designs with Product Management and business users.
- Develop secure, resilient and efficient software components following client standards.
- Build data acquisition, modelling, cleansing, aggregation and processing pipelines.
- Design optimised data models balancing complexity, performance and operational cost.
- Stay up to date with Big Data technologies (cloud platforms, distributed computing, open‑source frameworks).
- Master and apply key technical frameworks (e.g., Spark), functional programming languages (Scala) and other relevant languages.
- Execute unit, integration and performance tests to ensure alignment with quality standards.
- Participate in product validation phases and contribute to fine‑tuning before release.
- Debug and resolve technical issues in collaboration with Product Managers and Analysts.
- Maintain and update technical documentation for internal and external stakeholders.
- Optimise existing data systems for scalability, performance and reliability.
- Contribute to continuous improvement initiatives across engineering practices and tools.
- Collaborate with cybersecurity and Data Governance teams to ensure data protection and compliance.
Requirements
- Master’s degree in IT Engineering, Data Engineering, Data Science, or related field.
- +2 years of hands-on experience as a Big Data Engineer (such as Spark, Kafka, Cloud Native and Data-Lakes).
- Experience working on Big Data Architectures independently with deep understanding of big data technology, concepts, tools, features and functions of different approaches available.
- Comfortable Programming/scripting in Spark, Scala, Java, Python or Shell.
- Experience with Databricks and Hadoop HDFS.
- Knowledge of Elasticsearch and SQL‑based databases.
- Interest in Generative AI and cybersecurity.
- Practical experience with Cloud technologies (Azure, Google Cloud, AWS).
- Creativity, initiative and innovation mindset.
- Strong communication skills with the ability to explain technical topics to non-technical stakeholders.
- Ownership mindset, strong analytical and structured problem solving, ability to work in ambiguous environments and collaboratively in multicultural teams.
- Fluency in Portuguese and English.
- Nice-to-have: Databricks Professional Data Engineer; Understanding of statistics, mathematics, and machine learning is a strong asset.
Benefits
- At Capgemini Portugal we have a flexible and dynamic work environment.
- We have local programs that promote people growth, reskill and new skills development (Career Acceleration Programs).
- We promote an empowering environment with autonomy and peers' relationships among the top scores of our Monthly Employees' feedback.
- We also offer an attractive compensation package and benefits such as Health and Life insurance.
- Referral program with bonuses for talent recommendations and other fringe benefits according with our partnerships in force.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Big Data EngineeringSparkScalaJavaPythonShell scriptingDatabricksHadoop HDFSElasticsearchSQL
Soft Skills
strong communication skillsownership mindsetanalytical problem solvingcreativityinitiativeinnovation mindsetability to work in ambiguous environmentscollaborative teamworkexplain technical topics to non-technical stakeholdersmulticultural team collaboration
Certifications
Master’s degree in IT EngineeringMaster’s degree in Data EngineeringMaster’s degree in Data ScienceDatabricks Professional Data Engineer