Vulnerability & Exposure Management Data Engineer
Schwarz Corporate Solutions
full-time
Posted on:
Location Type: Office
Location: Barcelona • 🇪🇸 Spain
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
AirflowAWSCloudMongoDBNeo4jPySparkPythonRedisSQL
About the role
- Design and develop a solution that processes millions of data entries daily for the new Vulnerability Management Platform
- Build and maintain scalable data pipelines (batch and real-time) to ingest high volumes of data into the data lake
- Perform data modeling to optimize datasets and ease data consumption for stakeholders
- Bring data analytics to production at scale, participating in architecture design
- Collaborate with Backend and Frontend teams to implement and improve the product
- Ensure data availability and integrity for business stakeholders
Requirements
- 5+ years of experience in Software Development and Big Data Frameworks
- Strong proficiency in Python (must have) and advanced knowledge in PySpark
- Experience building data processing pipelines (ELT) using tools such as Airflow, dbt, or Airbyte
- Proficiency with Cloud data warehousing solutions (preferably STACKIT or AWS)
- Experience with relational (SQL) and non-relational databases (MongoDB, Redis); Neo4j is a plus
- Experience working in Agile environments
- Strong English communication skills and ability to work in a collaborative, international environment
Benefits
- health insurance
- retirement plans
- professional development
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonPySparkdata processing pipelinesELTdata modelingdata analyticsSQLMongoDBRedisNeo4j
Soft skills
communicationcollaboration