Smarkets

Data Engineer

• Developing and maintaining our Data ETL pipelines, some of which are real-time. The pipelines are fundamental to helping teams and stakeholders understand and drive business direction.
• Ensuring our data lake is kept in a healthy state, particularly our data warehouses: Redshift and Bigquery;
• Developing and maintaining Flask services and Postgres databases within the Data team to provide access to data or manage certain business entities relevant to Data.
• Assisting the different teams in the company with reporting, especially when it comes to automated reporting pipelines.
• Doing data exploration and training & deploying ML models used to perform different kinds of user segmentation, detect operational anomalies or estimate important business quantities. In particular maintain and improve our existing recommender service that provides users with suggestions on new sport competitions.