Spearhead the migration of existing workloads to the Iceberg format, establishing and maturing the foundational lakehouse architecture.
Architect and construct robust batch and streaming data pipelines utilizing Spark and Flink technologies.
Collaborate closely with the Backend Engineering team on API integrations and the establishment of formal data contracts.
Contribute to the development of a unified lineage and governance framework utilizing DataHub.
Provide comprehensive support to the Core Team in the successful adoption of new data platform capabilities.

Requirements

Demonstrated proficiency with Python and PySpark.
Hands-on experience with data lake formats (e.g., Iceberg, Delta Lake, or Hudi).
Solid understanding of Kafka and event-driven architectures.
Experience in building and orchestrating data pipelines at scale.
Strong SQL proficiency and comprehensive data modeling knowledge.
Familiarity with workflow orchestration tools (e.g., Airflow, Dagster, or similar).
Platform-oriented mindset: developing solutions for broad organizational use, not solely individual purposes.
Ownership mentality: committed to seeing problems through to resolution.
Clear communication skills: ability to articulate complex technical concepts to non-technical stakeholders.
Highly collaborative: excels in working alongside backend engineers, data engineers, and analysts.
Pragmatic approach: adept at balancing ideal solutions with practical delivery timelines.
Bonus: Demonstrated expertise with Flink or comparable streaming frameworks.
Bonus: Proficiency in DBT and familiarity with the modern data stack.
Bonus: Experience with modern data platforms such as BigQuery, Trino, Snowflake, or Databricks.
Bonus: Proven background in developing self-service data platforms.

Benefits

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

PythonPySparkSparkFlinkSQLData modelingKafkaAirflowDBTData lake formats

Clear communicationHighly collaborativeOwnership mentalityPragmatic approach