Tech Stack
AirflowApacheAWSAzureCloudETLGoogle Cloud PlatformGrafanaJavaKafkaPandasPySparkPythonSparkSQLTableauTCP/IP
About the role
- Serve as a core contributor owning and maintaining critical parts of ClickHouse's Data engineering ecosystem.
- Own the full lifecycle of data framework integrations, from the core database driver to SDKs and connectors that make ClickHouse native in JVM-based applications.
- Craft tools that enable Data Engineers to harness ClickHouse's speed and scale for real-time analytics and large-scale data processing.
- Impact systems ingesting millions of events per second and observability platforms monitoring global infrastructure.
- Collaborate closely with the open-source community, internal teams, and enterprise users to ensure performance, reliability, and developer experience.
- Work at the intersection of high-performance database engineering and developer experience, delivering production-grade connectors and SDKs.
Requirements
- 6+ years of software development experience focusing on building and delivering high-quality, data-intensive solutions.
- Proven experience with the internals of at least one of the following technologies: Apache Spark, Apache Flink, Kafka Connect, or Apache Beam.
- Experience developing or extending connectors, sinks, or sources for at least one big data processing framework such as Apache Spark, Flink, Beam, or Kafka Connect.
- Strong understanding of database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases.
- Strong proficiency in Java and the JVM ecosystem, including deep knowledge of memory management, garbage collection tuning, and performance profiling.
- Solid experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns.
- Outstanding written and verbal communication skills to collaborate effectively within the team and across engineering functions.
- Understanding of JDBC, network protocols (TCP/IP, HTTP), and techniques for optimizing data throughput over the wire.
- Passion for open-source development.
- Bonus: Prior contributions to open-source projects.
- Bonus: Familiarity with ClickHouse or similar high-performance data platforms.
- Bonus: Working knowledge of Python, especially in data engineering contexts (e.g., Pandas, PySpark, Airflow).