Design , construct, and optimize scalable ETL / ELT pipelines for both batch and real-time data using DBT, Apache Spark and Apache Flink.
Develop and manage data schemas and warehouses within Snowflake , ensuring data is organized for efficient querying and analysis.
Collaborate with infrastructure teams to administer and optimize data storage solutions using Cassandra for high-velocity, wide-column data, and graph databases for complex relationship-based data.
Build and maintain data ingestion workflows for real-time applications using Apache Flink to process data from sources like Apache Kafka.
Tune complex Spark, Flink , SQL, and CQL queries to improve performance and reduce cost within Snowflake and other database systems.
Implement and enforce data quality standards, monitor pipelines, and establish data governance policies to ensure data integrity and security.
Collaborate with DevOps teams to manage and automate the deployment of data applications using CI/CD pipelines.
Work with data scientists, BI analysts, and other stakeholders to translate complex data requirements into scalable engineering solutions.
Requirements
Bachelor's degree in Computer Science, Engineering, or a related technical field.
6+ years of professional experience in data engineering or a similar role.
Strong proficiency in programming languages like Python, Scala, or Java.
Expert-level knowledge of Snowflake for data warehousing, including data modeling and query optimization.
Hands-on experience with Apache Spark for large-scale data processing.
Experience with Apache Flink for building real-time data streaming applications.
Strong experience with Cassandra for managing and optimizing distributed data storage.
Solid understanding and hands-on experience with graph databases and their query languages (e.g., Gremlin, Cypher).
Familiarity with a major cloud provider (e.g., AWS, Azure, GCP) and its data-related services.
Benefits
Health and wellness coverage: Medical, dental, and vision insurance
Disability coverage: Short-term and long-term disability
Life protection: Life insurance and Accidental Death & Dismemberment (AD&D)
Additional life coverage options: Supplemental life insurance for employees, spouses, and children
Flexible spending accounts for health care, and dependent care; limited purpose flexible spending account
Financial security: 401(k) Savings and Investment Plan with company matching
Time off benefits: Flexible vacation policy
Holidays: 8 paid holidays annually
Sick leave
Parental support: Paid parental leave
Employee Assistance Program (EAP) and Care Counselors
Voluntary benefits: Legal Assistance, Critical Illness, Accident, Hospital Indemnity and Pet Insurance options
Health Savings Account (HSA) with employer contribution
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.