FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.

Senior Data Engineer – Veterinary Technology
Truelogic SoftwareSenior Data Engineer responsible for data platform reliability and analytics for veterinary technology. Building data pipelines and managing infrastructure while ensuring data quality and performance optimization.
Tech Stack
Tools & technologiesAirflowAmazon RedshiftApacheAWSElixirErlangETLKafkaKubernetesPostgresPythonSQLTerraform
About the role
Key responsibilities & impact- Take end-to-end ownership of the data platform's reliability, encompassing pipelines, warehousing, transformations, and observability.
- Design, build, and maintain robust data pipelines using Apache Airflow, orchestrating complex workflows across batch and near-real-time workloads.
- Manage and optimize the primary Snowflake data warehouse, handling schema design, clustering keys, materialized views, access controls, and strict cost governance.
- Build and maintain the dbt transformation layer, including model design, incremental strategies, dependency management, and documentation.
- Deploy and operate data platform services on Kubernetes (EKS), independently managing workloads, debugging pod issues, and tuning resource requests.
- Provision and manage data platform infrastructure, including Snowflake resources and Airflow, utilizing Terraform.
- Write high-quality SQL and Python for ETL tooling, pipeline logic, and data product delivery.
- Manage PostgreSQL as a source-of-truth operational database, focusing on query optimization, indexing, replication, and migrations.
- Lead the transition toward change data capture (CDC) for data ingestion, utilizing tools like Debezium to stream database changes.
- Implement comprehensive observability, SLA tracking, and alerting across the data platform using Datadog.
- Maintain CI/CD pipelines for DAG deployments, dbt runs, schema migrations, and container image builds.
- Collaborate with analytics, product, and full-stack development teams to model clean, well-documented data products.
- Navigate AWS environments (including RDS and S3) to manage data-adjacent services, read logs, and adjust scaling parameters.
Requirements
What you’ll need- 5+ years of experience in data engineering or a combined data and infrastructure role, with a proven track record of building production-grade data platforms from the ground up.
- Deep expertise in Snowflake, including schema design, performance tuning, access control, and advanced cost optimization.
- Strong, hands-on experience with dbt (modeling patterns, incremental strategies, testing) and Airflow (writing DAGs, managing dependencies, debugging).
- Advanced proficiency in SQL and solid programming skills in Python for ETL and automation.
- Working knowledge of Kubernetes, with the ability to deploy workloads, read pod logs, and manage Helm charts independently.
- Extensive experience using Terraform for infrastructure provisioning, specifically for managing data platform components.
- Hands-on experience with Datadog for observability, monitoring, and SLA visibility.
- Familiarity with AWS data-adjacent services like RDS and S3.
- Fluency in utilizing AI-based development assistants to write, review, and debug code efficiently.
- Prior experience with Amazon Redshift is a plus.
- Familiarity with streaming infrastructure (Kafka, Flink) or open table formats (Iceberg, Delta Lake) is highly preferred.
- Experience with Elixir or Erlang is advantageous.
- Knowledge of data quality, cataloging, or lineage tooling (e.g., Great Expectations, Soda, Monte Carlo, DataHub, OpenMetadata) is a strong plus.
- Hands-on experience with Debezium or comparable CDC tooling, particularly in production deployments, is a strong bonus.
- Experience managing EKS Spot instances at scale is a plus.
- Background in healthcare, veterinary medicine, or similarly regulated domains requiring strict data accuracy and auditability is preferred.
Benefits
Comp & perks- 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive.
- Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.
- Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and recharge when needed.
- Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.
- Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
SQLPythonData Pipeline DevelopmentETL ToolingSchema DesignPerformance TuningChange Data CaptureData Quality ToolingStreaming InfrastructureObservability Implementation