FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Data Engineer
Infinite Lambda. Lead the design, development, and optimization of data pipelines using Databricks (including Delta Live Tables / Lakeflow) on Azure.
Tech Stack
Tools & technologiesAirflowAmazon RedshiftAWSAzureCassandraCloudDockerDynamoDBGoGoogle Cloud PlatformGreenplumHadoopJavaKafkaKubernetesLinuxMacOSMongoDBMySQLNoSQLOraclePostgresPythonScalaSpark
About the role
Key responsibilities & impact- Lead the design, development, and optimization of data pipelines using Databricks (including Delta Live Tables / Lakeflow) on Azure.
- Migrate and refactor legacy stored procedures and sprawling MSSQL processes into modern, governed Databricks solutions.
- Contribute to data platform modernization initiatives, including medallion architecture, data quality, and governance practices.
- Collaborate with the client’s team and our Analytics Engineers to deliver high-quality, production-ready data assets.
- Work in a client-facing consulting environment: gather requirements, provide recommendations, and professionally push back when needed to ensure the best technical outcomes.
- Apply broad data engineering skills (pipelining, orchestration, cloud infrastructure) while deepening your expertise in the modern data stack.
Requirements
What you’ll need- 5+ years of experience
- Programming Languages: Python, Java, Scala or Golang
- Cloud Providers: AWS, GCP, Azure (Azure is preferred)
- Data Warehousing: Snowflake, Databricks, Redshift, Greenplum, Oracle, DB2 or similar (Must have experience with Snowflake or Databricks)
- Data Pipelining Tools: Snowplow, Fivetran, dbt, Talend
- Relational Databases: Oracle, PostgreSQL, MySQL, Microsoft or similar
- NoSQL Databases: MongoDB (Atlas), Cassandra, DynamoDB or similar
- Streaming Technologies: Kinesis, Kafka or Google PubSub or similar
- Containers & Container Orchestration: Docker & Kubernetes
- Workflow Orchestration: Airflow, Cadence Workflow
- OS: Linux, MacOS
- Version Control: Git
- Big Data stack: Spark, EMR, Hadoop, Hive, Presto
- Fluent in English
- Excellent client-facing interaction skills
- Comfortable working in a distributed team
- Agile environment adaptability
- Self-starter and pride in work
Benefits
Comp & perks- We support your growth with dedicated learning time, access to top-notch resources and a knowledge-sharing culture;
- You work autonomously here in a wholesome environment and get as much paid holiday as you need;
- The projects are diverse and give you plenty of opportunity to experiment with new tech;
- The benefits are plenty, with private health insurance, work-from-home budget, a company MacBook and more on the list.
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonJavaScalaGolangDatabricksSnowflakeAirflowDockerKubernetesSpark
Soft Skills
client-facing interactioncollaborationrequirements gatheringrecommendation skillsprofessional push backadaptabilityself-starterpride in workcomfortable in distributed teamscommunication