FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Cloud Data Engineer
Green Castle MediaData Engineer responsible for designing, building, and maintaining cloud data platforms for analytics at Greencastle Digital. Executing on batch and real-time data processing with AWS tools.
Tech Stack
Tools & technologiesAirflowAmazon RedshiftApacheAWSBigQueryCloudDockerKafkaKubernetesPythonSparkSQL
About the role
Key responsibilities & impact- Design, develop, and maintain scalable batch and real-time data pipelines.
- Build ELT workflows to extract, transform, and load large datasets from multiple internal and external sources.
- Develop and maintain cloud-based data infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.
- Implement orchestration and scheduling workflows using Apache Airflow or Amazon MWAA.
- Develop data transformations and modelling processes using SQL and dbt.
- Integrate streaming and large-scale processing solutions using technologies such as Apache Kafka and Apache Spark.
- Ensure the reliability, performance, and scalability of production data pipelines and infrastructure.
- Participate in a scheduled on-call rotation to monitor, troubleshoot, and resolve high-priority data pipeline issues, ensuring the reliability of the data platform during weekends and bank holidays.
- Support the integration of data into enterprise data warehouses such as Snowflake or Redshift.
Requirements
What you’ll need- Minimum of 3 years’ professional experience in data engineering or a related technical role.
- Hands-on experience working with cloud data platforms, particularly Amazon Web Services.
- Strong experience working with large-scale production databases and SQL-based data warehouses such as Amazon Redshift, Snowflake, or Google BigQuery.
- Proven experience developing ELT pipelines using dbt, Apache Airflow, and Python.
- Familiarity with big data and streaming technologies such as Apache NiFi, Apache Kafka, and Apache Spark.
- Experience with containerization and orchestration technologies including Docker and Kubernetes.
Benefits
Comp & perks- Health insurance
- Flexible work arrangements
- Professional development opportunities
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data engineeringELT workflowsSQLdbtApache AirflowApache KafkaApache SparkAmazon RedshiftSnowflakePython