FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAirflowAmazon RedshiftAWSAzureCassandraCloudEC2Google Cloud PlatformHadoopJavaKafkaNoSQLPostgresPythonScalaSparkSQL
About the role
Key responsibilities & impact- Responsible for expanding and optimizing our data and data pipeline architecture.
- Optimizing data flow and collection for cross functional teams.
- Support our product owners, product analysts, data analysts and data scientists on data initiatives.
- Ensure optimal data delivery architecture is consistent throughout ongoing work.
- Engage with business stakeholders to establish clear needs and links to solutions, including setting up prototypes, and involving multiple parties in design sessions.
- Create data collection, extraction, and transformation frameworks for structured and unstructured data.
- Develop and maintain data infrastructure systems (e.g. data warehouses) including data access points.
- Prepare and manipulate data using a variety of data integration and data pipeline tools including, but not limited to, Talend, SQL, Snowflake, Kafka, Azure Data Factory.
- Create efficient load processes including logging and handling of exceptions, notification to support, and overall visibility operations.
- Organize data into formats and structures that optimize reuse and efficient delivery to businesses and analytics teams and system applications.
- Integrate data across data lake, data warehouse and systems applications to ensure the consistent delivery of information across the enterprise.
- Accountable for efficient architecture and systems design.
- Build and evolve the data service layer and engages the team to bring together components for a best-in-class customer offering.
Requirements
What you’ll need- Bachelor’s degree required, Master’s an asset, in Software Engineering, Computer Science, or equivalent work experience in a Technology or business environment.
- Minimum of 7 years of experience working in developing and following structured work processes in data engineering.
- Minimum of 7 years of experience in integration solutions development with data integration tools (e.g., Talend, Azure Data Factory).
- Minimum of 3 years of experience with real-time data streaming tools like Kafka, or any similar tools.
- Experience with cloud platforms including Azure, AWS, or GCP.
- Experience with data warehousing platforms such as Snowflake or Databricks.
- High proficiency in SQL, Python, and other programming languages.
- Highly proficient in data management, governance, data design and database architecture.
- Proven track record of manipulating, processing, and extracting value from large, disconnected datasets.
- Proficient in data modelling and data architecture with experience using WhereScape RED/3D an asset.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
- Highly proficient in data modelling, data integrations, data orchestration, and supporting methodologies.
- Highly proficient in leading large-scale projects or significant project steps and communicating progress/approach with technical/non-technical peers/clients and leaders.
- Highly proficient in multiple programming languages and coding.
- Excellent ability to design and engineer moderately complex enterprise solutions.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Strong project management and organizational skills.
Benefits
Comp & perks- Work from anywhere with true flexibility and freedom.
- Earn in USD with compensation that matches your expertise.
- Recharge confidently with dedicated paid time off.
- Advance your career with fully covered international certifications.
- Access coworking spaces worldwide whenever you want a professional setup.
- Strengthen your English and expand your global reach.
- Connect and have fun with activities that unite our international team.
- Feel appreciated with personalized gifts and a thoughtful welcome kit.
- Grow our community and earn through our referral program.
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data pipeline architecturedata integrationdata warehousingSQLPythonKafkaAzure Data FactorySnowflakedata modelingbig data tools
Soft Skills
project managementorganizational skillscommunicationcollaborationproblem-solvingstakeholder engagementleadershipdesign thinkingdata governancedata orchestration
Certifications
Bachelor's degreeMaster's degree