Tech Stack
AirflowAmazon RedshiftAWSCloudDynamoDBEC2JavaScriptNoSQLPythonSQLTypeScriptVue.js
About the role
- PlatformQ seeks a Senior Data Engineer to lead design, development, and optimization of applications and infrastructure.
- Own and evolve architecture to ensure security, reliability, scalability, and performance of the platform.
- Collaborate with cross-functional teams to deliver data solutions that power decision-making and innovation.
- Architect, build, and maintain robust, scalable, and secure data pipelines and applications.
- Design and optimize data warehouse and lakehouse models for efficient querying and analysis.
- Proactively monitor, troubleshoot, and optimize pipelines to deliver trusted, consistent data.
- Evaluate and implement data storage solutions (SQL data warehouses, in-memory stores, NoSQL databases).
- Architect and optimize APIs and services to support data reporting and analytics applications.
- Automate infrastructure and resource management using IaC.
- Implement best practices, set engineering standards, and lead technical design reviews.
- Mentor junior engineers and contribute to a culture of technical excellence.
- Collaborate with engineering and cross-functional stakeholders to translate business requirements into scalable solutions.
- Partner with product, engineering leadership, and business stakeholders to ensure the data strategy supports organizational goals.
- Drive Agile development practices and contribute to project planning and prioritization.
Requirements
- Bachelor’s or Master's degree in Computer Science, Engineering, or related field.
- 5+ years of experience in data engineering with increasing levels of responsibility.
- Proficiency in Python and SQL with large-scale data systems.
- Expertise in AWS cloud services (API Gateway, CloudWatch, DynamoDB, EC2, ECS, IAM, Lambda, Redshift, S3, etc).
- Strong knowledge of data modeling, relational and non-relational databases.
- Hands-on experience with orchestration tools (e.g., Airflow, AWS Step Functions).
- Experience with Infrastructure as Code for building and deploying cloud resources.
- Experience developing secure APIs and web applications using JavaScript/TypeScript.
- Strong analytical, problem-solving, and communication skills.