Senior Data Engineer
AND Digital
Amazon RedshiftAWSAzureCloudETLHadoopJavaScriptKafkaMariaDBMongoDBMySQLNode.js+7 more
Senior Software Engineer / Data Engineer
Twilio
full-time
Posted on:
Origin: • 🇺🇸 United States • California, Colorado, Hawaii, Illinois
Visit company websiteSalary
💰 $138,700 - $203,900 per year
Job Level
Senior
Tech Stack
Amazon RedshiftApacheAWSCloudDistributed SystemsDynamoDBETLJavaKafkaKubernetesLinuxMicroservicesMySQLNoSQLOpen SourcePostgresSDLCSparkSQLTerraform
About the role
- Design, build, and operate core platform services that help transition our platform to the next generation architecture.
- Build services and products that operate at a massive scale for Commerce Platform Billing Engine.
- Design, implement, and operate both new features on our current services as well as new services that will be built from scratch.
- Troubleshoot and fix operational issues and improve troubleshooting procedures and tools.
- Execute full software development life cycle (SDLC).
- Develop flowcharts and documentation to identify solutions.
- Write well-designed, testable code; document and maintain software functionality; troubleshoot, debug and upgrade existing systems.
- Own and lead multiple domains of the platform (microservices, REST APIs) from inception to deployment and maintenance.
- Collaborate with product teams; may travel occasionally for in-person meetings.
Requirements
- 5+ years of work experience building highly scalable products.
- 2+ years of experience with Data Engineering solutions development and strong mindset/orientation of Data Engineering skills like building data pipelines, Kafka, DBT, Redshift, Snowflake, Athena/Trino/Presto, or Spark.
- 1+ years of programming experience in Java/Springbot-Microservices writing clean code.
- 1 + years of experience contributing to design ( one e2e module design, implementation alongside non functional reliability and scaling) for a new/current system.
- Expert level knowledge in Object Oriented programming with a successful track record.
- Experience working with stakeholders at all levels - be able to dive into nuts-and-bolts of how things work as needed.
- Collaborating with internal/external teams/engineers and fostering an inclusive environment, where all points of view are welcomed and encouraged.
- Experience building scalable software including distributed systems infrastructure, business logic for APIs or tooling to help debug business critical applications.
- Excellent experience debugging production infrastructure and services.
- Experience with Linux and Kubernetes.
- Own and lead multiple domains of the platform (microservices, REST APIs) from inception to deployment and maintenance while making best in class technical decisions that impact the success of the company.
- Good knowledge of relational and NoSQL databases (Aurora/MySQL, Postgres,DynamoDB etc), SQL queries, query optimizations and ETL tools.
- experience in Cloud Solutions AWS, RDS, Kubernetes/EKS, CI/CD pipelines, Testing & Automation mindset is a big plus.
- Clear written and spoken communication skills.
- Self drive - you take complete ownership of your tasks and champion efforts to get your tasks to completion.
- Degree in Computer Science or a related field, or equivalent work experience.
Similar jobs on JobTailor
DataOps Engineer, Data Tools
Trustly
AirflowAmazon RedshiftAWSDockerEC2KafkaKubernetesPostgresPythonSparkSQLTerraform
Lead Engineer, Frontend
Casebook PBC
Amazon RedshiftApacheCloudElasticSearchGraphQLJavaKafkaMicroservicesPostgresReactRedisSpring+3 more
Senior Data Engineer
Grainger
ApacheAWSAzureCloudDistributed SystemsDockerETLGoogle Cloud PlatformKafkaKubernetesOpenShiftPostgres+5 more
Senior Data Engineer
eSimplicity
AirflowAmazon RedshiftApacheAWSCloudEC2ETLHadoopJavaJavaScriptMySQLPostgres+4 more