Lead Data Engineer
American Red Cross
Amazon RedshiftAWSCloudEC2ETLPythonSQL
Senior Data Engineer
Truelogic Software
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
Amazon RedshiftAWSDynamoDBETLKafkaPandasPostgresPySparkPythonSQL
About the role
- Consolidate two AWS Aurora Postgres instances into a single managed Postgres setup with minimal downtime.
- Manage and improve existing data pipelines (Fivetran, Hevo, AWS DMS) to enhance reliability, reduce latency, and facilitate fault detection.
- Oversee the migration from DynamoDB to Postgres and Snowflake as part of a data platform simplification initiative.
- Implement monitoring and alerting for pipeline health, data quality, and schema consistency.
- Develop and maintain optimal ETL/ELT processes across multiple data sources.
- Support the design and refactoring of data models and schemas aligned with evolving business requirements.
- Ensure all data processes adhere to HIPAA and security compliance standards.
- Communicate plans, progress, and outcomes effectively with both technical and non-technical stakeholders.
- Collaborate with global teams across multiple time zones.
Requirements
- 5+ years of experience as a Data Engineer (9+ years for Staff level).
- Excellent communication skills in English and the ability to work autonomously with a high sense of ownership.
- Proven experience managing and optimizing data pipelines across relational and non-relational systems.
- Strong expertise with PostgreSQL, Snowflake, and DynamoDB.
- Hands-on experience with Fivetran, Hevo, or similar ELT/replication tools.
- Solid understanding of AWS services such as RDS/Aurora, DMS, and Lambda.
- Proficiency in Python (Pandas, PySpark) for data processing and automation.
- Strong SQL skills, including schema design, query optimization, and data validation.
- Experience building and maintaining data warehouses (Snowflake, Redshift, Hive).
- Knowledge of streaming systems such as Kafka, Kinesis, SQS, or SNS.
- Familiarity with data privacy and regulatory compliance, preferably in HIPAA or similar environments.
Benefits
- 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive. All it takes is a laptop and a reliable internet connection.
- Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.
- Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and recharge when needed.
- Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.
- Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PostgreSQLSnowflakeDynamoDBFivetranHevoAWS DMSPythonSQLETLELT
Soft skills
communicationautonomyownership
