Softgic

Data Engineer, Python, AWS, Data Pipelines

Softgic

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇺🇸 United States

Visit company website
AI Apply
Apply

Salary

💰 $2,800 per month

Job Level

Mid-LevelSenior

Tech Stack

AirflowAmazon RedshiftAWSEC2ETLMongoDBPostgresPython

About the role

  • Design and maintain scalable ETL/ELT pipelines in Python, integrating structured and semi-structured data (JSON, CSV, XML) across Snowflake, MongoDB, Postgres, and AWS services (S3, Glue, Lambda, EC2, EMR, Redshift, RDS).
  • Build and optimize transformation and orchestration workflows using DBT, Airflow, Prefect, or Dagster.
  • Implement data governance, quality checks, and security best practices throughout data pipelines.
  • Extend and optimize the Elastic Hierarchy framework to harmonize financial data from various systems.
  • Collaborate with analysts, ML engineers, and product teams to deliver business-ready datasets and data solutions.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • Strong Python programming skills with experience in data processing and automation.
  • Proven experience with the AWS data ecosystem, including S3, Glue, Lambda, EMR, EC2, Redshift, and RDS.
  • Hands-on experience with Snowflake, MongoDB, and Postgres databases.
  • Proficiency with DBT or similar data transformation tools, and with orchestration frameworks such as Airflow, Prefect, or Dagster.
  • Knowledge of data mapping, attribution, or reconciliation (experience in financial services is a strong plus).
  • Understanding of hybrid/on-premise deployment models within enterprise environments.
  • Excellent English communication skills and ability to collaborate effectively within distributed teams.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PythonETLELTDBTAirflowPrefectDagsterdata processingdata automationdata governance
Soft skills
communicationcollaboration
Certifications
Bachelor’s degreeMaster’s degree
Rackner

Kubernetes Engineer – DoD Secret Eligible, Weekend Operations

Rackner
Mid · Seniorfull-time🇺🇸 United States
Posted: 2 hours agoSource: boards.greenhouse.io
AnsibleAWSAzureCloudGoogle Cloud PlatformKubernetesLinuxTerraform
Fanatics

Software Engineer III – Distributed, Kafka, Kotlin

Fanatics
Senior · Leadfull-time$120k–$215k / yearNew York · 🇺🇸 United States
Posted: 4 hours agoSource: fa-exki-saasfaprod1.fa.ocs.oraclecloud.com
JavaKafkaKotlinMicroservicesPostgresRedisSpringSpring BootSpringBoot
Dropbox

Senior Backend Product Software Engineer, Storage Management

Dropbox
Seniorfull-time$196k–$265k / year🇺🇸 United States
Posted: 13 hours agoSource: boards.greenhouse.io
CGWS - COME GROW WITH US

Software Engineer 2, Backend

CGWS - COME GROW WITH US
Mid · Seniorfull-timeArizona, Florida, Idaho, New York, North Carolina, Oklahoma, Oregon, South Carolina, Tennessee, Texas, Utah, Virginia · 🇺🇸 United States
Posted: 14 hours agoSource: boards.greenhouse.io
JavaMySQLPHPPythonSQL
Sunday

Staff Engineer, Backend

Sunday
Leadfull-time🇺🇸 United States
Posted: 15 hours agoSource: getsunday.applytojob.com
DjangoDockerFlaskKubernetesPython