SAP Data Migration Consulting Manager
PwC
ETLMS SQL ServerSQL
Senior Data Engineer
Lower
full-time
Posted on:
Location Type: Hybrid
Location: Columbus • Ohio, Texas • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
AirflowAWSCloudDockerETLKafkaKubernetesPandasPythonSQLTableauTerraform
About the role
- Design, develop, and optimize high-performance ETL/ELT pipelines using Python, dbt, and Snowflake.
- Build and manage real-time ingestion pipelines leveraging AWS Lambda and CDC systems.
- Develop scalable serverless solutions with AWS, adopting event-driven architecture patterns.
- Manage containerized applications using Docker and infrastructure as code via GitHub Actions.
- Create sophisticated, multi-layered Snowflake data models optimized for scalability, flexibility, and performance.
- Integrate and manage APIs for Salesforce, Braze, and various financial systems, emphasizing robust error handling and reliability.
- Implement robust testing frameworks, data lineage tracking, monitoring, and alerting.
- Enhance and manage CI/CD pipelines, drive migration to modern orchestration tools (e.g., Dagster, Airflow), and manage multi-environment deployments.
Requirements
- 5+ years of data engineering experience, ideally with cloud-native architectures.
- Expert-level Python skills, particularly with pandas, SQLAlchemy, and asynchronous processing.
- Advanced SQL and Snowflake expertise, including stored procedures, external stages, performance tuning, and complex query optimization.
- Strong proficiency with dbt, including macro development, testing, and automated deployments.
- Production-grade Pipeline Experience specifically with Lambda, S3, API Gateway, and IAM.
- Proven experience with REST APIs, authentication patterns, and handling complex data integrations.
- Preferred Experience Background in financial services or fintech, particularly loan processing, customer onboarding, or compliance.
- Experience with real-time streaming platforms like Kafka or Kinesis.
- Familiarity with Infrastructure as Code tools (Terraform, CloudFormation).
- Knowledge of BI and data visualization tools (Tableau, Looker, Domo).
- Container orchestration experience (ECS, Kubernetes).
- Understanding of data lake architectures and Delta Lake.
Benefits
- Competitive salary and comprehensive benefits (healthcare, dental, vision, 401k match)
- Hybrid work environment (primarily remote, with two days a week in downtown Columbus Ohio)
- Professional growth opportunities and internal promotion pathways
- Collaborative, mission-driven culture recognized as a local and national 'best place to work'
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythondbtSnowflakeSQLAWS LambdaDockerCI/CDREST APIsKafkaTerraform
