
GCP Data Engineer – Snowflake, Airflow, Agent Development
Mindex
full-time
Posted on:
Location Type: Remote
Location: New York • United States
Visit company websiteExplore more
Salary
💰 $90,000 - $140,000 per year
About the role
- Develop an understanding of the data environment through profiling and analysis to enhance data quality.
- Build Python-based solutions for data extraction, cleansing, transformation, and validation to support data migration.
- Document data integration processes, ensure traceability and develop data monitoring solutions.
- Collaborate with architects for solution integration ensuring alignment with company standards.
- Manage data tools and platforms for proper software/infrastructure updates.
- Work with the Data Management Organization to align with data quality improvement objectives.
- Ensure solutions meet Service Level Agreements with capacity and performance considerations.
Requirements
- Bachelor’s Degree in Computer Science or equivalent experience preferred.
- 4 years of experience in software engineering with a strong focus on Python and data engineering.
- Advanced proficiency in Python and **Agent Development **with strong problem-solving skills required.
- 3 years of development experience and proficiency with Relational Databases, NoSQL, and/or Data Lakehouses (**Snowflake**, Microsoft Fabric, Databricks)
- Intermediate proficiency in cloud technologies, including **Google Cloud Platform**, required.
- Working knowledge of REST standards preferred.
- Experienced in data quality, data integration, and data processing.
- Proficiency with data movement solutions like Informatica IICS, Fivetran, and Airbyte.
- Experience with data transformation solutions, such as dbt.
- Experience with workflow orchestration tools such as **Airflow or Astronmer**, Dagster, and Prefect.
- Familiarity with CI/CD and container technology is preferred. Understanding usage of AI technologies for development and proficiency in prompting
Benefits
- Health insurance
- Paid holidays
- Flexible time off
- 401k retirement savings plan and company match with pre-tax and ROTH options
- Dental insurance
- Vision insurance
- Employer paid disability insurance
- Life insurance and AD&D insurance
- Employee assistance program
- Flexible spending accounts
- Health savings account with employer contributions
- Accident, critical illness, hospital indemnity, and legal assistance
- Adoption assistance
- Domestic partner coverage
- Tickets to local sporting events
- Teambuilding events
- Holiday and celebration parties
- Leadership training
- License to Udemy online training courses
- Growth opportunities
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
Pythondata extractiondata cleansingdata transformationdata validationRelational DatabasesNoSQLData Lakehousesdata qualitydata integration
Soft skills
problem-solvingcollaborationdocumentation