Mindex

GCP Data Engineer – Snowflake, Airflow, Agent Development

Mindex

full-time

Posted on:

Location Type: Remote

Location: New YorkUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $90,000 - $140,000 per year

About the role

  • Develop an understanding of the data environment through profiling and analysis to enhance data quality.
  • Build Python-based solutions for data extraction, cleansing, transformation, and validation to support data migration.
  • Document data integration processes, ensure traceability and develop data monitoring solutions.
  • Collaborate with architects for solution integration ensuring alignment with company standards.
  • Manage data tools and platforms for proper software/infrastructure updates.
  • Work with the Data Management Organization to align with data quality improvement objectives.
  • Ensure solutions meet Service Level Agreements with capacity and performance considerations.

Requirements

  • Bachelor’s Degree in Computer Science or equivalent experience preferred.
  • 4 years of experience in software engineering with a strong focus on Python and data engineering.
  • Advanced proficiency in Python and **Agent Development **with strong problem-solving skills required.
  • 3 years of development experience and proficiency with Relational Databases, NoSQL, and/or Data Lakehouses (**Snowflake**, Microsoft Fabric, Databricks)
  • Intermediate proficiency in cloud technologies, including **Google Cloud Platform**, required.
  • Working knowledge of REST standards preferred.
  • Experienced in data quality, data integration, and data processing.
  • Proficiency with data movement solutions like Informatica IICS, Fivetran, and Airbyte.
  • Experience with data transformation solutions, such as dbt.
  • Experience with workflow orchestration tools such as **Airflow or Astronmer**, Dagster, and Prefect.
  • Familiarity with CI/CD and container technology is preferred. Understanding usage of AI technologies for development and proficiency in prompting
Benefits
  • Health insurance
  • Paid holidays
  • Flexible time off
  • 401k retirement savings plan and company match with pre-tax and ROTH options
  • Dental insurance
  • Vision insurance
  • Employer paid disability insurance
  • Life insurance and AD&D insurance
  • Employee assistance program
  • Flexible spending accounts
  • Health savings account with employer contributions
  • Accident, critical illness, hospital indemnity, and legal assistance
  • Adoption assistance
  • Domestic partner coverage
  • Tickets to local sporting events
  • Teambuilding events
  • Holiday and celebration parties
  • Leadership training
  • License to Udemy online training courses
  • Growth opportunities

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
Pythondata extractiondata cleansingdata transformationdata validationRelational DatabasesNoSQLData Lakehousesdata qualitydata integration
Soft skills
problem-solvingcollaborationdocumentation