Scrunch

Senior Software Engineer, Data & AI Engineering

Scrunch

full-time

Posted on:

Location Type: Remote

Location: Brazil

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

BigQueryCloudGoogle Cloud PlatformPandasPostgresReactSparkSQL

About the role

  • Play a huge part in successfully delivering our roadmap and ultimately in giving our customers the tools they need to succeed in the AI era.
  • Focused on building features related to our data pipelines, usage of LLMs, analytics APIs, etc.
  • Deliver value to our customers, which can include some light React work but also work creating notifications, alert emails, scheduled reports, connectors into third party systems, etc.

Requirements

  • Have extensive experience building & using web APIs, including handling authentication, authorization, caching, rate limiting, etc.
  • Experience building API for external customers is a big plus.
  • Experience with relational (transactional) databases, particularly PostgreSQL.
  • Experience with analytics tools and technologies, such as:
  • Analytical SQL, maybe with a modern analytical data platform like Snowflake, Google BigQuery, DuckDB, Spark SQL, etc.
  • Experience with analytics packages like Pandas or Polars is a plus.
  • Experience with streaming analytics is a plus.
  • Experience writing batch and streaming/interactive data processing pipelines. This could mean any of:
  • Big data tools like Flink, Beam (GCP Dataflow), Spark, etc.
  • Job queues and task processing frameworks (Celery, Resque, or cloud-based options like Google Cloud Tasks)
  • Multi-step durable execution frameworks like Temporal or Inngest
  • The ability to quickly understand source data and validate output data quality
  • Experience using LLMs and/or traditional ML techniques to build classifiers, data extractors, summarizers, etc.
  • Not required but a big plus: experience building evals for LLM-based tools to assess and improve accuracy at these kinds of tasks.
Benefits
  • Scrunch is an equal opportunity employer. We welcome people of all backgrounds, experiences, perspectives, and identities. We do not discriminate.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
web APIsauthenticationauthorizationcachingrate limitingPostgreSQLAnalytical SQLSnowflakeGoogle BigQueryPandas