Staff Platform Engineer
Inspiren
AWSCloudIoTJenkinsLinuxTerraform
Senior Data Platform Engineer
Dataiku
full-time
Posted on:
Location Type: Remote
Location: Remote • New York • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
AzureCloudJenkinsPythonSDLCSQL
About the role
- Be an expert level engineer within the Dataiku Platform including Platform Automation, GenAI Capabilities, Plugin Development, maintenance & troubleshooting
- Be an expert level engineer within Snowflake for data engineering and security/governance features
- Build & maintain GenAI Platform solutions focused on security and governance for engineering delivery
- Build & maintain Python & SQL based platform automation process
- Build & maintain DataOps process for SDLC delivery
- Build & maintain data quality metrics & observability to help drive data quality standards
- Build & maintain administration systems and applications for monitoring, alerting, data observability, access management, platform metrics, and end user transparency
- Assist Data Engineering with building python & SQL data replication & data pipelines on large & often complex data sets
- Design data models for both short term and long term use cases to support data warehouse scalability
- Identify opportunities for improvements & optimization for greater scalability & delivery velocity
- Collaborate with engineers within GenAI Engineering & Analytics Engineering to build scalable solutions within the Data Platform
- Perform root cause analysis on often complex errors to help ensure data pipeline availability
- Help drive technical & architectural decisions on the data platform including decisions on data architecture, data engineering processes, data quality frameworks, data access security & governance frameworks, DataOps processes & data consumption models.
- Help test new features in Dataiku and partner tools to both provide feedback internally and determine value towards internal analytics & data platform integration
- Work closely with key stakeholders across the organization including Infra, embedded analytics teams, Product and Engineering to help foster both technical implementations & requirements gathering
- Promote the Data Platform internally, help train & mentor others within the organization with technical excellence, & provide support on data & platform related inquiries
- Proactively drive innovation internally with dedicated innovation time & projects that aim to be transformational for either the platform, team or company as a whole.
- Actively contribute to the expertise level and competencies of the EDA Team and participate in the creation and support of data development standards and best practices.
Requirements
- Experience & a strong understanding of GenAI development, security & governance concepts a must
- 5+ years of relevant experience in Data Engineering / Data Platform Engineering /Data Architecture
- Expert level SQL & Python is a must.
- Experience in Dataiku DSS is a strong plus.
- Prior experience with Snowflake required
- Prior experience with DevOps technologies such as Github Actions, Azure DevOps or Jenkins
- Strong understanding of data architecture & data modeling concepts
- Prior experience building and maintaining replication & data pipelines in a cloud data warehouse or data lake environment
- Strong analytical mindset; proactively clarifies ambiguous problems, challenges assumptions, and proposes pragmatic solutions.
- Works effectively with complex stakeholders, translating vague asks into clear, testable requirements.
- Excellent written and verbal communication with senior audiences; articulates business value, data products, and platform capabilities; produces precise, concise documentation.
- Demonstrated ownership in remote, fast-paced environments: manages multiple projects, adapts to different roles, mentors peers, and invests in continuous learning & knowledge-sharing.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
DataikuGenAIPythonSQLDataOpsData EngineeringData ArchitectureData ModelingData QualityData Pipelines
Soft skills
analytical mindsetcommunicationcollaborationmentoringinnovationproblem-solvingstakeholder managementproject managementadaptabilityownership
