
Senior Data Engineering Consultant
Ippon Technologies USA
full-time
Posted on:
Location Type: Hybrid
Location: Washington, D.C. • Washington • United States
Visit company websiteExplore more
Salary
💰 $175,427 - $185,000 per year
Job Level
Tech Stack
About the role
- Create and optimize end-to end data pipelines and perform and enhance real-time data processing.
- Identify client needs and provide customized solutions across many major data platforms (Snowflake, Databricks, and more) atop all major cloud platforms.
- Research and prototype new technologies using EMR, Kafka, Spark, Airflow, Flink, etc.
- Perform coding using various programming and scripting languages to automate data ingestion and improve data management processes.
- Support and develop data flows by developing processes that verify, standardize, and scale data input, transformation and storage.
- Design and implement Data Architectures, customize storage and extraction, metadata, and information repositories.
- Utilize programming languages like Kafka, Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake and Redshift.
- Work on a variety of projects involving data architecture, data models, data migration, data integration, data analysis, and visualization.
- Work with clients from Latin America and communicate with them in Spanish regarding complex technological concepts.
- Serve as subject matter expert on data engineering and management best practices.
- Stay on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community.
- Work with Data Scientists and Data Owners to understand use cases and hypotheses to test with data.
- Establish data governance models and contribute to strategies for enterprise data management.
- Perform extensive data profiling and analysis based on the client's data and needs.
- Work with software development teams and stakeholders to define reporting requirements.
- Support project delivery on Data Warehouse/BI projects for external clients, including partnering with subject matter experts on project execution.
- Support clients in developing and implementing data engineering process improvement plans.
Requirements
- Education: Bachelor’s degree in Information Technology or a related field
- Experience: 4 years, including 4 years of working in the position of Data Engineer, Software Developer or related experience
- experience using traditional RDMS systems (MSSQL, Oracle, Postgres, MySQL)
- experience building Continuous Integration/Continuous Deployment + infrastructure as code
- Data Architecture experience
- experience using Kafka, Java, Scala, Python
- experience using NoSQL databases and Cloud based data warehousing services such as Redshift or Databricks
- experience working within a team in an Agile development environment, managing stakeholders, defining requirements and participating in Agile ceremonies
- experience translating technical solutions into business outcomes
- experience developing pipelines in Apache Airflow
- experience using Snowflake designing data pipelines and building analytics solutions for cloud data projects
- Special Skills or Other Requirements: Fluent in Spanish (to communicate with clients from Latin America)
Benefits
- Competitive salary – Great starting salaries for well qualified candidates
- Generous Paid Time Off policy - Ippon offers flexible time off to help you be your best
- Health, dental, and vision insurance – We are dedicated to helping our employees live healthier lives through comprehensive health programs
- 401k with company match - Ippon offers an industry leading 401(k) matching plan
- Family Leave - We support the importance of family and offer maternity, paternity and family medical leave plans
- A fun, smart, and healthy work environment, focused on our values and teamwork
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data pipelinesreal-time data processingdata architecturedata migrationdata integrationdata analysisdata visualizationdata governancedata profilingdata management
Soft Skills
communicationclient needs assessmentmentoringstakeholder managementteam collaborationproblem-solvingadaptabilityresearchcustomized solutionstranslating technical solutions