Ippon Technologies USA

Data Engineer

• Create and optimize end-to end data pipelines and perform and enhance real-time data processing.
• Identify client needs and provide customized solutions across many major data platforms (Snowflake, Databricks, and more) atop all major cloud platforms.
• Research and prototype new technologies using EMR, Kafka, Spark, Airflow, Flink, etc.
• Perform coding using various programming and scripting languages to automate data ingestion and improve data management processes.
• Support and develop data flows by developing processes that verify, standardize, and scale data input, transformation and storage.
• Design and implement Data Architectures, customize storage and extraction, metadata, and information repositories.
• Utilize programming languages like Kafka, Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake and Redshift.
• Work on a variety of projects involving data architecture, data models, data migration, data integration, data analysis, and visualization.
• Work with clients from Latin America and communicate with them in Spanish regarding complex technological concepts.
• Serve as subject matter expert on data engineering and management best practices.
• Stay on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community.
• Work with Data Scientists and Data Owners to understand use cases and hypotheses to test with data.
• Establish data governance models and contribute to strategies for enterprise data management.
• Perform extensive data profiling and analysis based on the client's data and needs.
• Work with software development teams and stakeholders to define reporting requirements.
• Support project delivery on Data Warehouse/BI projects for external clients, including partnering with subject matter experts on project execution.
• Support clients in developing and implementing data engineering process improvement plans.

Senior Data Engineering Consultant