
Data/Business Engineer
Gorilla Logic
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇨🇴 Colombia
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
AzureCloudHadoopKafkaSparkSQL
About the role
- Design new data infrastructures, including the Lakehouse, data warehouses, dataflows, data pipelines, semantic models, and reports.
- Migrate large-scale data stores from the existing on-premises SQL Server infrastructure to the new Microsoft Fabric-based infrastructure.
- Classify and organize data base on identified taxonomy structures.
- Work with the data architect to ensure that the data is of high quality and meets the organization’s requirements.
- Optimize data processing by using modern data engineering tools such as notebooks, dataflows, data pipelines, semantic models, and reports.
- Provide technical expertise during the design, planning, design, development, implementation, and testing of digital solutions, often custom developed and integrating new technologies.
- Understand technological systems and strategic vision and help facilitate the technical portion to produce integrated end-to-end digital solution options.
- Participate in cross-project planning and release planning activities.
- Serve as a stakeholder of the technical backlog: identify opportunities in our system, capturing the ideas in user stories, and meeting with other stakeholders to prioritize them.
- Write and maintain concise documentation about our development process and major systems.
- Build scalable, maintainable, easy-to-use software following our development best-practices and requirements laid out by the architect and the development team.
- Create and maintain the build, deployment, and test automation portions of our DevOps pipeline.
- Collaborate with product owner and end-users to understand any desired business functionality and craft intuitive, responsive UIs to match.
- Regularly review application logs and dashboards to proactively monitor for defects, gauge performance, and troubleshoot production problems.
- Participate in the development of logical and detailed design deliverables (e.g. storyboards, activity/state diagrams, class diagrams, sequence diagrams, etc.) for each application component based on enterprise conceptual designs.
- Keep up-to-date on cutting edge technology, standards, protocols and tools in areas relevant to the rapidly changing digital environment.
- Troubleshoot and support user acceptance testing, rollout efforts and the team’s systems in each environment.
Requirements
- 5+ years software engineering experience with at least 3 years in C#.
- Excellent relational database skills writing SQL, analyzing, and optimizing query plans, and writing DDL scripts.
- Passion for building clean and testable code, creating unit tests, and focusing on code quality.
- Extensive knowledge and experience with Power BI or other widely used data solutions.
- 2+ years experience building solutions for any major public-cloud provider (Azure preferred)
- 3+ years’ experience with data platform technologies such as Kafka, Hadoop, or Spark but preferably those in the Azure platform such as HD Insight, Synapse, Data Lake, and Data Factory.
- Highly self-motivated and directed with strong sense of curiosity and drive to accomplish goals and lead data product team.
- Passion for data and data quality.
- Experience with API and integration concepts.
- Experience with XML, SQL, relational databases, and large data repositories.
- Exceptional verbal and written communication and collaboration skills, with the ability to interact effectively with a wide range of technical and non-technical stakeholders including executive and senior leaders.
- Experience with Agile methodologies, particularly Scrum, and a track record of successful product delivery.
- Bachelors in Computer Science or related field
Benefits
- Contribute to positive, trusting, inclusive culture and team-first environment
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
C#SQLPower BIKafkaHadoopSparkAzureData LakeData FactoryDevOps
Soft skills
self-motivatedcuriositycommunicationcollaborationleadershipproblem-solvingattention to detailgoal-orientedadaptabilityteamwork