Tech Stack
AzurePySparkPythonSparkSQLVault
About the role
- The Client is seeking a skilled Data Analyst with strong experience in Azure Databricks to support the creation of data aggregations, dashboards, and reports.
- The ideal candidate will have hands-on expertise with Databricks (PySpark) and visualization tools, including both Databricks native tools and Power BI.
- In this role, you will be responsible for developing business requirements, supporting change management documentation, and actively collaborating with stakeholders to ensure alignment between data solutions and business needs.
- You will work closely with a technical lead and participate in design discussions and planning with the broader development team.
- Key Responsibilities: Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity
- Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries
- Collaborate closely with data engineers to design and deliver high-quality data products
- Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats
- Design and build intuitive, informative dashboards using tools such as Power BI or Databricks' native visualization tools to effectively communicate insights
- Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools
- Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality
- Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights
- Develop and implement predictive models, algorithms, and advanced analytical tools to address specific business challenges
Requirements
- Hands-on experience designing, deploying, and managing Azure Databricks architecture in enterprise environments (Required 3 Years)
- Strong understanding of data science concepts, including statistical learning and machine learning algorithms (Desired 3 Years)
- Proficiency in SQL and Python for developing queries, data transformations, and interactive dashboards (Required 3 Years)
- Experience with techniques like dimensional modeling, entity-relationship modeling, normalization/denormalization, or Data Vault (Required 3 Years)
- Excellent communication skills with proven ability to collaborate with cross-functional teams and translate business needs into technical solutions (Required 5 Years)
- Databricks Data Analyst Associate Certification (Desired)