Optimize and enhance existing data pipelines, ETL processes, and data workflows to improve performance, scalability and reliability. Implement best practices for data processing, storage, and retrieval. Implement automated testing within Databricks using frameworks such as pytest
Role Overview Design and develop BI solutions, including dashboards, reports, and data models. Build and maintain ETL processes to extract data from multiple sources. Work closely with business stakeholders to gather and refine reporting requirements. Responsibilities