📂 DBT-Databricks-Project/ │ ├── 📂 models/ │ ├── 📂 bronze/ # Raw data ingestion layer │ │ ├── bronze_customer.sql # Customer dimension source │ │ ├── bronze_date.sql # Date dimension source ...
Make sure to add databricks-labs-pytester as a test-time dependency and not as a compile-time dependency, otherwise your wheels will transitively depend on pytest, which is not usually something you ...
Databricks is a versatile cloud-based data platform that supports various functions, including: - Data Engineering (ETL pipelines) - Data Analysis (SQL queries) - Machine Learning (ML models) - Big ...
Principal Data Engineer at Standard Chartered Bank || Building Scalable Data pipelines on Cloud and On-Premises using Airflow, Spark, Python, Scala, JAVA, Hadoop ...