Data Platforms

Databricks

1. Databricks is ACID

1. DB Learning Library

   1. Free courses

   2. Docs Optimization recommendations

   3. Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads

   4. Vector Search

   5. DB for ML

   6. DB for Data Engineering

2. (good) Introduction & Tutorial - cluster / notebook / table / SQL / DataFrame / connections

3. must know 7 concepts

1. RDD vs Dataframe vs Dataset

   1. 2016 official blog post

   2. linkedin blog post

   3. comparison on youtube

   4. RDDs vs. Dataframes vs. Datasets – What is the Difference and Why Should Data Engineers Care?

2. Optimizations

   1. Optimization recommendations on Databricks

   2. Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads

   3. How I Use Caching in Databricks to Increase Performance and Save Costs

   4. Why and How: Partitioning in Databricks

3. Best Practices

   1. official docs