Learn Together: Ingest data with Spark and Microsoft Fabric notebooks
Learn Together: Ingest data with Spark and Microsoft Fabric notebooks
Full series information: https://aka.ms/learnlive-microsoft-fabric-wave-1
More info here: https://aka.ms/learnlive-microsoft-fabric-wave-1-Ep108
Follow on Microsoft Learn:
- Complete the Learn module: https://aka.ms/learnlive-20240207A
Discover how to use Apache Spark and Python for data ingestion into a Microsoft Fabric lakehouse. Fabric notebooks provide a scalable and systematic solution.
---------------------
Learning objectives
- Ingest external data to Fabric lakehouses using Spark
- Configure external source authentication and optimization
- Load data into lakehouse as files or as Delta tables
---------------------
Chapters
--------
00:00 - Introduction
05:49 - Learning objectives
06:22 - Context in Fabric
10:32 - What is Spark?
14:55 - An introduction to notebooks
16:43 - Explore Fabric notebooks
22:29 - What is a lakehouse?
25:45 - Fabric lakehouse vs Data warehouse
28:48 - Write data into a lakehouse
30:58 - Write to a Delta table
34:14 - Consider uses for ingested data
42:02 - Exercise - Ingest data with Spark and Microsoft Fabric notebooks
1:04:52 - Knowledge check
1:13:25 - Summary
---------------------
Presenters
Johan Ludvig Brattås
Director, Microsoft MVP
Deloitte
- LinkedIn: https://www.linkedin.com/in/johanludvig/
