Learn Together: Use Apache Spark in Microsoft Fabric
Learn Together: Use Apache Spark in Microsoft Fabric
Full series information: https://aka.ms/learnlive-microsoft-fabric-wave-1
More info here: https://aka.ms/learnlive-microsoft-fabric-wave-1-Ep202
Follow on Microsoft Learn:
- Complete the Learn module: https://aka.ms/learnlive-20240124B
Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data in a Lakehouse at scale.
---------------------
Learning objectives
- Configure Spark in a Microsoft Fabric workspace
- Identify suitable scenarios for Spark notebooks and Spark jobs
- Use Spark dataframes to analyze and transform data
- Use Spark SQL to query data in tables and views
- Visualize data in a Spark notebook
---------------------
Chapters
--------
00:00 - Introduction
06:07 - Learning objectives
11:56 - Prepare to use Apache Spark
15:11 - Demo - Spark configuration
24:33 - Run Spark code
30:46 - Load data into a Spark dataframe
36:21 - Transform data in a dataframe
59:43 - Save a dataframe
1:13:33 - Work with data using Spark SQL
1:17:02 - Demo - Use Spark SQL
1:26:29 - Summary and resources
---------------------
Presenters
Anupama Natarajan
Data And Ai Consultant, Microsoft MVP
Pearl Innovations Limited
- LinkedIn: https://www.linkedin.com/in/anupamanatarajan/
Armando Lacerda
Azure Data Architect And Engineer, Microsoft MVP, Microsoft Super User
MC Tech
- LinkedIn: https://www.linkedin.com/in/armando-lacerda
Moderators
Andrei Khaidarov
Senior Bi Engineer, Microsoft Super User
Velvetech LLC
- LinkedIn: https://www.linkedin.com/in/andgenn/
More info here: https://aka.ms/learnlive-microsoft-fabric-wave-1-Ep202
Follow on Microsoft Learn:
- Complete the Learn module: https://aka.ms/learnlive-20240124B
Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data in a Lakehouse at scale.
---------------------
Learning objectives
- Configure Spark in a Microsoft Fabric workspace
- Identify suitable scenarios for Spark notebooks and Spark jobs
- Use Spark dataframes to analyze and transform data
- Use Spark SQL to query data in tables and views
- Visualize data in a Spark notebook
---------------------
Chapters
--------
00:00 - Introduction
06:07 - Learning objectives
11:56 - Prepare to use Apache Spark
15:11 - Demo - Spark configuration
24:33 - Run Spark code
30:46 - Load data into a Spark dataframe
36:21 - Transform data in a dataframe
59:43 - Save a dataframe
1:13:33 - Work with data using Spark SQL
1:17:02 - Demo - Use Spark SQL
1:26:29 - Summary and resources
---------------------
Presenters
Anupama Natarajan
Data And Ai Consultant, Microsoft MVP
Pearl Innovations Limited
- LinkedIn: https://www.linkedin.com/in/anupamanatarajan/
Armando Lacerda
Azure Data Architect And Engineer, Microsoft MVP, Microsoft Super User
MC Tech
- LinkedIn: https://www.linkedin.com/in/armando-lacerda
Moderators
Andrei Khaidarov
Senior Bi Engineer, Microsoft Super User
Velvetech LLC
- LinkedIn: https://www.linkedin.com/in/andgenn/
Views: 5