Data pipeline vs Dataflow vs Shortcut vs Notebook in Microsoft Fabric
Published 2024-03-11
So you want to move your analytics workloads from a Power BI-centric model to a Fabric-centric model? But how do you do that?
This video is the third in the series where I discuss different options for getting data into Microsoft Fabric, including Data Pipelines, Dataflow Gen2, Fabric Notebooks, OneLake Shortcuts, Database Mirroring.
We talk about the pros and cons of each to help you make better architectural decisions in Microsoft Fabric.
Catch up on the Power BI to Microsoft Fabric Transition Guide series here: • Power BI to Fabric Transition Guide
Timeline
0:00 Intro
1:08 Series review
1:29 The problem
3:07 Overview of the different methods
5:19 Data ingestion principles
7:29 Dataflow overview
7:54 Dataflow: when to use/ when not to use
10:09 Dataflow: implementation notes
13:11 Data pipeline overview
13:27 Pipelines: when to use/ not to use
15:35 Pipelines: implementation notes
17:38 Notebooks overview
18:29 Notebooks: when to use/ not to use
20:16 File/database replication overview
22:30 Shortcuts overview
22:52 Internal shortcut limitations
24:05 Shortcuts: implementation notes
25:17 Database mirroring overview
27:53 What to consider when choosing a method
#powerbi #microsoftfabric #dataanalytics
All Comments (21)
-
Hey everyone, I'm back! If you found this video helpful, please do give it a like or share it with colleagues, it really helps grow the channel 😊 THANK YOU!
-
You have such an inclusive approach- how could we resist watching until the end? Thank you for such helpful content!
-
This is my favorite video and reshaping my knowledge framework about Fabric! Thank you, Will !
-
⏳watched it all the way through. Thanks for the detail. Loads of options for loading data!
-
I really enjoyed your approach to describing the features of Fabric. Thank you. ⌛️
-
Thanks a lot for all your videos. I’m new to fabric and they have been a huge help in getting my feet wet. I really like your presentation style and pacing
-
Thank you. I love the was you explained each concepts.⏳
-
great video, nice pacing and really useful framing of the topics covered. Thank you!
-
Thanks for sharing this kind of content,super useful!
-
I really liked the way you encapuslated the methods. Much better more high level than Learn. And hopefully I have enough ⏳ to finish these before the exam.
-
⏳ Loving the super helpful videos. Especially this series of Fabric videos which are really useful even if you are not coming from Power Bi. Thanks for your content 🙏🏻
-
Greetings form Guatemala Central America, Thanks I´m learning a lot with your videos ⌛
-
Very well explained ! Thanks !
-
Thank you for this explanation of data ingestion in Fabric environments ⏳
-
"How to get the data into MS Fabric"? - Better way explanation on possible options to get the data into MS Fabric i.e, using Data pipeline, Dataflow, Internal/External Shortcuts, files/Database replication, Fabric Notebooks, Database mirroring. Keep it up Will :)
-
This is very helpful stuff as I study for the DP-600, and also eye a on-prem Postgres database that I’d like to get into a Fabric lakehouse. Thank you! ⏳
-
⌛️ Thanks so much such insightful contents. Waiting for capacity and costing consideration video.
-
⏳ - superb, thanks Will!
-
⌛️brilliant series! I’m learning fabric so I can ingest azure resource graph queries from azure tenants for use in powerbi dashboards
-
Perfect explanation
