5. How to load all the foldernames and count of files inside each folder into SQL table using ADF

5. How to load all the foldernames and count of files inside each folder into SQL table using ADF

Azure Content : Annu

1 год назад

9,075 Просмотров

Ссылки и html тэги не поддерживаются


Комментарии:

Hugo Bernardes
Hugo Bernardes - 04.10.2023 18:00

Great! This was what I was looking for.

Ответить
Akash thakur
Akash thakur - 04.09.2023 19:11

Very well explained

Ответить
david green
david green - 18.08.2023 01:21

Ok ive found several examples of this, NONE of which show a kind of recursion that then goes back into the level 2 folders to get or count the files in the subfolders.
The use case in have is to start at a parent folder and extract the path and name of every file in all the subfolders. The folder structure is such that there may be any number of subfolders with files in the last child folder. The subfolders may be 6 or 7 levels deep 😑

Ответить
Vincent Garcia
Vincent Garcia - 09.06.2023 06:14

Hello, I have one similar case but I need to iterate each container and each subfolder something like recursively, so I need to identify all the subfolder nested

Ответить
MY BI NOTES
MY BI NOTES - 28.04.2023 15:40

.. I learned ADF watching your videos .. thank you so much

Ответить
chittaranjan pradhan
chittaranjan pradhan - 16.03.2023 01:01

HI any, first of all good job on making such videos. One thing I didn't get it in the lookup activity you have used for folder name as '@{item().name}.But how the pipeline will come to know that is from GEtMetadata1 because we have one more fetMetadat2 also present where @{item().name} also present. Please explain

Ответить
Online Forward
Online Forward - 31.01.2023 16:24

This is impressive use case, but now consider everything until FILTER then copy to a blob storage all the files you get from filter.

Ответить
ashokreddy kunduru
ashokreddy kunduru - 27.01.2023 18:33

can you please explain when we use Get Metadata activity and Lookup activity &
deference between the Get Metadata activity and Lookup activity

Ответить
sudheernadh
sudheernadh - 11.01.2023 11:48

Hi Maam i have 10 files like file1,file2,.... i want to load first 5 files to sql can you do one video on this scenario

Ответить
kishor kumar
kishor kumar - 22.12.2022 08:58

Thxs for the video this has made my job simple. i am really thankful mam..

Ответить
Rajnish Rajput
Rajnish Rajput - 21.12.2022 22:47

Thanks Annu, very nicely explained
I wanted to loop through 5 layers of subfolders and copy the jason to azure sql db, this example was useful

Ответить
Harsh Brahmbhatt
Harsh Brahmbhatt - 15.10.2022 11:59

Can we load the data of files in different folder into the azure sql table?

Ответить
Saurabh Menon
Saurabh Menon - 21.08.2022 12:16

Hello, as an alternative to the filter activity, could we instead use the length function over the childItems array of the second get metadata to get the number of files inside the folder?

Ответить
Hritik sharma
Hritik sharma - 21.08.2022 10:11

Very nice video

Ответить
avinash thakur
avinash thakur - 21.08.2022 09:27

Nice nice
Explanation is very good Annu
Keep up the good work ✌️😊

Ответить
ManamTelugu
ManamTelugu - 21.08.2022 06:12

Thank you

Ответить