How to do Pagination on a REST API in Power Query (Part 1)

excellent video, knowing how to get information from api is really a great help. This video deserves so much more likes.

How can I use Dataflows for this task? I always get a dynamic consult error when I try this trick.

Wanted to drop a line and say thank you! Can't tell you how much help this was. Thank you again!

thank you for this video! very good explanation !

You are the absolute GOAT

NOTE as of 10/5/22: This approach only works in PBI desktop and wont work once published to PBI Online. Refer to "dynamic data source" error.

Hi, I humble request you for getting suggestion how to import data in power bi from Apache druid . there is not direct connectivity option in power bi.

Thanks!

Hi there,

I was wondering how you could paginate an API with x pages and where the page ends with Next, mine keeps looping with this method, so I think my example needs another fix right?

Could you help me with that?

This video is a lifesaver! Thank you so much!!!

This video is very luxurious. Thank you very much. :-)

Hello, I get the message "Some data sources may not be listed because of hand-authored queries" when I open the data source settings. Any idea how I could fix this? I think this appears when I dynammically loop the query based on de column1 list

Hello
Long time viewer, first time caller, keep up the good work
I have had a problem with this that I have encountered before using API but havent been able to solve, it is the dreaded "Formula.Firewall: Query 'Query2' (step 'Added Custom') references other queries or steps, so it may not directly access a data source. Please rebuild this data combination" error message
There are examples online but none of them use Web.Contents, can you show me how to solve this?

Thank you so much! I just got dropped into the deep end of the reporting pool at work, and this was an exceptionally helpful video!

Thank you so much, wonderful explanation !!

Thank you so much ! Exactly what I needed !

waiting for part-2

I realize I'm a couple weeks late but I would love to see part 2!

Hey Loved the video. Making it really easy to learn the stuff. I'd really love to get the second part of the video.
The thing is that my company is usking JIRA and their API does not use this page nr system as you are showing and the table i need to process has 1150 rows, but jira is limiting it to 50 outputs per request. So as a result I think there is tone of people (many jira users) who'd love to get this second part as much as I do.

I've been wondering how to do this for ages, this is amazing. I've implemented it today for a client and it's worked perfectly - Thanks!

great video,
currently trying to call all available invoice pages from Xero(accounting tool). can't wait for next part.

How can I import data from JIRA server using rest Api.. please help

I've had opportunity to do both this and another one where I don't know the amount of pages beforehand, but in both cases, my main issue is that it won't refresh in the service. I'd love a video on that if you have a solution. As always thank you for your amazing content!

Great video! 2nd video please!

I have an API that provides a next page key and count of records but says nothing about number of pages. How do I treat this?

Hi Madam. I just want to know is it possible in power query to get the data of all duplicates in a single row.

This is a nice trick. Ruth, talking about APIs, how about you do a video about using "Function.InvokeAfter" as a mean to work around some API provider's limits on requests per minute? I recently faced that challenge with a geocoding provider, and this is effective method to solve the issue.

Or you could use ?per_page=9999999 to obtain all the records in one result :)

Voting for sooner Part 2! Thanks, Ruth!

Hey Ruth, Thank you for the tips. I couldn't try as the API isn't working (maybe because of firewall...) however i was wondering if you could schedule refresh in the Web Service. Often it gets the error that Dynamic queries are not supported (as least in Pro version without premium)

Great Video!
Can you also do a tutorial to create admin views? (Workspaces, user access, reports, datasets, etc) using REST APIs that refreshes dynamically? (Without having to hardcore your password in the query editor). TIA.

Cool .. very good idea 👍👍

Hey Ruth, great timing :) because I have problem with that :) And I have a question for You or subscribers: will this solution work on PowerBI Server?

great stuff! one question: since we have the dynamic number of pages in query 'country' do we need 'Query1' any more?

Sooner🙂

As always, a great video with good content! Waiting for the second video! :)

Yes please do part 2

yes please - part 2 sounds v interesting

Yes please Ruth. Would love to see that second video. Thanks for sharing :) Great practical topic

Love this! Making everything dynamic is exciting!

Buen vídeo!!