Question

Split the results into small batches and run until the results are submitted

  • 24 July 2023
  • 5 replies
  • 28 views

I’m running a daily Zap that uses API Request in Google Sheets and is getting up to 70,000 results.

 

Is there a Zapier tool that would let me split it into small batches (around 300 records per batch) and run it until all records are being sent (to Marketo)?


This post has been closed for comments. Please create a new post if you need help or have a question about this topic.

5 replies

Userlevel 7
Badge +14

Hi @Ops User 

Good question.

Fetching that much data in a Zap step likely will go above the Zap step data size limits.

For us to have more context, how is your GSheet API Request Zap step configured? (screenshots)

Hi @Troy Tessalone, I’m only using the GET method and the URL to retrieve the data.

 

Userlevel 7
Badge +14

@Ops User 

GSheets API endpoint to reference for setting ranges: https://developers.google.com/sheets/api/reference/rest/v4/spreadsheets.values/batchGet

 

@Ops User

GSheets API endpoint to reference for setting ranges: https://developers.google.com/sheets/api/reference/rest/v4/spreadsheets.values/batchGet

 

Thank you! How can I create a loop that reads the first range, then the next, and so on until it finishes all the rows?

Userlevel 7
Badge +14

@Ops User 

You’ll have to implement logic (likely with a Code step) to increment the range values and determine the # of rows returned to further determine if the looping should continue to happen.

 

May offer guidance about how to create a looping Zap with webhooks: