I’m trying to pull a large amount of data - it’s an API call to get roughly 9000 employees. I then run through a number of steps that include filtering out by specific details and then manipulating data before passing each employee through another API endpoint. My zap triggers on a schedule and then I am using Loop from Numbers to cycle through the API pagination to get all workers (25 at time to avoid throttling). I tried to add a Delay After Queue for 1 Minute after all the filter steps and right before the API call at the end, but I found that the delay release time was taking into account all the records, not just the filtered ones.
Any suggestions on how to handle the pagination through all these records and not throttle the API call at the end?
