Best answer

How to send API request from big data file?

  • 8 December 2021
  • 1 reply
  • 397 views

Indented goal is to send data from a quite large csv file to an external API without running into rate limits or throttling. To be precise; all API POST request need to “simulate” live traffic (as if every submit is not sources from the bulk file, rather submissions on a live website. Trying to figure out how to implement this “mimic real user behavioir”. 
 

can anyone please help me?

icon

Best answer by robschmidt 8 December 2021, 15:26

View original

This post has been closed for comments. Please create a new post if you need help or have a question about this topic.

1 reply

Userlevel 7
Badge +9

Hi @Tal 

You can use Zapier Transfer (https://zapier.com/transfer) to send your data in bulk. To do this:

  • Put your CSV data in a Google sheet
  • Using transfer, select ‘Webhook by Zapier” as destination to make POST request to any endpoint

However, that is likely to hit a limit. The other way of doing this would be a bit complicated, which is as follows:

  • Save your CSV as JSON in a publicly accessible URL
  • Create a Zap, use Zapier Schedule as triggger
  • Use “Webhook by Zapier” to GET the JSON data from the URL
  • Use “Loop by Zapier” to go take one item/array from the CSV/JSON data
  • Use “Delay” action to avoid rate limit
  • Use “Webhook by Zapier” to make POST request to your website where you can specify the submission

You should be able to manually run it:

If you dont want to convert CSV to JSON, then you may try https://zapier.com/apps/easycsv/integrations