Skip to main content

Get Support
Have a question? Let's get you an answer!

How Do I...? Troubleshooting Code & Webhooks Developer Zone

Other Help Resources
Wait, there's more! Check out these Community sourced spaces for additional resources.

Zapier Help Center Hire an Expert

Learning Resources
All of our best learning resources can be found here.

Featured Articles Show & Tell Asked & Answered Zapier's products AI Hub Zapier Tools Hub

Share your knowledge
Give back to the Community by sharing your automation wins and helping to answer questions.

Share your success See unanswered questions User Groups

Other Learning Resources
Some of our favorite additional ways to upskill your Zapier knowledge.

Zapier Learn Zapier Blog Zapier Webinars

Product Updates
Check out what is new and upcoming with Zapier with our regular product updates.

Product Updates

Early Access Program
Want to join Early Access? Learn more here.

Best answer

How to send API request from big data file?

  • December 8, 2021
  • 1 reply
  • 678 views

Indented goal is to send data from a quite large csv file to an external API without running into rate limits or throttling. To be precise; all API POST request need to “simulate” live traffic (as if every submit is not sources from the bulk file, rather submissions on a live website. Trying to figure out how to implement this “mimic real user behavioir”. 
 

can anyone please help me?

Best answer by robschmidt

Hi @Tal 

You can use Zapier Transfer (https://zapier.com/transfer) to send your data in bulk. To do this:

  • Put your CSV data in a Google sheet
  • Using transfer, select ‘Webhook by Zapier” as destination to make POST request to any endpoint

However, that is likely to hit a limit. The other way of doing this would be a bit complicated, which is as follows:

  • Save your CSV as JSON in a publicly accessible URL
  • Create a Zap, use Zapier Schedule as triggger
  • Use “Webhook by Zapier” to GET the JSON data from the URL
  • Use “Loop by Zapier” to go take one item/array from the CSV/JSON data
  • Use “Delay” action to avoid rate limit
  • Use “Webhook by Zapier” to make POST request to your website where you can specify the submission

You should be able to manually run it:

If you dont want to convert CSV to JSON, then you may try https://zapier.com/apps/easycsv/integrations

View original
This post has been closed for comments. Please create a new post if you need help or have a question about this topic.

1 reply

robschmidt
Forum|alt.badge.img+9
  • robschmidtZapier Solution Partner
  • Zapier Solution Partner
  • Answer
  • December 8, 2021

Hi @Tal 

You can use Zapier Transfer (https://zapier.com/transfer) to send your data in bulk. To do this:

  • Put your CSV data in a Google sheet
  • Using transfer, select ‘Webhook by Zapier” as destination to make POST request to any endpoint

However, that is likely to hit a limit. The other way of doing this would be a bit complicated, which is as follows:

  • Save your CSV as JSON in a publicly accessible URL
  • Create a Zap, use Zapier Schedule as triggger
  • Use “Webhook by Zapier” to GET the JSON data from the URL
  • Use “Loop by Zapier” to go take one item/array from the CSV/JSON data
  • Use “Delay” action to avoid rate limit
  • Use “Webhook by Zapier” to make POST request to your website where you can specify the submission

You should be able to manually run it:

If you dont want to convert CSV to JSON, then you may try https://zapier.com/apps/easycsv/integrations

Outliant.com | Zapier Expert
Early access


Next Gen Zaps

Build and deploy automations from AI tools you already use. With Agentic Management, if anything breaks, the agent diagnoses the issue and proposes a fix.

Request access now


Terms & ConditionsAccessibility statement