Skip to main content
Question

Formatter not sending Google Sheets all the data from the Webhook

Hi ,

I am new to Zapier and I am working with The webhook app to pull data from my warehouse.  I am tring to get a simple list of model number and quantity available.

 

The webhook pulls all data form the warehouse and is a large data dump.  When I use formater to pull the fields into google sheets I get all of my items but only three quarters of the quantity available field.

 

My question is , does the formater have data limits?  if so can I send quires with the webhook to filter out the data that I actually need so I am not pulling in a massive amount of data?

 

This post has been closed for comments. Please create a new post if you need help or have a question about this topic.

24 replies

Troy Tessalone
Userlevel 7
Badge +14

Hi @lolombibi 

My question is , does the formater have data limits?  if so can I send quires with the webhook to filter out the data that I actually need so I am not pulling in a massive amount of data?

If the API being used in the request has filtering parameters, then those should be used to limit the returned data.

OR a Code step can be used to handle data: https://zapier.com/apps/code/help

 

 

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

Thank you, I will look into the filtering parameters.  If that is not possible, any way you can help with the code step? I am not a programer and would not know what code commands to use to filter the data.

 

Troy Tessalone
Userlevel 7
Badge +14

@lolombibi 

Please do your best to outline your use case with an example of the input data desired output data.

Best to include screenshots for context.

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

I dont see a way of entering filtering parameters in the Zapier Webhook Get step. Do I just add them to the http: address?

Troy Tessalone
Userlevel 7
Badge +14

@lolombibi 

Depends on what API endpoint you are using.

Can you share the link to the API docs you are referencing?

The more details you are able to provide for context, the better we can evaluate and advise.

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

The warehouse name is Flexe. The API documentation can be found here

 

https://developer.flexe.com/doc/public

 

L
Badge

I am requesting the inventory from the following address

https://developer.flexe.com/doc/public#tag/Inventory-Stable

 

 

Troy Tessalone
Userlevel 7
Badge +14

@lolombibi 

Are you able to provide more details and context about how you are trying to use this API in your Zap?

What endpoint are you using?
 

Depends on what API endpoint you are using.

Can you share the link to the API docs you are referencing?

The more details you are able to provide for context, the better we can evaluate and advise.

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

Sure, Sorry

 

I am pulling data from https://api.flexe.com/api/v1/shipper/inventory

 

All I need is the Item Number and the quantity available

 

I was formating the available data with the formater and dumping it into google sheets. The only problem is the formater is not showing all the data. 

 

I will just need to filter out all the none essential data from the Webhook GET 

Troy Tessalone
Userlevel 7
Badge +14

@lolombibi 

Clicking the API links requires a login to view, so unfortunately I can’t see the API documentation.

 

Consider hiring a Zapier Expert: https://zapier.com/app/get-help

 

 

 

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

That is strange, even the address that has Public at the end?

 

https://developer.flexe.com/doc/public

 

 

L
Badge

Here is a screen shot of the backend

This post has been edited by a moderator to remove sensitive information. Please remember to obfuscate any personally identifiable information prior to posting as this is a public forum. 

1 Attachment
Troy Tessalone
Userlevel 7
Badge +14

@lolombibi 

Please try the links in a new/private browser.

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

I see, Can you have a look at the attachment?

Troy Tessalone
Userlevel 7
Badge +14

@lolombibi 

These are query string parameters that can be used in the GET request to narrow down the returned results:

 

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

yes, I have been adding them manually to the address for example 

 

https://api.flexe.com/api/v1/shipper/inventory?ever_in_use=false

 

This did not seem to change the result. Still getting all the data from the webhook, Is there another spot that I need to be adding the query parameters?

 

Troy Tessalone
Userlevel 7
Badge +14

@lolombibi 

If you’re using the GET request option (not Custom - GET), then there is a section for the Query String Params

 

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

Thank you, So I added a second Webhook to send the GET request  after the first one that gets the authorization.

I am now getting a Authorization error, I guess I have to include the authorization form the first webhook, do I need to include the Authorization with every request? Is there a way to pass it down?

 

Troy Tessalone
Userlevel 7
Badge +14

@lolombibi

The ‘custom’ option can be used to dynamical map variables between steps: https://zapier.com/help/create/basics/set-up-your-zap-action#set-up-your-action

⚡ Troy Tessalone - AutomationAce.com | Premier Certified Zapier Expert | #1 Zapier Community Contributor
L
Badge

Thank you for the feedback, unfortunately the authentication variable is empty in the next step.

I wish I know of a piece of software where you can link API field with a drag and drop interface. This is a overly complicated.

R
Userlevel 3
Badge +1

Lolombibi,

I concur with the suggestion you filter with a code step. This can be done by either looping through the API results or by loading the results into an array which you then filter.

This is a valuable skill for you to learn, IMHO, since it will serve as a model for any future queries you want to do against this or other data.

L
Badge

Hi Thank you for the comments,

 

Do I use the Zapier Filter app to load the data into an Array?

R
Userlevel 3
Badge +1

The Filter app is for an entirely different purpose. Think of it as a selective roadblock that stops execution if certain conditions are met.

You would load the data into an array with a code step. If you want to send me a private message, we can perhaps talk it through.

L
Badge

ok thank you.

 

Terms & Conditions