Skip to main content

I use a zapier webhook request to get back a dump of data via API.

I have 10,000 recordds and within each record there is a field called “type” and a value called “unna A" or “unna C”. I have loopers set up that are correctly processing all the records individually and sending them to my system. It works, I am looking to refine it.

 

This information back is parsed and mapped and then sent to another system via API.

The problem I have is that in that first request I get a reply of say 12K records. Of those 12K records 10K of them I want to exclude from subsequent processing based on a text match identifier.

There is a field in each record called “type” and a value called “unna" that is part of a word stem featured in the results I want to exclude from processing.

IN other words all the records that contain the word “unna” need to be excluded.

This will then leave 2K records which are relevant, which can then be processed by the following steps.

Basically I want to filter out any records where the field “type” contains “unna*”

Unfortunately the API I connect with via the webhook does not have the ability to perform this on the data being sent so I need to find a way to filter it on the way in.

 

Thanks for any help.

 

Hi @GSH 

Add a Filter step: https://zapier.com/apps/filter/help


 

Am I being an idiot? I am parsing the data set where I am looking to filter out records that match.


Can somone help me understand how I set a rule that basically tells it to let everything else through.


 


@GSH 

NOTE: If you are returning too much data in a Zap step, you may encounter an error.

If you are returning more than 500 records, then you would likely need to use a custom Code step to filter the records: https://zapier.com/apps/code/help

Looping Zap app can be used to iterate line items, but has a limit of 500.

Files by Zapier may be another option for handling large data volume: https://zapier.com/apps/files-by-zapier/integrations#triggers-and-actions

 

 


Reply