Does anyone know of any other smart ways to scrape data from websites?
Best answer by ChelseyBest answer by Chelsey
What is the actual website
'var url = inputData.url
fetch(url)
.then(res => res.text())
.then(body => {
var output = { url, rawHTML: body }
callback(null, output)
})
.catch(callback)'
It brought back all of the info I needed. The fun part is then parsing it out with code or formatter.
There are a few things to keep in mind:
- if you're running the zap constantly, you will get blocked from the site temporarily, this will also occur with Apify or Import.io
- It's best with a plan with Paths.
- Its tedious, but it works really well!
- You'll need to know regex, but if you don't feel free to pm me, I love this kind of stuff.
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.