APIFY: Webscraping

Bram · December 30, 2023, 11:34am

Hi All,

So I’ve created a video about using Apify with a use case for a mortgage advisor in combination with some other tools like Activepiece and Frontly.

Please see the video here: What's your scraping use case? - #25 by Bram

I think no triggers are needed as you can set these up via Webhooks, but on the action side I think could be really big.

Actions

Running actors API reference | Apify Documentation
Getting items (from datasets) API reference | Apify Documentation

There is a lot more to be added, but I think this would be a great start.

KR Bram

codemaster_devops · May 29, 2024, 12:41am

This would be a great help if we add this apify integration

echalupa · September 10, 2024, 9:41pm

just wanted to bump this post as this would be an awesome feature that would add a lot of functionality!

Mark_van_Bellen · November 21, 2024, 3:29pm

I created a piece with 3 or 4 actions. Enjoy.

Bram · November 21, 2024, 4:28pm

HEROOOOOO Thanks @Mark_van_Bellen

echalupa · December 30, 2024, 6:20pm

Bram,

Were you able to get “Start an Apify Actor” to work? I have been using Apify with AP via HTTP Requests and Webhooks, and I was hoping to use this new piece. Not sure if I have the right id or JSON data. I am assuming I am doing it correctly, but maybe there is something that I am missing? How have you set yours up?

EDIT

It looks like my issue is that I was trying to run the task within the actor. It would be great if we could get tasks as part of this integration, as I would like to have multiple runs on the same actor. As I understand it, you cannot really duplicate actors for multiple runs.

Bram · December 30, 2024, 8:17pm

Hi @echalupa,

Acutally I triggered it with webhooks too, also moved over to Zerowork instead of Apify for most of my scrapings.

But i just tested it and if works fine. You can also schedule the actor from Apify side to your needs btw.

For the connection with Apify you have to get your API key and for the actor to start you need the Actor ID, they are both at (go to your actor) → API → API Clients and then you have the following screen, top one is the API token bottom one is the Actor ID