Forum Replies Created

  • Mauro Amaral

    Member
    April 17, 2025 at 10:20 am in reply to: About Extract Web Content API

    Hey Hasan!

    It seems to be happening on any site. I just tested this one:

    https://www.slashfilm.com/1832402/sci-fi-movie-2073-max-streaming-charts/

    A few months ago I noticed that some sites block scraping (The Verge, for example). But that wouldn’t give a 500 error, normally it executes but doesn’t return results, with a message indicating this.

    It seems like something widespread this time​​​​​​​​​​​​​​​​.

    Still on this subject:

    Have you already tested any solution for sites that block this type of extraction?

    I use your custom app to automate my content curation process to supply my newsletters and networks with ideas and summaries of articles. I’ve noticed that more and more sites have been blocking scraping. Any solution?​​​​​​​​​​​​​​​​

    Thanks!

    • This reply was modified 7 hours, 10 minutes ago by  Mauro Amaral.
  • Mauro Amaral

    Member
    April 16, 2025 at 5:00 pm in reply to: About Extract Web Content API

    Hey Hasan! Nice to talk to you!

    So, I’ve been using your app in scenarios like the one attached.
    My process involves tagging interesting articles and posts on InoReader (or by my Chrome extension), which executes a webhook that sends to your app, from this app to GPT, etc.

    But, since yesterday, Make.com has notified me with an error 500.