• Mauro Amaral

    Member
    April 17, 2025 at 10:20 am

    Hey Hasan!

    It seems to be happening on any site. I just tested this one:

    https://www.slashfilm.com/1832402/sci-fi-movie-2073-max-streaming-charts/

    A few months ago I noticed that some sites block scraping (The Verge, for example). But that wouldn’t give a 500 error, normally it executes but doesn’t return results, with a message indicating this.

    It seems like something widespread this time​​​​​​​​​​​​​​​​.

    Still on this subject:

    Have you already tested any solution for sites that block this type of extraction?

    I use your custom app to automate my content curation process to supply my newsletters and networks with ideas and summaries of articles. I’ve noticed that more and more sites have been blocking scraping. Any solution?​​​​​​​​​​​​​​​​

    Thanks!