• About Extract Web Content API

    Posted by Mauro Amaral on April 16, 2025 at 12:06 pm

    Hey Hasan,

    Good morning and greetings from Brazil! I’ve been following your tutorials for some time and have been using them in tests with AI agents + Make.com + Notion to create a content curation and production system. First of all, thank you very much!

    I’m reaching out with a question: has the app you created for Make.com (Extract Web Content) been discontinued? I ask because I use it for these tests and noticed that since April 13th it has been returning errors (Error 500) on Make.com.

    Is this temporary?

    • This discussion was modified 1 day, 4 hours ago by  Mauro Amaral.
    Mauro Amaral replied 6 hours, 41 minutes ago 2 Members · 4 Replies
  • 4 Replies
  • Hasan

    Administrator
    April 16, 2025 at 4:56 pm

    Hi Mauro, thank you!

    Do you mean extracting from YouTube or from blog posts?

    • Mauro Amaral

      Member
      April 16, 2025 at 5:00 pm

      Hey Hasan! Nice to talk to you!

      So, I’ve been using your app in scenarios like the one attached.
      My process involves tagging interesting articles and posts on InoReader (or by my Chrome extension), which executes a webhook that sends to your app, from this app to GPT, etc.

      But, since yesterday, Make.com has notified me with an error 500.

      • Hasan

        Administrator
        April 17, 2025 at 8:40 am

        Thanks, I need to check this, is it with all URLs? or specific ones?

  • Mauro Amaral

    Member
    April 17, 2025 at 10:20 am

    Hey Hasan!

    It seems to be happening on any site. I just tested this one:

    https://www.slashfilm.com/1832402/sci-fi-movie-2073-max-streaming-charts/

    A few months ago I noticed that some sites block scraping (The Verge, for example). But that wouldn’t give a 500 error, normally it executes but doesn’t return results, with a message indicating this.

    It seems like something widespread this time​​​​​​​​​​​​​​​​.

    Still on this subject:

    Have you already tested any solution for sites that block this type of extraction?

    I use your custom app to automate my content curation process to supply my newsletters and networks with ideas and summaries of articles. I’ve noticed that more and more sites have been blocking scraping. Any solution?​​​​​​​​​​​​​​​​

    Thanks!

    • This reply was modified 6 hours, 38 minutes ago by  Mauro Amaral.

Log in to reply.