Curated

(5/5)

Introduction to the HTTP Tool

AI agent that can scrape webpages Remake of https://n8n.io/workflows/2006-ai-agent-that-can-scrape-webpages/ Changes: Replaces Execute Workflow Tool and Subworkflow Replaces Response Formatting

Integrations Used (3)

Lmchatopenai

Toolhttprequest

Agent

Workflow Structure (9 nodes)

100%

Set

Set ChatInput

Langchain.lm Chat Open Ai

OpenAI Chat Model

Langchain.agent

AI Agent

Langchain.tool Http Request

Webscraper Tool

Manual Trigger

When clicking ‘Test workflow’

Set

Set ChatInput1

Langchain.lm Chat Open Ai

OpenAI Chat Model1

Langchain.agent

AI Agent1

Langchain.tool Http Request

Activity Tool

Node Types:

default

http

transform

trigger

Requires credentials

Prerequisites

Required Credentials (2)

HTTP Header Auth

Used by: Webscraper Tool

Docs

OpenAI

Used by: OpenAI Chat Model, OpenAI Chat Model1

Docs

Complexity

Moderate

Some experience helpful. Multiple integrations or logic.

Setup time: ~25 min

Score: 27/100

When to Use This Workflow

Real-time Response

React instantly when events happen - new orders, form submissions, or API calls.

Zero delay between trigger and action for time-sensitive workflows.

Time Savings

Replace repetitive manual tasks with reliable automation.

Reclaim hours every week for higher-value work.

Error Reduction

Eliminate human error from routine processes with consistent automation.

Improve accuracy and reliability across your workflows.

workflow.json

{
  "meta": {
    "instanceId": "26ba763460b97c249b82942b23b6384876dfeb9327513332e743c5f6219c2b8e"
  },
  "nodes": [
    {
      "id": "abccacce-bbdc-428e-94e0-19996c5bfe02",
      "name": "Sticky Note",
      "type": "n8n-nodes-base.stickyNote",
      "position": [
        1720,
        160
      ],
      "parameters": {
        "color": 7,
        "width": 319.5392879244982,
        "height": 218.88813194060202,
        "content": "### AI agent that can scrape webpages\nRemake of https://n8n.io/workflows/2006-ai-agent-that-can-scrape-webpages/\n\n**Changes**:\n* Replaces Execute Workflow Tool and Subworkflow\n* Replaces Response Formatting"
      },
      "typeVersion": 1
...