Crawl4AI

What is the Crawl4AI tool?

The Crawl4AI tool is a built-in capability in the Agno framework that allows AI agents to open-source web crawling optimized for ai. When added to an agent in Agno Builder, the agent can autonomously decide when to invoke this tool based on the user's request.

This is a free tool — no API key or external account is needed. It works out of the box when you add it to any agent.

How to use Crawl4AI in Agno Builder

1. 1

   Create an agent

   Drag an Agent node onto the canvas in Agno Builder, or use one of the built-in templates.

2. 2

   Enable Crawl4AI

   Click the agent, go to the Tools tab, and toggle on "Crawl4AI" from the scraping category.

3. 3

   Test in chat

   Open the chat panel and send a message. The agent will automatically use Crawl4AI when relevant.

4. 4

   Export Python code

   Click File > Export Python to get clean, runnable code with the correct imports for Crawl4AI.

Python code example

This is the code Agno Builder exports when you use Crawl4AI:

from agno.agent import Agent
from agno.models.openai import OpenAIChat
from agno.tools.crawl4ai import Crawl4aiTools

agent = Agent(
    name="Crawl4AI Agent",
    model=OpenAIChat(id="gpt-4o"),
    tools=[Crawl4aiTools()],
    instructions=["Use the crawl4ai tool to help the user."],
    markdown=True,
)

agent.print_response("Help me with a crawl4ai task")

Install with: pip install agno