Agents tagged "web-crawling"

5 results
web-crawling ×
Data & Analysis

webclaw Web Extraction Engine

Turn websites into clean Markdown, JSON, and model-ready context with a local-first Rust toolchain.

66 · Some gaps ★ 2.4k · 26d ago
Dev & Engineering

Second Brain AI Assistant

Build an agentic RAG assistant that searches, summarizes, and reasons over your personal knowledge base.

61 · Some gaps ★ 3.1k · 6mo ago
Dev & Engineering

wigolo

Local-first web search, retrieval, and crawling for coding agents.

54 · Major gaps ★ 5.5k · 22d ago
Data & Analysis

Maxun

Turn websites into structured data and reusable APIs with no-code robots.

48 · Major gaps ★ 18k · today
Dev & Engineering

Tavily Python SDK

Integrate Tavily's smart search, extraction, crawling, mapping, and research capabilities directly into your Python applications.

46 · Major gaps ★ 1.4k · 12d ago