🕷️
Scrape
OfficialActiveby UniSkill Team
Extract full-page content from any URL.
Description
The Scrape skill renders and extracts content from any public URL, including JavaScript-heavy single-page applications. It returns clean, markdown-formatted text stripped of navigation, ads, and boilerplate — ready to be injected directly into an LLM context window. Handles bot detection mitigation and supports cookie-based page access.
API Reference
Input Parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
url | string | Yes | Target URL to scrape |
format | 'markdown' | 'text' | 'html' | No | Output format (default: markdown) |
wait_for | string | No | CSS selector to wait for before scraping |
timeout | number | No | Max wait time in ms (default: 10000) |
Response Schema
| Field | Type | Description |
|---|---|---|
content | string | Extracted page content in requested format |
title | string | Page <title> tag |
url | string | Final resolved URL (after redirects) |
word_count | number | Approximate word count of content |
Use Cases
- Ingest documentation sites into a knowledge base
- Monitor pricing pages for competitor changes
- Extract blog content for summarization pipelines
- Pull legal/compliance documents for analysis
Pricing
Cost per Request
2CR
Credits are deducted per successful API call.
Performance
Avg. Latency~1.5s
Success Rate97.8%
Integration
curl -X POST https://api.uniskill.io/v1/scrape
-H "Authorization: Bearer <LOGIN_TO_VIEW_TOKEN>"
-H "Content-Type: application/json"
-d '{"query": "example"}'