Web Scraper API
Fetch raw HTML from any website with full JavaScript rendering and advanced proxy support. Bypass bot detection and scrape dynamic content reliably.
API Version
v3.0 enables smart defaults — auto_proxy, auto_render, and retry are all on by default. The best proxy and rendering strategy is chosen automatically for each target domain.
Endpoint
HTTP
GET https://opengraph.io/api/3.0/scrape/{encoded_url}?app_id=YOUR_APP_IDParameters
Path Parameters
| Parameter | Type | Description |
|---|---|---|
| encoded_url | string | Required. URL-encoded target URL |
Query Parameters
| Parameter | Type | Default | Description |
|---|---|---|---|
| app_id | string | - | Required. Your API key |
| full_render | boolean | false | Enable JavaScript rendering (required for SPAs) |
| cache_ok | boolean | true | Allow cached results |
| use_proxy | boolean | false | Use standard datacenter proxy |
| use_premium | boolean | false | Use residential proxy (better for protected sites) |
| use_superior | boolean | false | Use mobile proxy (best for heavily protected sites) |
| accept_lang | string | en-US | Language header for localized content |
| auto_proxy | boolean | true | Automatically select optimal proxy |
| auto_render | boolean | true | Automatically enable JS rendering when needed |
| retry | boolean | true | Auto-retry failed requests with proxy escalation |
Example Request
curl "https://opengraph.io/api/3.0/scrape/https%3A%2F%2Fexample.com?app_id=YOUR_APP_ID"Example Response
Response
{
"htmlContent": "<!DOCTYPE html><html>...</html>",
"requestInfo": {
"redirects": 0,
"host": "example.com",
"responseCode": 200,
"responseContentType": "text/html"
}
}Proxy Options
For sites with bot protection, use our proxy options to bypass blocks. See the Proxy Options guide for details on proxy types and credit costs.
Use Cases
- Content aggregation and monitoring
- Market research and competitive analysis
- Data validation and verification
- SEO auditing
- Price monitoring
MCP Tool
This endpoint is available as the Scrape tool in the OpenGraph MCP Server. Your AI assistant can scrape pages directly without writing any code.