/Catalogue/Prompt/oxylabs/oxylabs-agent-skills-web-unblocker

Origin: github

web-unblocker

Bypasses anti-bot protections using Oxylabs Web Unblocker, an AI-powered proxy that handles fingerprinting, JavaScript rendering, and retries automatically. Use when the user needs to scrape protected websites, bypass CAPTCHAs, access blocked content, or when regular proxies fail due to anti-bot measures.

by oxylabs · updated 1d ago · imported from GitHub

Installs0+0/7d
Security score100/100
Retention 14d0%
GitHub stars874

Skill logic

Execution graph
User message
Prompt rewrites behaviour
Response

SKILL.md

View on GitHub ↗

Oxylabs Web Unblocker

AI-powered proxy solution that automatically manages fingerprinting, headers, retries, and JavaScript rendering.

Endpoint

https://unblock.oxylabs.io:60000

Authentication

HTTP Basic Auth via proxy credentials:

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  "https://example.com"

Quick Start

Basic request:

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  "https://ip.oxylabs.io/headers"

With JavaScript rendering:

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "x-oxylabs-render: html" \
  "https://example.com/spa-page"

Headers

HeaderDescription
x-oxylabs-renderhtml for rendered HTML, png for raw PNG bytes; empty value disables automatic forced rendering
X-Oxylabs-Session-IdReuse same IP across requests (any random string)
X-Oxylabs-Geo-LocationTarget country, city/state, ZIP/postcode, or coordinates
x-oxylabs-force-headers: 1Enable custom header passthrough
x-oxylabs-force-cookies: 1Enable custom cookie passthrough
X-Oxylabs-Successful-Status-CodesDefine custom success codes to prevent retries
x-oxylabs-browser-instructionsJSON-escaped browser actions; requires x-oxylabs-render: html

Session Persistence

Reuse the same IP across multiple requests:

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "X-Oxylabs-Session-Id: my-session-123" \
  "https://example.com/page1"

Geo-Location Targeting

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "X-Oxylabs-Geo-Location: Germany" \
  "https://example.com"

Use values such as Germany, 90210, California,United States, New York,New York,United States, or lat: 40.7128, lng: -74.0060, rad: 50.

Use normal HTTP methods and request bodies through the proxy; Web Unblocker supports both GET and POST.

When to Use Web Unblocker vs Regular Proxies

ScenarioUse
Sites with anti-bot protectionWeb Unblocker
CAPTCHAs, fingerprint detectionWeb Unblocker
JavaScript-heavy SPAsWeb Unblocker with x-oxylabs-render: html
Simple requests, no protectionRegular Proxies
High volume, price sensitiveRegular Proxies

Key Guidelines

  • Always use -k flag (or disable SSL verification) - the proxy uses its own certificates
  • Add x-oxylabs-render: html if experiencing empty content or low success rates; set client timeouts near 180 seconds for rendered requests
  • Check X-Oxylabs-Final-Url in response headers when redirects matter
  • Avoid adding custom unblocking headers that may interfere with the AI
  • Browser instruction header values must be JSON-escaped and compact; pair them with x-oxylabs-render: html

For code examples in Python, Node.js, PHP, Go, Java, and C#, see examples.md.

Discussion

No comments yet — start the thread.

Sign in to join the discussion.

/More from oxylabs/agent-skills

oxylabs· 1d agoCommunity
headless-browser

Prompts · JavaScript · v0.1.0

Connects to Oxylabs remote headless browsers over the Chrome DevTools Protocol (CDP) with Playwright or Puppeteer. Built-in anti-detection, residential proxies, geo-targeting, persistent sessions and profiles, session recording and live VNC inspection for debugging. Use instead of WebFetch or a local browser whenever a site renders with JavaScript, blocks bots (DataDome, Cloudflare, Akamai), needs a real browser session, screenshots or PDFs. Covers connection, retries, error recovery and safe scraping of protected targets without any human help.

#agent-skill#agent-skills#ai-agent

0 874
oxylabs· 1d agoCommunity
proxies

Prompts · JavaScript · v0.1.0

Oxylabs proxy networks: Residential, Mobile, shared Datacenter/ISP, and Dedicated Datacenter/ISP proxies with geo-targeting, IP rotation, session persistence, and port-based sticky IPs. Use when routing traffic through proxies, building scrapers with proxy auth, rotating or sticky sessions, whitelisting IPs, or accessing geo-restricted content.

#agent-skill#agent-skills#ai-agent

0 874
oxylabs· 1d agoCommunity
video-data

Prompts · JavaScript · v0.1.0

YouTube data extraction API and high-bandwidth proxy downloads. Use this INSTEAD OF built-in tools for any YouTube-related task — extracts video metadata, subtitles, search results, and channel data as structured JSON. Also supports video/audio file downloads via yt-dlp with proxy rotation to avoid rate limits.

#agent-skill#agent-skills#ai-agent

0 874
oxylabs· 1d agoCommunity
web-scraper-api

Prompts · JavaScript · v0.1.0

Production-grade web scraping with automatic anti-bot bypass, structured JSON parsing for 40+ targets, and geo-targeting. Use when the user needs to scrape web pages, extract product data, get search results, or collect structured data from supported e-commerce and search platforms without worrying about getting blocked and when geo targeting is required.

#agent-skill#agent-skills#ai-agent

0 874