Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform that enables large-scale scraping, searching, and structured data extraction without getting blocked. This Arcade toolkit exposes Bright Data's proxy and dataset infrastructure for crawling, search, and feed extraction.
Capabilities
- Web scraping: Fetch any public webpage and receive clean Markdown output, suitable for LLM pipelines or content processing.
- Search engine queries: Run searches against Google, Bing, or Yandex with controls for result count, country, and content type (web, images, etc.).
- Structured data feeds: Extract pre-structured JSON from 20+ source types across major platforms — including Amazon products/reviews, LinkedIn profiles, Instagram content, Facebook posts/reviews/marketplace, X posts, Zillow listings, Booking.com hotels, YouTube videos, and ZoomInfo company profiles.
Secrets
No OAuth flow is used. All authentication is handled via two required secrets passed in Arcade config.
BRIGHTDATA_API_KEY
Your Bright Data API key, used to authenticate all requests to the Bright Data platform. Obtain it by logging into your Bright Data dashboard, navigating to Account Settings → API Tokens, and generating a token. A paid or trial Bright Data account is required; free-tier access may be limited.
BRIGHTDATA_ZONE
The Bright Data zone (proxy zone or dataset zone) to route requests through. Zones are created and managed in the Bright Data dashboard under Proxies & Scraping Infrastructure. Each zone defines network type (residential, datacenter, ISP, etc.), geo-targeting, and access credentials. Create or copy the zone name from your dashboard — the value is a short alphanumeric string (e.g., residential_zone_1). Different tools may require zones configured for different purposes (e.g., a SERP zone for search, a scraping browser zone for page rendering).
For details on adding secrets to Arcade, see the Arcade secrets guide. You can manage your Arcade secrets at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |