Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform for scraping, searching, and extracting structured data at scale without being blocked. This toolkit exposes Bright Data's proxy and scraping infrastructure through Arcade tools for crawling, search engine querying, and structured data extraction.
Capabilities
- Web scraping: Fetch any public webpage and return its content as clean Markdown, suitable for LLM ingestion or document pipelines.
- Search engine queries: Run searches against Google, Bing, or Yandex with configurable result count, search type (web/images), and country targeting.
- Structured data feeds: Extract typed, pre-parsed JSON records from major platforms — including Amazon products/reviews, LinkedIn profiles, Instagram/Facebook/X content, Zillow listings, Booking.com hotels, YouTube videos, and ZoomInfo company data.
Secrets
BRIGHTDATA_API_KEY — Your Bright Data API key, used to authenticate all requests. Obtain it from the Bright Data control panel under Account Settings → API Token. A paid or trial Bright Data account is required.
BRIGHTDATA_ZONE — The name of the Bright Data zone (proxy zone or dataset zone) your requests should route through. Zones are created and named in the Bright Data control panel under Proxies & Scraping Infrastructure. The zone type must match your use case (e.g., a Web Unlocker or Scraping Browser zone for scraping, a dataset zone for structured feeds). Copy the exact zone name string as shown in the dashboard.
For guidance on storing secrets in Arcade, see https://docs.arcade.dev/en/guides/create-tools/tool-basics/create-tool-secrets. You can manage your secrets at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |