Web Scraping API

Extract structured data from any webpage with one call: provide the URL and a mock JSON object as the fields parameter, using natural-language placeholder values to describe the data you want (not selectors or HTML details). Example Usage Scenario: User wants to extract the product details from the Amazon product page. ``` "url": "https://www.amazon.com.au/MSI-PRO-MP341CQW-UltraWide-Compatible/dp/B09Y19TRQ2", "fields": { "monitor_name": "< The product name of the monitor. >", "brand": "< The brand or manufacturer name. >", "display_size_in_inches": "< Numeric only. >", "resolution": "< Example format: 1920x1080. >", "panel_type": "< Type of panel. >", "refresh_rate_hz": "< Numeric only. >", "aspect_ratio": "< Example format: 16:9. >", "ports": "< A comma-delimited list of available ports (e.g., HDMI, DisplayPort, etc.). >", "features": "< Key selling points or capabilities, comma-delimited (e.g., LED, Full HD, etc.). >", "price": "< Numeric price (integer or float). >", "price_currency": "< Price currency (3 character alphabetic ISO 4217). >", "review_count": "< Total number of customer reviews, numeric only. >", "average_rating": "< Float or numeric star rating (e.g., 4.3). >", "review_summary": "< A 50 words or less summary of all the written customer feedback. >" } ``` Sample response: ``` { "monitor_name": "MSI PRO MP341CQW 34" UltraWide Business Monitor", "brand": "MSI", "display_size_in_inches": 34, "resolution": "3440x1440", "panel_type": "VA", "refresh_rate_hz": 100, "aspect_ratio": "21:9", "ports": "HDMI, DisplayPort", "features": "1500R Curved, Frameless, 1ms, Tilt Compatible, HDR Ready, Built-in Speakers, VESA", "price": 299, "price_currency": "AUD", "review_count": 443, "average_rating": 4.5, "review_summary": "Customers appreciate the monitor's excellent color accuracy and immersive curved design, making it ideal for both work and entertainment." } ```

Extract all links on a webpage that match a specific description with one call: Provide the URL and a natural-language description of the kinds of links to extract. Example Usage Scenario: User wants to extract individual product URLs from an Ikea product listing page. ``` "url": "https://www.ikea.com/au/en/cat/quilt-cover-sets-10680/?page=3", "description": "individual product urls" ``` Sample response: ``` [ "https://www.ikea.com/au/en/p/strandlummer-duvet-cover-and-pillowcase-multicolour-floral-pattern-00579802/", "https://www.ikea.com/au/en/p/gullnattljus-duvet-cover-and-2-pillowcases-white-floral-pattern-60600075/", ... ] ```

Extract "Next Page" links from a paginated web page with one call: Provide the URL only. Example Usage Scenario: User wants to extract the "next page" links from a paginated Ikea product listing result. ``` "url": "https://www.ikea.com/au/en/cat/quilt-cover-sets-10680/" ``` Sample response: ``` [ "https://www.ikea.com/au/en/cat/quilt-cover-sets-10680/?page=2#products-page-2", ... ] ```

Extract relevant Google search result URLs with one call: Provide the Google domain, search query, and page number of the results. Example Usage Scenario: User wants to extract the first page of search result URLs for the search query "white sofas" on the www.google.com domain. ``` "google_domain": "www.google.com", "query": "white sofas", "page": 1 ``` Sample response: ``` [ "https://www.ashleyfurniture.com/p/maitelynn_sofa/4820238.html?google_pla=true&utm_source=google&utm_medium=unpaidShopping&region_id=564100", "https://www.livingspaces.com/pdp-isabella-sand-97-inch-sofa-320111?utm_test=spotlight&region_id=808080", ... ] ```