Greasy Fork 镜像站

Google SERP Scraper

Scrape Google SERP results. View, filter, and export (JSON, CSV, MD, URLs). Configurable.

2025-05-16 기준 버전입니다. 최신 버전을 확인하세요.

이 스크립트 설치 ?

질문 또는 리뷰 남기기, 또는 스크립트 신고하기.

작성자

StonedKhajiit

평점

0 0 0

버전

0.1.0

생성일

2025-05-16

갱신일

2025-05-16

크기

185KB

라이선스

MIT

적용 사이트

google.com
google.net
google.org
google.de
google.co.uk

Extract structured data from Google Search Engine Results Pages (SERPs) with a straightforward and configurable user interface. This script allows you to manually scrape search results, view them in JSON or a filterable list with a preview, and export them in various formats (JSON, CSV, Markdown, URLs).

Features:

Manual Scraping: Click a button to scrape results from the currently loaded Google SERP.
Floating UI Panel: A draggable, minimizable, and maximizable panel for all operations.
Dual View Modes:
- JSON View: Inspect raw scraped data.
- List View: Browse results in a list with an integrated preview pane for details.
Filtering: Filter scraped results by keywords across multiple fields.
Multiple Export Options:
- Copy to Clipboard: JSON, URL List, Markdown.
- Download as File: JSON, CSV, URL List (.txt), Markdown (.md).
Configurable Settings:
- Custom Title Selector: Define your own CSS selector for result titles, with a built-in Selector Tester to verify and preview matches directly on the page.
- Data Fetching Control: Choose which data fields to extract (Title, URL, Site Name, Breadcrumbs, Description, Highlighted Keywords, Date Info).
- Export Field Customization: Select specific fields to include in CSV and Markdown exports.
- UI Preferences: Dark Mode, show/hide preview pane, filter area, download actions.
- Highlighting Options: Temporarily highlight scraped items on the page or highlight a selected list item on the page.
- Debug mode and output options.
Context Menu for List Items: Right-click on a result in the list view for quick actions (copy specific fields, open URL, highlight on page).
URL Decoding: Automatically decodes URLs, including Punycode for internationalized domain names (IDNs).
Date Parsing: Attempts to parse various date formats (relative and absolute) from result descriptions.

How to Use:

After installing the script, a floating panel will appear on Google search results pages.
Click the "Scrape Page" button to start scraping the currently visible results.
Use the filter input, view toggle buttons, and copy/download links to manage your data.
Click the gear icon (⚙️) in the panel's title bar to access detailed settings.

Important Notes:

This script does not automatically handle infinite scroll or paginated results. Scraping is performed on the content currently loaded on the page.
To scrape multiple pages or a long infinite scroll page at once:
1. It is strongly recommended to use a browser extension like Infy Scroll (https://github.com/sixcious/infy-scroll) to automatically load all desired results onto a single page first.
2. Once all content is loaded by Infy Scroll (or manually scrolled/navigated), then use this script's "Scrape Page" button to process all the loaded results.
Google's page structure can change, which might affect the script's ability to find results. If the script stops working correctly, try adjusting the "Title Element Selector" in the settings or report an issue.
This script is primarily tested and optimized for Google search sites in English, Japanese, and Traditional Chinese, especially concerning date parsing and some internal text indicators (like "Related Questions"). While it may work on other languages/regions, full functionality is not guaranteed.

Acknowledgements / Third-Party Code

This script includes an implementation of Punycode.js for decoding internationalized domain names (IDNs). The original Punycode.js library was created by Mathias Bynens and is typically available under the MIT license. You can find more information about the original library at https://github.com/mathiasbynens/punycode.js.

扫码关注【爱吃馍】