Cloud storage

PAR Scrape is a web scraping tool

PAR Scrape is a versatile web scraping tool with options for Selenium or Playwright, featuring AI-powered data extraction and formatting.

This is free and open source software.

Features include:

  • Web scraping using Playwright or Selenium.
  • AI-powered data extraction and formatting.
  • Can be used to crawl and extract clean markdown without AI.
  • Supports multiple output formats (JSON, Excel, CSV, Markdown).
  • Customizable field extraction.
  • Token usage and cost estimation.
  • Prompt cache for Anthropic provider.
  • Uses the devloper’s PAR AI Core.
  • Crawling currently comes in 3 modes:
    • Single page which is the default.
    • Single level which will crawl all links on the first page and add them to the queue. Links from any pages after the first are not added to the queue.
    • Domain which will crawl all links on all pages as long as they below to the same top level domain (TLD).

Website: github.com/paulrobello/par_scrape
Support:
Developer: Paul Robello
License: MIT License

PAR Scrape tool

PAR Scrape is written in Python. Learn Python with our recommended free books and free tutorials.


Explore Linux

Best Free and Open Source Software - A huge collection of recommended free and open source software covering every major category.
In-depth Linux Software Reviews - Detailed assessments of Linux software covering features, usability and overall quality.

The Big List of Active Linux Distros - An extensive collection of actively developed Linux distributions.
Open Source Alternatives - Alternatives to software and services from Google, Microsoft, Apple, Adobe, IBM, Autodesk, Oracle and others.
Essential Linux System Tools - Indispensable utilities for monitoring, maintaining and managing Linux systems.
Linux Productivity Tools - Useful utilities for improving productivity and streamlining everyday tasks.
Alternatives to Popular CLI Tools - Modern alternatives to familiar command-line utilities supplied with Linux systems.
Awesome Free Linux Game Tools - Tools, utilities and companion software that improve gaming on Linux.
Machine Learning on Linux - Machine learning and deep learning software, self-hosted applications and practical tools.
Saving Money with Linux - Practical ways to reduce electricity consumption and lower computing costs with Linux.
Linux Candy - Fun, entertaining and sometimes delightfully quirky software from the lighter side of Linux.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted