Skip to content

amintikk/PepperDealsScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Pepper Deals Scraper logo

Pepper Deals Scraper

Multi-country Python scraper for Pepper deal communities.
Chollometro, HotUKDeals, MyDealz, Dealabs, Pepper NL, Pepper PL, Preisjaeger, Pepperdeals, and Promodescuentos.

Python Sites Exports Unofficial

Languages

English | Español | Deutsch | Français | Nederlands | Polski | Svenska

Overview

pepper-deals-scraper is an unofficial command-line scraper for deal listings, deal details, search results, JSON/CSV exports, and deal images from the main Pepper-based deal communities.

The Python module is named pepper_deals_scraper.

Supported Sites

Market Site Code Default Home Hot New Top Detail
Spain Chollometro es hot Yes Yes Yes No Yes
United Kingdom HotUKDeals uk hot Yes Yes Yes Yes Yes
Germany MyDealz de hot Yes Yes Yes No Yes
France Dealabs fr hot Yes Yes Yes Yes Yes
Netherlands Pepper NL nl hot Yes Yes Yes No Yes
Poland Pepper PL pl hot Yes Yes Yes No Yes
Austria Preisjaeger at hot Yes Yes Yes No Yes
Sweden Pepperdeals SE se new Yes No Yes No Yes
United States Pepper US us new Yes Yes Yes Limited Yes
Mexico Promodescuentos mx hot Yes Yes Yes No Yes

No means the public website does not expose a matching section/feed for that sort.

Features

Feature Status Notes
Deal listings Yes Site-aware feeds: home, hot, new, top
Search Yes Plain text search
Deal detail Yes By deal ID or URL
Detail enrichment Yes Optional extra detail request per listing deal
JSON export Yes Structured output
CSV export Yes Spreadsheet-friendly output
Image download Yes Original, large, medium, thumb, tiny

Install

py -3 -m venv .venv
.venv\Scripts\activate
pip install -r requirements.txt

On macOS/Linux:

python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt

Quick Use

# Default feed for the selected site
py -3 -m pepper_deals_scraper --site es --pages 1

# New deals from HotUKDeals
py -3 -m pepper_deals_scraper --site uk --sort-by new --pages 1

# Top/hottest feed where the website exposes it
py -3 -m pepper_deals_scraper --site fr --sort-by top --pages 1

# Search deals
py -3 -m pepper_deals_scraper --site de --search "lego star wars"

# One deal by ID
py -3 -m pepper_deals_scraper --site es --detail 1930684

# Export listing results
py -3 -m pepper_deals_scraper --site mx --pages 3 --json deals.json --csv deals.csv

# Export listings with full detail data
py -3 -m pepper_deals_scraper --site uk --pages 1 --enrich --json deals.json

# Download deal images
py -3 -m pepper_deals_scraper --site es --detail 1930684 --download-images images --image-sizes thumb,medium

# Use a proxy for all requests
py -3 -m pepper_deals_scraper --site es --proxy http://host:port --pages 1

Options

Option Example Description
--site --site uk Site code: es, uk, de, fr, nl, pl, at, se, us, mx
--sort-by --sort-by new Sort mode: home, hot, new, top
--pages --pages 3 Number of listing pages
--search --search "monitor" Search term
--detail --detail 1930684 Fetch one deal by ID or URL
--enrich --enrich Fetch full detail data for every listing item
--json --json deals.json Save JSON output
--csv --csv deals.csv Save CSV output
--download-images --download-images images Download deal images
--image-sizes --image-sizes thumb,medium Image sizes to download
--proxy --proxy http://host:port Proxy for HTTP and HTTPS requests
--http-proxy --http-proxy http://host:port Proxy for HTTP requests only
--https-proxy --https-proxy http://host:port Proxy for HTTPS requests only

Sort Aliases

Alias Uses
popular hot
hottest top
highlights home

Output

Area Fields
Deal ID, title, URL, link, price, temperature, status, voucher code
Merchant ID, name, URL name, avatar
User ID, username, avatar
Categories ID, name, URL name
Images Main image, gallery images, description images, multiple sizes
Dates Published, created, updated, hot, picked, start/end
Metadata Trending, pinned, locked, monetisation, disclaimers, SEO metadata

Search Keywords

Chollometro scraper, HotUKDeals scraper, MyDealz scraper, Dealabs scraper, Pepper deals scraper, Promodescuentos scraper, Preisjaeger scraper, Pepperdeals scraper, deal scraper Python, discounts scraper, offers scraper, JSON CSV deal export.

Recommended GitHub Topics

chollometro hotukdeals mydealz dealabs promodescuentos pepper deals scraper python json csv

Notes

  • This is an unofficial project and is not affiliated with Pepper, Chollometro, HotUKDeals, MyDealz, Dealabs, Preisjaeger, Pepperdeals, or Promodescuentos.
  • Public websites change. The scraper may need updates if a supported site changes its HTML, embedded data, or public feeds.
  • Use sensible delays and avoid aggressive scraping.
  • top is only exposed where the public website has a real HOTTEST/top feed. Pepper US supports it, but the feed can be very small.
  • --enrich makes one extra detail request per deal, so it is slower than a plain listing scrape.

Releases

Packages

Contributors

Languages