03PRODUCTION155 sites
NexusDeals
Pakistan-focused deal aggregator. 155 sites, 25 Scrapy spiders, Redis caching, live deal feed with sub-second refresh.
— Overview
NexusDeals aggregates deals across the Pakistani e-commerce landscape. A fleet of 25 purpose-built Scrapy spiders crawls 155 sites, normalises the offers, and feeds a live deal stream.
Redis caching keeps the feed at sub-second refresh, Supabase holds the catalogue, and a Next.js front end serves the stream. Built and run as a production system.
— Highlights
- →155 sites crawled by 25 purpose-built Scrapy spiders
- →Sub-second feed refresh via Redis caching
- →FastAPI ingestion layer with Supabase storage
- →Next.js front end over a live deal stream