Web Record Extractor

A client went to me and asked me to do some scraping job. He wants to get a list of data on websites he wants to get leads for his business. I created a scraper that would easy for me to scrape data on websites.

I used scrapy for web scraping and to assist I integrated an AI model for it to be more intelligent, it will just not detect html tags but also understands the context of what it is trying to scrape.

Scraped data can be exported as an excel file or CSV.

Stack:
Scrapy + Playwright -> scraping
Redis → Task queueing
SvelteKit → frontend + optional API
Gemini -> AI Model for scraping