dbaseextractor

byHello Mcdonald

make an app that can crawl the web and web directory to find and extract email leads on the internet

LandingSign UpLoginNew CrawlLeadsCrawls
Landing

Comments (0)

No comments yet. Be the first!

Architecture

dbaseextractor Service Networkv13
External
Storage
Backend (FastAPI)
Frontend
Client
schedules background task
Crawl Target Sites
MariaDB
Redis
/api/auth
register, login
/api/crawls
create crawl, list history
/api/leads
list extracted leads
/health
crawler.py
run_crawl
(background task)
extraction.py
extract_emails,
record_extracted_leads
redis_client.py
claim/release job,
progress mirror
React App
Browser
Live
Landing design preview
Landing: Read product overview
Sign Up: Open enrollment form
Sign Up: 1. Submit enrollment details
Sign Up: 2. Correct inline enrollment error
Crawls: View empty crawl list
New Crawl: 1. Open crawl form
New Crawl: 2. Submit crawl targets
New Crawl: 3. Correct invalid target error
Crawls: 4. Monitor queued crawl status
Crawls: 5. Open running crawl progress
Crawls: 6. Inspect failed crawl row
Leads: 7. Review extracted leads
Leads: 8. See empty lead state
Login: Open returning verification
Login: 1. Submit credentials
Login: 2. Re-enter incorrect credentials
Crawls: 1. Review prior crawl history
Leads: 2. Review persisted leads
Live
Landing design preview
Landing: Read product overview
Sign Up: Open enrollment form
Sign Up: 1. Submit enrollment details
Sign Up: 2. Correct inline enrollment error
Crawls: View empty crawl list
New Crawl: 1. Open crawl form
New Crawl: 2. Submit crawl targets
New Crawl: 3. Correct invalid target error
Crawls: 4. Monitor queued crawl status
Crawls: 5. Open running crawl progress
Crawls: 6. Inspect failed crawl row
Leads: 7. Review extracted leads
Leads: 8. See empty lead state
Login: Open returning verification
Login: 1. Submit credentials
Login: 2. Re-enter incorrect credentials
Crawls: 1. Review prior crawl history
Leads: 2. Review persisted leads