Skip to content

comdotharman0/JJSR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

JJSR 🚀

A Lightweight,Open-Source, Mobile-Optimized Web Search Engine

JJSR is a custom-built web crawler and indexer designed for efficiency and privacy. It is developed entirely within a mobile environment (Termux), proving that you don't need a high-end workstation to build powerful data tools.


🌟 Key Features

  • Ethical Crawling: Uses robotparser to strictly follow robots.txt rules and honor website owner preferences.
  • Resource Management: Designed to operate within a daily limit of 500 URLs to ensure stability on mobile hardware.
  • Automated Indexing: Features a custom cycle that refreshes data every 26 hours.
  • SQLite Backend: A fast, serverless database that stores titles, meta-descriptions, and page content.
  • Simple Flask UI: A clean, no-bloat interface for querying your local index.

🛠️ Technology Stack

  • Language: Python 3.x
  • Web Framework: Flask
  • Parsing: BeautifulSoup4 & Requests
  • Database: SQLite3
  • Dev Environment: Termux (Android)

📁 Project Structure

JJSR/jjsr/src/jjsr/
├── __init__.py          # Flask Web Interface
├── crawler.py      # The Indexing Engine
├── db.py     # Schema and DB initialization
├── search_data.db   # SQLite Database (Auto-generated)
└── README.md       # Project Documentation

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors