A collection of web scraping scripts using BeautifulSoup and Selenium in Python.
beautifulSoup.py- Basic HTML parsing with BeautifulSoup using local HTML fileSelenium.py- Selenium WebDriver setup and basic usageLiveSite/sol.py- Live website scraping example (Alibaba sourcing data)index.html- Sample HTML file for testing BeautifulSoup
pip install beautifulsoup4 lxml requests selenium pandasChrome Driver: Download from Chrome for Developers (version 138.0.7204.94 or compatible with your Chrome version)
-
BeautifulSoup (Local HTML):
python beautifulSoup.py
-
Selenium (Google):
python Selenium.py
-
Live Site Scraping:
python LiveSite/sol.py
- Ensure Chrome Driver is in your PATH or update the path in scripts
- Install required packages using pip
- Run scripts individually based on your needs
Basic web scraping examples for learning purposes