ching/chh-crawler
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
8 Commits 3 Branches 0 Tags
Commit Graph

7 Commits

Author SHA1 Message Date
root
7af1c6acbe refactor(crawler): use webdriver-manager and add debug logging 2025-12-04 11:35:17 +08:00
Ching L
6b5c4a3a1b refactor(crawler): replace requests with selenium for web scraping 
- Replaced requests + BeautifulSoup with Selenium WebDriver
  - Added Chrome WebDriver with headless mode support
  - Updated HTML element extraction to use Selenium locators
  - Fixed logger path to use local directory for cross-platform compatibility
  - Added proper error handling for element extraction
  - Maintained compatibility with existing Redis and Mastodon functionality
 2025-12-03 16:07:42 +08:00
Ching
c5bf60858c refactor: 修改获取短链逻辑 2024-04-17 10:18:17 +08:00
Ching
a4c7f76216 refactor: Add URL shortening functionality 2024-04-16 14:12:58 +08:00
Ching
c0533a4772 feat(crawler): 修改嘟文格式 
修改嘟文格式

Signed-off-by: Ching <loooching@gmail.com>
 2023-07-17 14:34:03 +08:00
Ching
129df366ed feat(crawler): 增加 logger，修改发送逻辑 
增加 logger，修改发送逻辑

Signed-off-by: Ching <loooching@gmail.com>
 2023-07-17 11:49:05 +08:00
Ching
5dfbfa5c57 feat(crawler): 增加 chh 爬虫函数和发嘟嘟函数 
增加 chh 爬虫函数和发嘟嘟函数

Signed-off-by: Ching <loooching@gmail.com>
 2023-07-16 21:20:04 +08:00