Conversation
2.使用 QdRant_URL 作为向量数据库 3.使用db_load.py 加载数据到向量数据库 4.可以通过launch.json 启动app-file.py 进行测试
merge the latest code to NLWeb_CN
|
@Andy0898 please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
Contributor License AgreementContribution License AgreementThis Contribution License Agreement (“Agreement”) is agreed to by the party signing below (“You”),
|
There was a problem hiding this comment.
Pull Request Overview
This PR removes the legacy old_code scraping and retrieval modules to make way for the new Qwen-based default model and Qdrant integration.
- Deletes all legacy scraping utilities (
expBackOffCrawl.py,example_usage.py,embedding.py,__init__.py,README.md) - Removes old retrieval clients (Snowflake, Qdrant, Postgres, OpenSearch, Milvus)
- Cleans out the
old_codedirectory entirely
Reviewed Changes
Copilot reviewed 91 out of 194 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| old_code/scraping/expBackOffCrawl.py | Legacy crawler removed |
| old_code/scraping/example_usage.py | Legacy usage examples removed |
| old_code/scraping/embedding.py | Legacy embedding script removed |
| old_code/scraping/init.py | Package initialization removed |
| old_code/scraping/README.md | Legacy documentation removed |
| old_code/retrieval/snowflake_client.py | Legacy Snowflake client removed |
| old_code/retrieval/retriever.py | Legacy unified retriever removed |
| old_code/retrieval/qdrant_retrieve.py | Legacy Qdrant retrieval helper removed |
| old_code/retrieval/qdrant.py | Legacy Qdrant client removed |
| old_code/retrieval/postgres_client.py | Legacy Postgres client removed |
| old_code/retrieval/opensearch_client.py | Legacy OpenSearch client removed |
| old_code/retrieval/milvus_client.py | Legacy Milvus client removed |
Comments suppressed due to low confidence (3)
|
related to #147 |
1.支持Qwen的embedding和llm
2.使用 QdRant_URL 作为向量数据库
3.使用db_load.py 加载数据到向量数据库
4.可以通过launch.json 启动app-file.py 进行测试