LanceDB requires data to train the index - How does it work with cocoindex flow? #1348
|
https://github.com/cocoindex-io/cocoindex/blob/main/examples/text_embedding_lancedb/main.py - great question from user discussion |
Answered by
georgeh0
Dec 2, 2025
Replies: 1 comment
|
There is a limitation from LanceDB side. LanceDB requires at least 256 rows to be there before it can build the index (see this issue for more details). So currently we cannot enable the index when the table is empty, but can enable it after it's populated with >=256 rows. I created #1355. After the target table has at least 256 rows, users can change a single line in the |
0 replies
Answer selected by
badmonster0
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
There is a limitation from LanceDB side. LanceDB requires at least 256 rows to be there before it can build the index (see this issue for more details).
So currently we cannot enable the index when the table is empty, but can enable it after it's populated with >=256 rows.
I created #1355. After the target table has at least 256 rows, users can change a single line in the
.envfile to enable the index since the next cocoindex run.