if you don't store any valuable data in your storage, please try to clear /mnt/disks/sda/qdrant. Qdrant supports storage compatibility between consecutive versions
Last active 2 months ago
22 replies
9 views
- AN
if you don't store any valuable data in your storage, please try to clear /mnt/disks/sda/qdrant. Qdrant supports storage compatibility between consecutive versions
- MA
I see, I am trying to migrate instances, so I thought instead of re indexing all of 20M records from scratch, I could just use the same qdrant_storage location. So I moved to a storage disk
- MA
is it possible to use the same data in my storage from an older run ? instead of reindexing everything?
- AN
in this case you would need to upgrade versions one by one
- AN
so service would apply proper migrations
- MA
I'm sorry, which versions would I have to upgrade? qdrant docker image? I was trying to just use :latest or v0.10.4 which was an older one.
- MA
do you mean
version.info
file in qdrant/collections? - AN
no, just a version of the docker
- MA
so I would need to find the correct docker image for this that supports 0.4.0?
docker run -p 6333:6333 -v /mnt/disks/sda/qdrant:/qdrant/storage qdrant/qdrant:v0.10.4
- AN
does v0.10.2 work?
- MA
no, also just tried
qdrant/qdrant v0.10.1
, will try a lower one - AN
do you have the same error with v0.10.2?
- MA
yeah, I just tried v0.10.0 and I think it's trying to start up
[2023-01-16T23:41:52.012Z INFO segment::segment_constructor::segment_constructor_base] Migrating segment 0.3.1 -> 0.4.0 [2023-01-16T23:41:56.810Z INFO qdrant] Distributed mode disabled [2023-01-16T23:41:56.816Z INFO qdrant::tonic] Qdrant gRPC listening on 6334 [2023-01-16T23:41:56.821Z INFO actix_server::builder] Starting 1 workers [2023-01-16T23:41:56.823Z INFO actix_server::server] Actix runtime found; starting in Actix runtime
- MA
it's possible that it takes time to start because the storage data is huge?
- AN
maybe
- AN
old versions are slower
- MA
ok, I just have to try to get this to work then I can upgrade later. As I think I might also have to change the client API code
- AN
yes, it also changed
- MA
yeah, I am sure it's improved, so does that also mean I need to re upload all the vectors? or do you think the migration takes care of it
- AN
re-upload would be easier
- MA
ok I should have saved the vectors as generating them takes time.
- MA
thanks for helping
Last active 2 months ago
22 replies
9 views