Logo-amall

if you don't store any valuable data in your storage, please try to clear /mnt/disks/sda/qdrant. Qdrant supports storage compatibility between consecutive versions

Last active 2 months ago

22 replies

9 views

  • AN

    if you don't store any valuable data in your storage, please try to clear /mnt/disks/sda/qdrant. Qdrant supports storage compatibility between consecutive versions

  • MA

    I see, I am trying to migrate instances, so I thought instead of re indexing all of 20M records from scratch, I could just use the same qdrant_storage location. So I moved to a storage disk

  • MA

    is it possible to use the same data in my storage from an older run ? instead of reindexing everything?

  • AN

    in this case you would need to upgrade versions one by one

  • AN

    so service would apply proper migrations

  • MA

    I'm sorry, which versions would I have to upgrade? qdrant docker image? I was trying to just use :latest or v0.10.4 which was an older one.

  • MA

    do you mean version.info file in qdrant/collections?

  • AN

    no, just a version of the docker

  • MA

    so I would need to find the correct docker image for this that supports 0.4.0?

    docker run -p 6333:6333 -v /mnt/disks/sda/qdrant:/qdrant/storage qdrant/qdrant:v0.10.4

  • AN

    does v0.10.2 work?

  • MA

    no, also just tried qdrant/qdrant v0.10.1, will try a lower one

  • AN

    do you have the same error with v0.10.2?

  • MA

    yeah, I just tried v0.10.0 and I think it's trying to start up

    [2023-01-16T23:41:52.012Z INFO  segment::segment_constructor::segment_constructor_base] Migrating segment 0.3.1 -> 0.4.0
    [2023-01-16T23:41:56.810Z INFO  qdrant] Distributed mode disabled
    [2023-01-16T23:41:56.816Z INFO  qdrant::tonic] Qdrant gRPC listening on 6334
    [2023-01-16T23:41:56.821Z INFO  actix_server::builder] Starting 1 workers
    [2023-01-16T23:41:56.823Z INFO  actix_server::server] Actix runtime found; starting in Actix runtime
    
  • MA

    it's possible that it takes time to start because the storage data is huge?

  • AN

    maybe

  • AN

    old versions are slower

  • MA

    ok, I just have to try to get this to work then I can upgrade later. As I think I might also have to change the client API code

  • AN

    yes, it also changed

  • MA

    yeah, I am sure it's improved, so does that also mean I need to re upload all the vectors? or do you think the migration takes care of it

  • AN

    re-upload would be easier

  • MA

    ok I should have saved the vectors as generating them takes time.

  • MA

    thanks for helping

Last active 2 months ago

22 replies

9 views