milvus | native vector database , storage for next generation AI | Search Engine library

 by   milvus-io Go Version: v2.2.10 License: Apache-2.0

kandi X-RAY | milvus Summary

kandi X-RAY | milvus Summary

milvus is a Go library typically used in Database, Search Engine applications. milvus has no bugs, it has no vulnerabilities, it has a Permissive License and it has medium support. You can download it from GitHub.

Milvus is an open-source vector database built to power embedding similarity search and AI applications. Milvus makes unstructured data search more accessible, and provides a consistent user experience regardless of the deployment environment. Milvus 2.0 is a cloud-native vector database with storage and computation separated by design. All components in this refactored version of Milvus are stateless to enhance elasticity and flexibility. For more architecture details, see Milvus Architecture Overview. Milvus was released under the open-source Apache License 2.0 in October 2019. It is currently a graduate project under LF AI & Data Foundation.
Support
    Quality
      Security
        License
          Reuse

            kandi-support Support

              milvus has a medium active ecosystem.
              It has 19923 star(s) with 2258 fork(s). There are 330 watchers for this library.
              There were 10 major release(s) in the last 12 months.
              There are 522 open issues and 7487 have been closed. On average issues are closed in 28 days. There are 83 open pull requests and 0 closed requests.
              It has a neutral sentiment in the developer community.
              The latest version of milvus is v2.2.10

            kandi-Quality Quality

              milvus has 0 bugs and 0 code smells.

            kandi-Security Security

              milvus has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
              milvus code analysis shows 0 unresolved vulnerabilities.
              There are 0 security hotspots that need review.

            kandi-License License

              milvus is licensed under the Apache-2.0 License. This license is Permissive.
              Permissive licenses have the least restrictions, and you can use them in most projects.

            kandi-Reuse Reuse

              milvus releases are available to install and integrate.
              Installation instructions, examples and code snippets are available.

            Top functions reviewed by kandi - BETA

            kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
            Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of milvus
            Get all kandi verified functions for this library.

            milvus Key Features

            No Key Features are available at this moment for milvus.

            milvus Examples and Code Snippets

            No Code Snippets are available at this moment for milvus.

            Community Discussions

            QUESTION

            ModuleNotFoundError: No module named 'milvus'
            Asked 2022-Feb-15 at 19:23

            Goal: to run this Auto Labelling Notebook on AWS SageMaker Jupyter Labs.

            Kernels tried: conda_pytorch_p36, conda_python3, conda_amazonei_mxnet_p27.

            ...

            ANSWER

            Answered 2022-Feb-03 at 09:29

            I would recommend to downgrade your milvus version to a version before the 2.0 release just a week ago. Here is a discussion on that topic: https://github.com/deepset-ai/haystack/issues/2081

            Source https://stackoverflow.com/questions/70954157

            QUESTION

            When I start Milvus Cluster by helm, I encounter this error "0/4 nodes are available: 4 node(s) didn't satisfy existing pods anti-affinity rules."
            Asked 2022-Feb-08 at 10:56

            I follow this link to install milvus cluster. When I execute this command "helm install my-release milvus/milvus" ,I find that a pod never started successfully. enter image description here

            ...

            ANSWER

            Answered 2022-Feb-08 at 10:56

            Base on the milvus chart, only the etcd has the affinity setup, but your "queryNode" also has the affinity set? You need to remove the affinity that you have set here for queryNode.

            Source https://stackoverflow.com/questions/71031760

            QUESTION

            I am not able to install Mlivus standalone through Helm
            Asked 2022-Feb-02 at 17:20

            my-release-etcd-0 1/1 Running 0 3m58s

            my-release-milvus-standalone-8587d4796d-r579n 0/1 Running 0 3m58s

            my-release-minio-54fc79dbdf-gzlsh 1/1 Running 0 3m58s

            [2022/01/21 07:30:00.210 +00:00] [DEBUG] [client.go:82] ["DataCoordClient, not existed in msess "] [key=datacoord] ["len of msess"=0] [2022/01/21 07:30:00.209 +00:00] [ERROR] [client.go:115] ["failed to get client address"] [error="number of datacoord is incorrect, 0"] [stack="github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).connect\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:115\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).GetGrpcClient\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:87\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).callOnce\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:177\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).ReCall\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:217\ngithub.com/milvus-io/milvus/internal/distributed/datacoord/client.(*Client).GetComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/datacoord/client/client.go:110\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates.func1\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:50\ngithub.com/milvus-io/milvus/internal/util/retry.Do\n\t/go/src/github.com/milvus-io/milvus/internal/util/retry/retry.go:34\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:74\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentHealthy\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:89\ngithub.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:183\ngithub.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).Run\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:95\ngithub.com/milvus-io/milvus/cmd/components.(*QueryCoord).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/query_coord.go:50\ngithub.com/milvus-io/milvus/cmd/roles.(*MilvusRoles).runQueryCoord.func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:178"]

            ...

            ANSWER

            Answered 2022-Jan-24 at 02:55

            Can you deploy with docker-compose or Minikube? https://milvus.io/docs/v2.0.0/install_standalone-docker.md

            Also, there is a slack channel (https://slack.milvus.io/) for the Milvus community, where a lot of active community members solve Milvus-related problems together. Please join if you need further troubleshooting. Cheers!

            Source https://stackoverflow.com/questions/70828416

            QUESTION

            A question about the Milvus docker installation port
            Asked 2021-Apr-22 at 09:51

            I know that when dockers installs Milvus, port 19530 is the Milvus port. I would like to know what port 19121 does and if it can be installed without mapping this port? The dockers command to install milvus is as follows:

            ...

            ANSWER

            Answered 2021-Apr-22 at 09:51

            QUESTION

            A question about Milvus distance calculation
            Asked 2021-Apr-22 at 09:46

            I have a question about distance calculation in Milvus. In Milvus, I use the L2 distance calculation to query a vector for top1 and Milvus returns a distance of 9.340524. whereas the distance I get between the query vector and the return using the L2 formula is 2.156227. Why is the formula for distance calculated differently from the result returned by Milvus?

            ...

            ANSWER

            Answered 2021-Apr-22 at 09:46

            The L2 distance is returned by FAISS, it is a square value. For example, vector1=[1,2], vector2=[0, 4], the returned L2 distance is 5.

            You got L2 distance 9.340524, but it is not equal to 2.156227*2.156227, I think there must be some mistakes. You can do the steps to verify:

            1. create a new collection
            2. insert the vector that you got from the previous query(the top1 vector)
            3. query again

            Source https://stackoverflow.com/questions/67207898

            QUESTION

            How can milvus release deleted collection in memory?
            Asked 2021-Apr-02 at 09:28
            1. When calling the drop_collection() to delete a table, why is memory not released?

            2. How could milvus free up the memory space occupied by the deleted collection?

            ...

            ANSWER

            Answered 2021-Apr-02 at 09:28
            • Because Milvus uses LRU caching strategy, memory occupied by deleted collection doesn't be released immediately.
            • Deleted data in memory could be replaced by new data when the cache is full. Otherwise, you could try to restart Milvus to free up memory.

            Source https://stackoverflow.com/questions/66915264

            QUESTION

            ubuntu16.04 system keeps reporting errors when installing milvus CPU version
            Asked 2021-Mar-31 at 08:29

            I installed it by following the instruction from Milvus. But every time I installed it with docker, it failed to start.

            The docker command is as followed:

            ...

            ANSWER

            Answered 2021-Mar-31 at 08:29

            Many factors might cause this problem. First, make sure that your machine supports these instruction sets.

            Source https://stackoverflow.com/questions/66880865

            QUESTION

            On error VBA line activities where there is not an error
            Asked 2021-Mar-30 at 12:41

            I have a macro which runs through several pivot tables. In this one if the option isn't available e.g. I'm trying to select the number 50, but that isn't in the pivot table data. I want it to select blank instead. I've done an On error GoTo This works when the code is not there, but if the code IS there it acts like it isn't and returns blank values in the filter. Can anyone tell what I've done wrong here?

            ...

            ANSWER

            Answered 2021-Mar-30 at 12:41

            If I understand your problem statement correctly, this will fix it:

            Source https://stackoverflow.com/questions/66869947

            QUESTION

            Milvus : train and search on separte machines
            Asked 2020-Nov-24 at 02:47

            I'm using milvus to make image similarity research in a dataset of around one million images.

            The basic setting is :

            • milvus in one docker
            • mysql in an other docker
            • milvus reads/writes in the mysql database.

            Question : is it reasonable to have mysql running on a remote machine ? How many mysql requests does Milvus do for performing one research ?

            If not, I guess that the most reasonable path is to copy the mysql docker with its data from the "train machine" to the "search machine". Correct ?

            ...

            ANSWER

            Answered 2020-Nov-24 at 02:47

            It's not a good choice to run mysql on a remote machine. There are many mysql requests when milvus does search task.

            ——"If not, I guess that the most reasonable path is to copy the mysql docker with its data from the "train machine" to the "search machine". Correct ?"

            ——Yes.

            Source https://stackoverflow.com/questions/64940901

            QUESTION

            Milvus : where to store the "id to data" relation?
            Asked 2020-Nov-24 at 02:26

            This question is related to this one.

            I'm using milvus to make image similarity research in a dataset of around one million images.

            When I insert an image, Milvus returns an id which is the id of that image in the milvus database (mysql). When Milvus performs a research, it returns the id of the most similar image.

            Now I have to keep track of the relation "id -> image name" to be able to present the correct image when the research is done.

            What is done in the furnished examples is to store that relation in a local dictionary (or using a package like diskcache).

            This works well when the training is done on the same machine as the research.

            I want to train on one machine and make the inference on an other one.

            My first idea would be to store the relation "id->name" in a separate table on the same mysql as the rest of milvus.

            Is that a good idea ? That would cost one more mysql request after the research.

            Can I make a mysql join between the milvus's table "id->vector" and my table "name->id", so that milvus returns its image id in the same time as my image name ?

            ...

            ANSWER

            Answered 2020-Nov-24 at 02:26

            It's a good idea to store the relation "id->name" on the mysql.

            But I do not recommend using mysql to store the "id->vector" relationship, because vector data is generally large and takes up more space.

            By the way, it's also a good choice to use a package like diskcache to store the relation "id->name". Because it's very covenient.

            Source https://stackoverflow.com/questions/64941015

            Community Discussions, Code Snippets contain sources that include Stack Exchange Network

            Vulnerabilities

            No vulnerabilities reported

            Install milvus

            Standalone Quick Start Guide
            Cluster Quick Start Guide
            Advanced Deployment
            Check the requirements first.

            Support

            Contributions to Milvus are welcome from everyone. See Guidelines for Contributing for details on submitting patches and the contribution workflow. See our community repository to learn about our governance and access more community resources.
            Find more information at:

            Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items

            Find more libraries

            Stay Updated

            Subscribe to our newsletter for trending solutions and developer bootcamps

            Agree to Sign up and Terms & Conditions

            Share this Page

            share link