milvus | native vector database , storage for next generation AI | Search Engine library
kandi X-RAY | milvus Summary
kandi X-RAY | milvus Summary
Milvus is an open-source vector database built to power embedding similarity search and AI applications. Milvus makes unstructured data search more accessible, and provides a consistent user experience regardless of the deployment environment. Milvus 2.0 is a cloud-native vector database with storage and computation separated by design. All components in this refactored version of Milvus are stateless to enhance elasticity and flexibility. For more architecture details, see Milvus Architecture Overview. Milvus was released under the open-source Apache License 2.0 in October 2019. It is currently a graduate project under LF AI & Data Foundation.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of milvus
milvus Key Features
milvus Examples and Code Snippets
Community Discussions
Trending Discussions on milvus
QUESTION
Goal: to run this Auto Labelling Notebook on AWS SageMaker Jupyter Labs.
Kernels tried: conda_pytorch_p36
, conda_python3
, conda_amazonei_mxnet_p27
.
ANSWER
Answered 2022-Feb-03 at 09:29I would recommend to downgrade your milvus version to a version before the 2.0 release just a week ago. Here is a discussion on that topic: https://github.com/deepset-ai/haystack/issues/2081
QUESTION
I follow this link to install milvus cluster. When I execute this command "helm install my-release milvus/milvus" ,I find that a pod never started successfully. enter image description here
...ANSWER
Answered 2022-Feb-08 at 10:56Base on the milvus chart, only the etcd
has the affinity setup, but your "queryNode" also has the affinity set? You need to remove the affinity that you have set here for queryNode.
QUESTION
my-release-etcd-0 1/1 Running 0 3m58s
my-release-milvus-standalone-8587d4796d-r579n 0/1 Running 0 3m58s
my-release-minio-54fc79dbdf-gzlsh 1/1 Running 0 3m58s
[2022/01/21 07:30:00.210 +00:00] [DEBUG] [client.go:82] ["DataCoordClient, not existed in msess "] [key=datacoord] ["len of msess"=0] [2022/01/21 07:30:00.209 +00:00] [ERROR] [client.go:115] ["failed to get client address"] [error="number of datacoord is incorrect, 0"] [stack="github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).connect\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:115\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).GetGrpcClient\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:87\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).callOnce\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:177\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).ReCall\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:217\ngithub.com/milvus-io/milvus/internal/distributed/datacoord/client.(*Client).GetComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/datacoord/client/client.go:110\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates.func1\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:50\ngithub.com/milvus-io/milvus/internal/util/retry.Do\n\t/go/src/github.com/milvus-io/milvus/internal/util/retry/retry.go:34\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:74\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentHealthy\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:89\ngithub.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:183\ngithub.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).Run\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:95\ngithub.com/milvus-io/milvus/cmd/components.(*QueryCoord).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/query_coord.go:50\ngithub.com/milvus-io/milvus/cmd/roles.(*MilvusRoles).runQueryCoord.func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:178"]
...ANSWER
Answered 2022-Jan-24 at 02:55Can you deploy with docker-compose or Minikube? https://milvus.io/docs/v2.0.0/install_standalone-docker.md
Also, there is a slack channel (https://slack.milvus.io/) for the Milvus community, where a lot of active community members solve Milvus-related problems together. Please join if you need further troubleshooting. Cheers!
QUESTION
I know that when dockers installs Milvus, port 19530
is the Milvus port. I would like to know what port 19121
does and if it can be installed without mapping this port?
The dockers command to install milvus is as follows:
ANSWER
Answered 2021-Apr-22 at 09:51Both of them seem to be used: https://milvus.io/docs/v0.10.1/milvus_config.md#Section-network
QUESTION
I have a question about distance calculation in Milvus. In Milvus, I use the L2 distance calculation to query a vector for top1 and Milvus returns a distance of 9.340524. whereas the distance I get between the query vector and the return using the L2 formula is 2.156227. Why is the formula for distance calculated differently from the result returned by Milvus?
...ANSWER
Answered 2021-Apr-22 at 09:46The L2 distance is returned by FAISS, it is a square value. For example, vector1=[1,2], vector2=[0, 4], the returned L2 distance is 5.
You got L2 distance 9.340524, but it is not equal to 2.156227*2.156227, I think there must be some mistakes. You can do the steps to verify:
- create a new collection
- insert the vector that you got from the previous query(the top1 vector)
- query again
QUESTION
When calling the
drop_collection()
to delete a table, why is memory not released?How could milvus free up the memory space occupied by the deleted collection?
ANSWER
Answered 2021-Apr-02 at 09:28- Because Milvus uses LRU caching strategy, memory occupied by deleted collection doesn't be released immediately.
- Deleted data in memory could be replaced by new data when the cache is full. Otherwise, you could try to restart Milvus to free up memory.
QUESTION
I installed it by following the instruction from Milvus. But every time I installed it with docker, it failed to start.
The docker command is as followed:
...ANSWER
Answered 2021-Mar-31 at 08:29QUESTION
I have a macro which runs through several pivot tables. In this one if the option isn't available e.g. I'm trying to select the number 50, but that isn't in the pivot table data. I want it to select blank instead.
I've done an On error GoTo
This works when the code is not there, but if the code IS there it acts like it isn't and returns blank values in the filter. Can anyone tell what I've done wrong here?
ANSWER
Answered 2021-Mar-30 at 12:41If I understand your problem statement correctly, this will fix it:
QUESTION
I'm using milvus to make image similarity research in a dataset of around one million images.
The basic setting is :
- milvus in one docker
- mysql in an other docker
- milvus reads/writes in the mysql database.
Question : is it reasonable to have mysql running on a remote machine ? How many mysql requests does Milvus do for performing one research ?
If not, I guess that the most reasonable path is to copy the mysql docker with its data from the "train machine" to the "search machine". Correct ?
...ANSWER
Answered 2020-Nov-24 at 02:47It's not a good choice to run mysql on a remote machine. There are many mysql requests when milvus does search task.
——"If not, I guess that the most reasonable path is to copy the mysql docker with its data from the "train machine" to the "search machine". Correct ?"
——Yes.
QUESTION
This question is related to this one.
I'm using milvus to make image similarity research in a dataset of around one million images.
When I insert an image, Milvus returns an id which is the id of that image in the milvus database (mysql). When Milvus performs a research, it returns the id of the most similar image.
Now I have to keep track of the relation "id -> image name" to be able to present the correct image when the research is done.
What is done in the furnished examples is to store that relation in a local dictionary (or using a package like diskcache).
This works well when the training is done on the same machine as the research.
I want to train on one machine and make the inference on an other one.
My first idea would be to store the relation "id->name" in a separate table on the same mysql as the rest of milvus.
Is that a good idea ? That would cost one more mysql request after the research.
Can I make a mysql join between the milvus's table "id->vector" and my table "name->id", so that milvus returns its image id in the same time as my image name ?
...ANSWER
Answered 2020-Nov-24 at 02:26It's a good idea to store the relation "id->name" on the mysql.
But I do not recommend using mysql to store the "id->vector" relationship, because vector data is generally large and takes up more space.
By the way, it's also a good choice to use a package like diskcache to store the relation "id->name". Because it's very covenient.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install milvus
Cluster Quick Start Guide
Advanced Deployment
Check the requirements first.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page