Milvus

Milvus is an open-source vector database that has garnered significant attention in the fields of data science and machine learning. One of its standout features lies in its robust support for vector indexing and querying. Milvus employs state-of-the-art, cutting-edge algorithms to accelerate the search process, making it exceptionally efficient at retrieving similar vectors, even when handling extensive datasets.spring-doc.cn

Prerequisites

A running Milvus instance. The following options are available:spring-doc.cn
- Milvus Standalone: Docker, Operator, Helm,DEB/RPM, Docker Compose.spring-doc.cn
- Milvus Cluster: Operator, Helm.spring-doc.cn
If required, an API key for the EmbeddingModel to generate the embeddings stored by the MilvusVectorStore.spring-doc.cn

Dependencies

Then add the Milvus VectorStore boot starter dependency to your project:spring-doc.cn

<dependency>
	<groupId>org.springframework.ai</groupId>
	<artifactId>spring-ai-milvus-store-spring-boot-starter</artifactId>
</dependency>

or to your Gradle build.gradle build file.spring-doc.cn

dependencies {
    implementation 'org.springframework.ai:spring-ai-milvus-store-spring-boot-starter'
}

Refer to the Dependency Management section to add the Spring AI BOM to your build file. Refer to the Repositories section to add Milestone and/or Snapshot Repositories to your build file.

The vector store implementation can initialize the requisite schema for you, but you must opt-in by specifying the initializeSchema boolean in the appropriate constructor or by setting …initialize-schema=true in the application.properties file.spring-doc.cn

this is a breaking change! In earlier versions of Spring AI, this schema initialization happened by default.

The Vector Store, also requires an EmbeddingModel instance to calculate embeddings for the documents. You can pick one of the available EmbeddingModel Implementations.spring-doc.cn

To connect to and configure the MilvusVectorStore, you need to provide access details for your instance. A simple configuration can either be provided via Spring Boot’s application.ymlspring-doc.cn

spring:
	ai:
		vectorstore:
			milvus:
				client:
					host: "localhost"
					port: 19530
					username: "root"
					password: "milvus"
				databaseName: "default"
				collectionName: "vector_store"
				embeddingDimension: 1536
				indexType: IVF_FLAT
				metricType: COSINE

Check the list of configuration parameters to learn about the default values and configuration options.

Now you can Auto-wire the Milvus Vector Store in your application and use itspring-doc.cn

@Autowired VectorStore vectorStore;

// ...

List <Document> documents = List.of(
    new Document("Spring AI rocks!! Spring AI rocks!! Spring AI rocks!! Spring AI rocks!! Spring AI rocks!!", Map.of("meta1", "meta1")),
    new Document("The World is Big and Salvation Lurks Around the Corner"),
    new Document("You walk forward facing the past and you turn back toward the future.", Map.of("meta2", "meta2")));

// Add the documents to Milvus Vector Store
vectorStore.add(documents);

// Retrieve documents similar to a query
List<Document> results = this.vectorStore.similaritySearch(SearchRequest.query("Spring").withTopK(5));

Manual Configuration

Instead of using the Spring Boot auto-configuration, you can manually configure the MilvusVectorStore. To add the following dependencies to your project:spring-doc.cn

<dependency>
	<groupId>org.springframework.ai</groupId>
	<artifactId>spring-ai-milvus-store</artifactId>
</dependency>

Refer to the Dependency Management section to add the Spring AI BOM to your build file.

To configure MilvusVectorStore in your application, you can use the following setup:spring-doc.cn

	@Bean
	public VectorStore vectorStore(MilvusServiceClient milvusClient, EmbeddingModel embeddingModel) {
		MilvusVectorStoreConfig config = MilvusVectorStoreConfig.builder()
			.withCollectionName("test_vector_store")
			.withDatabaseName("default")
			.withIndexType(IndexType.IVF_FLAT)
			.withMetricType(MetricType.COSINE)
			.build();
		return new MilvusVectorStore(milvusClient, embeddingModel, config);
	}

	@Bean
	public MilvusServiceClient milvusClient() {
		return new MilvusServiceClient(ConnectParam.newBuilder()
			.withAuthorization("minioadmin", "minioadmin")
			.withUri(milvusContainer.getEndpoint())
			.build());
	}

Metadata filtering

You can leverage the generic, portable metadata filters with the Milvus store.spring-doc.cn

For example, you can use either the text expression language:spring-doc.cn

vectorStore.similaritySearch(
    SearchRequest.defaults()
    .withQuery("The World")
    .withTopK(TOP_K)
    .withSimilarityThreshold(SIMILARITY_THRESHOLD)
    .withFilterExpression("author in ['john', 'jill'] && article_type == 'blog'"));

or programmatically using the Filter.Expression DSL:spring-doc.cn

FilterExpressionBuilder b = new FilterExpressionBuilder();

vectorStore.similaritySearch(SearchRequest.defaults()
    .withQuery("The World")
    .withTopK(TOP_K)
    .withSimilarityThreshold(SIMILARITY_THRESHOLD)
    .withFilterExpression(b.and(
        b.in("author","john", "jill"),
        b.eq("article_type", "blog")).build()));

These filter expressions are converted into the equivalent Milvus filters.

Milvus VectorStore properties

You can use the following properties in your Spring Boot configuration to customize the Milvus vector store.spring-doc.cn

Property	Description	Default value
spring.ai.vectorstore.milvus.database-namespring-doc.cn	The name of the Milvus database to use.spring-doc.cn	defaultspring-doc.cn
spring.ai.vectorstore.milvus.collection-namespring-doc.cn	Milvus collection name to store the vectorsspring-doc.cn	vector_storespring-doc.cn
spring.ai.vectorstore.milvus.initialize-schemaspring-doc.cn	whether to initialize Milvus' backendspring-doc.cn	falsespring-doc.cn
spring.ai.vectorstore.milvus.embedding-dimensionspring-doc.cn	The dimension of the vectors to be stored in the Milvus collection.spring-doc.cn	1536spring-doc.cn
spring.ai.vectorstore.milvus.index-typespring-doc.cn	The type of the index to be created for the Milvus collection.spring-doc.cn	IVF_FLATspring-doc.cn
spring.ai.vectorstore.milvus.metric-typespring-doc.cn	The metric type to be used for the Milvus collection.spring-doc.cn	COSINEspring-doc.cn
spring.ai.vectorstore.milvus.index-parametersspring-doc.cn	The index parameters to be used for the Milvus collection.spring-doc.cn	{"nlist":1024}spring-doc.cn
spring.ai.vectorstore.milvus.id-field-namespring-doc.cn	The ID field name for the collectionspring-doc.cn	doc_idspring-doc.cn
spring.ai.vectorstore.milvus.is-auto-idspring-doc.cn	Boolean flag to indicate if the auto-id is used for the ID fieldspring-doc.cn	falsespring-doc.cn
spring.ai.vectorstore.milvus.content-field-namespring-doc.cn	The content field name for the collectionspring-doc.cn	contentspring-doc.cn
spring.ai.vectorstore.milvus.metadata-field-namespring-doc.cn	The metadata field name for the collectionspring-doc.cn	metadataspring-doc.cn
spring.ai.vectorstore.milvus.embedding-field-namespring-doc.cn	The embedding field name for the collectionspring-doc.cn	embeddingspring-doc.cn
spring.ai.vectorstore.milvus.client.hostspring-doc.cn	The name or address of the host.spring-doc.cn	localhostspring-doc.cn
spring.ai.vectorstore.milvus.client.portspring-doc.cn	The connection port.spring-doc.cn	19530spring-doc.cn
spring.ai.vectorstore.milvus.client.urispring-doc.cn	The uri of Milvus instancespring-doc.cn	-spring-doc.cn
spring.ai.vectorstore.milvus.client.tokenspring-doc.cn	Token serving as the key for identification and authentication purposes.spring-doc.cn	-spring-doc.cn
spring.ai.vectorstore.milvus.client.connect-timeout-msspring-doc.cn	Connection timeout value of client channel. The timeout value must be greater than zero .spring-doc.cn	10000spring-doc.cn
spring.ai.vectorstore.milvus.client.keep-alive-time-msspring-doc.cn	Keep-alive time value of client channel. The keep-alive value must be greater than zero.spring-doc.cn	55000spring-doc.cn
spring.ai.vectorstore.milvus.client.keep-alive-timeout-msspring-doc.cn	The keep-alive timeout value of client channel. The timeout value must be greater than zero.spring-doc.cn	20000spring-doc.cn
spring.ai.vectorstore.milvus.client.rpc-deadline-msspring-doc.cn	Deadline for how long you are willing to wait for a reply from the server. With a deadline setting, the client will wait when encounter fast RPC fail caused by network fluctuations. The deadline value must be larger than or equal to zero.spring-doc.cn	0spring-doc.cn
spring.ai.vectorstore.milvus.client.client-key-pathspring-doc.cn	The client.key path for tls two-way authentication, only takes effect when "secure" is truespring-doc.cn	-spring-doc.cn
spring.ai.vectorstore.milvus.client.client-pem-pathspring-doc.cn	The client.pem path for tls two-way authentication, only takes effect when "secure" is truespring-doc.cn	-spring-doc.cn
spring.ai.vectorstore.milvus.client.ca-pem-pathspring-doc.cn	The ca.pem path for tls two-way authentication, only takes effect when "secure" is truespring-doc.cn	-spring-doc.cn
spring.ai.vectorstore.milvus.client.server-pem-pathspring-doc.cn	server.pem path for tls one-way authentication, only takes effect when "secure" is true.spring-doc.cn	-spring-doc.cn
spring.ai.vectorstore.milvus.client.server-namespring-doc.cn	Sets the target name override for SSL host name checking, only takes effect when "secure" is True. Note: this value is passed to grpc.ssl_target_name_overridespring-doc.cn	-spring-doc.cn
spring.ai.vectorstore.milvus.client.securespring-doc.cn	Secure the authorization for this connection, set to True to enable TLS.spring-doc.cn	falsespring-doc.cn
spring.ai.vectorstore.milvus.client.idle-timeout-msspring-doc.cn	Idle timeout value of client channel. The timeout value must be larger than zero.spring-doc.cn	24hspring-doc.cn
spring.ai.vectorstore.milvus.client.usernamespring-doc.cn	The username and password for this connection.spring-doc.cn	rootspring-doc.cn
spring.ai.vectorstore.milvus.client.passwordspring-doc.cn	The password for this connection.spring-doc.cn	milvusspring-doc.cn

Property

Description

Default value

spring.ai.vectorstore.milvus.database-namespring-doc.cn

The name of the Milvus database to use.spring-doc.cn

defaultspring-doc.cn

spring.ai.vectorstore.milvus.collection-namespring-doc.cn

Milvus collection name to store the vectorsspring-doc.cn

vector_storespring-doc.cn

spring.ai.vectorstore.milvus.initialize-schemaspring-doc.cn

whether to initialize Milvus' backendspring-doc.cn

falsespring-doc.cn

spring.ai.vectorstore.milvus.embedding-dimensionspring-doc.cn

The dimension of the vectors to be stored in the Milvus collection.spring-doc.cn

1536spring-doc.cn

spring.ai.vectorstore.milvus.index-typespring-doc.cn

The type of the index to be created for the Milvus collection.spring-doc.cn

IVF_FLATspring-doc.cn

spring.ai.vectorstore.milvus.metric-typespring-doc.cn

The metric type to be used for the Milvus collection.spring-doc.cn

COSINEspring-doc.cn

spring.ai.vectorstore.milvus.index-parametersspring-doc.cn

The index parameters to be used for the Milvus collection.spring-doc.cn

{"nlist":1024}spring-doc.cn

spring.ai.vectorstore.milvus.id-field-namespring-doc.cn

The ID field name for the collectionspring-doc.cn

doc_idspring-doc.cn

spring.ai.vectorstore.milvus.is-auto-idspring-doc.cn

Boolean flag to indicate if the auto-id is used for the ID fieldspring-doc.cn

falsespring-doc.cn

spring.ai.vectorstore.milvus.content-field-namespring-doc.cn

The content field name for the collectionspring-doc.cn

contentspring-doc.cn

spring.ai.vectorstore.milvus.metadata-field-namespring-doc.cn

The metadata field name for the collectionspring-doc.cn

metadataspring-doc.cn

spring.ai.vectorstore.milvus.embedding-field-namespring-doc.cn

The embedding field name for the collectionspring-doc.cn

embeddingspring-doc.cn

spring.ai.vectorstore.milvus.client.hostspring-doc.cn

The name or address of the host.spring-doc.cn

localhostspring-doc.cn

spring.ai.vectorstore.milvus.client.portspring-doc.cn

The connection port.spring-doc.cn

19530spring-doc.cn

spring.ai.vectorstore.milvus.client.urispring-doc.cn

The uri of Milvus instancespring-doc.cn

-spring-doc.cn

spring.ai.vectorstore.milvus.client.tokenspring-doc.cn

Token serving as the key for identification and authentication purposes.spring-doc.cn

-spring-doc.cn

spring.ai.vectorstore.milvus.client.connect-timeout-msspring-doc.cn

Connection timeout value of client channel. The timeout value must be greater than zero .spring-doc.cn

10000spring-doc.cn

spring.ai.vectorstore.milvus.client.keep-alive-time-msspring-doc.cn

Keep-alive time value of client channel. The keep-alive value must be greater than zero.spring-doc.cn

55000spring-doc.cn

spring.ai.vectorstore.milvus.client.keep-alive-timeout-msspring-doc.cn

The keep-alive timeout value of client channel. The timeout value must be greater than zero.spring-doc.cn

20000spring-doc.cn

spring.ai.vectorstore.milvus.client.rpc-deadline-msspring-doc.cn

Deadline for how long you are willing to wait for a reply from the server. With a deadline setting, the client will wait when encounter fast RPC fail caused by network fluctuations. The deadline value must be larger than or equal to zero.spring-doc.cn

0spring-doc.cn

spring.ai.vectorstore.milvus.client.client-key-pathspring-doc.cn

The client.key path for tls two-way authentication, only takes effect when "secure" is truespring-doc.cn

-spring-doc.cn

spring.ai.vectorstore.milvus.client.client-pem-pathspring-doc.cn

The client.pem path for tls two-way authentication, only takes effect when "secure" is truespring-doc.cn

-spring-doc.cn

spring.ai.vectorstore.milvus.client.ca-pem-pathspring-doc.cn

The ca.pem path for tls two-way authentication, only takes effect when "secure" is truespring-doc.cn

-spring-doc.cn

spring.ai.vectorstore.milvus.client.server-pem-pathspring-doc.cn

server.pem path for tls one-way authentication, only takes effect when "secure" is true.spring-doc.cn

-spring-doc.cn

spring.ai.vectorstore.milvus.client.server-namespring-doc.cn

Sets the target name override for SSL host name checking, only takes effect when "secure" is True. Note: this value is passed to grpc.ssl_target_name_overridespring-doc.cn

-spring-doc.cn

spring.ai.vectorstore.milvus.client.securespring-doc.cn

Secure the authorization for this connection, set to True to enable TLS.spring-doc.cn

falsespring-doc.cn

spring.ai.vectorstore.milvus.client.idle-timeout-msspring-doc.cn

Idle timeout value of client channel. The timeout value must be larger than zero.spring-doc.cn

24hspring-doc.cn

spring.ai.vectorstore.milvus.client.usernamespring-doc.cn

The username and password for this connection.spring-doc.cn

rootspring-doc.cn

spring.ai.vectorstore.milvus.client.passwordspring-doc.cn

The password for this connection.spring-doc.cn

milvusspring-doc.cn

Starting Milvus Store

From within the src/test/resources/ folder run:spring-doc.cn

docker-compose up

To clean the environment:spring-doc.cn

docker-compose down; rm -Rf ./volumes

Then connect to the vector store on http://localhost:19530 or for management http://localhost:9001 (user: minioadmin, pass: minioadmin)spring-doc.cn

Troubleshooting

If Docker complains about resources, then execute:spring-doc.cn

docker system prune --all --force --volumes