Running KernelMemory with services provisioned by Aspire

[v-croft]

I have looked at and implemented Aspire based launching of KernelMemory but the approach in the examples seems to assume that dependent services (Azure Storage Blobs/Queues, Qdrant/AzureAISearch, etc.) are already provisioned. There does not seem to be a mechanism to reference a service that is provisioned by Aspire (which is the key value of Aspire, i.e. to provision a complete environment and support dynamic linkage between provisioned services).

What I mean is to configure and consume Kernel Memory in this fashion:

// AppHost/program.cs 
// ...

// Dependency provisioning
var storage = builder.AddAzureStorage("storage");
var blobs = storage.AddBlobs("blobs");
var queues =storage.AddQueues("queues");

var qdrant = builder.AddQdrant("qdrant")
    .WithHttpEndpoint(targetPort: 6333, name: "qdrant");

// Kernel Memory provisioning
var kernelMemoryService = builder.AddContainer("kernel-memory", "kernelmemory/service", tag: "latest")
    .WaitFor(qdrant)
   .WithEnvironment("Add environment config for other services, etc.")
    .WithReference(blobs)
    .WithReference(queues)
    .WithReference(qdrant);

// Find Kernel Memory endpoint
var kernelMemoryEndpoint = kernelMemoryService.GetEndpoint("kernelmemoryservice");

// Api provisioning
var apiService = builder.AddProject<Projects.ApiService>("apiservice")
    .WaitFor(kernelMemoryService)
    .WithReference(kernelMemoryEndpoint);

// ...

Is my understanding correct or have I missed something?

If so, is there a way to work around this for the time being?

Much appreciated.

[v-croft]

I found a solution for those with the same issue in a post on the .NET/Aspire repository from @davidfowl which though not as straightforward as .WithReference() retrieves a connection string from the blobs and queues ResourceBuilders:

var kernelMemory = builder.AddContainer("kernel-memory", "kernelmemory/service", "latest")
   //....
    .WithEnvironment("ASPNETCORE_ENVIRONMENT", "Development")
    .WithEnvironment("KernelMemory__Services__AzureBlobs__ConnectionString", blobs)
    .WithEnvironment("KernelMemory__Services__AzureQueues__ConnectionString", queues);

dotnet/aspire#5115 (comment)

For Qdrant, it is a bit more complicated as the Kernel Memory configuration needs both an endpoint and a key rather than a connection string. See this post by @dluc which retrieves and then parses the connection string to get the APIKey:
#915 (reply in thread)

[dluc]

hi @SophisticatedConsulting I think you're on the right track, I don't know of other ways to do that. As far as I know, Aspire works only with connection strings, while some KM services such as Qdrant, Ollama, AWS S3 are not configured with a conn string but providing an endpoint or similar config params. In these cases, if Aspire is provisioning the services you need to find a way to discover the endpoints before starting KM, e.g. by parsing the resources.