Tool reduction #6781

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

MackinnonBuck merged 13 commits into main from mbuck/tool-reduction

Oct 20, 2025

Member

MackinnonBuck commented Sep 8, 2025 •

edited

Loading

Summary

This draft introduces the tool reduction feature set:

New abstractions (IToolReductionStrategy) for selecting a subset of tools per request.
Middleware (ToolReducingChatClient) that applies a configured strategy automatically.
An initial embedding-based implementation (EmbeddingToolReductionStrategy) as a first strategy.
Supporting builder extensions and tests.

All components are marked experimental and may evolve. Additional strategies can be added in follow-up work.

Next Steps

Additional tool reduction strategy implementations.
Refinements to abstractions as necessary.

Feedback welcome before expanding scope.

Fixes #6670

Microsoft Reviewers: Open in CodeFlow

MackinnonBuck added 3 commits

September 5, 2025 15:55


          [WIP] Basic prototype

ace3d1d


          Some refinements + more tests

c7608c1


          Remove usage of 'field'

a238349

github-actions bot added the area-ai label

dotnet-policy-service bot assigned MackinnonBuck


          Update System.Linq.Async version

06cedcc

stephentoub reviewed

View reviewed changes

eng/packages/TestOnly.props Outdated Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Outdated Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Outdated Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Outdated Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Outdated Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Outdated Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Outdated Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/ToolReducingChatClient.cs Show resolved Hide resolved

stephentoub reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/ToolReducingChatClient.cs Outdated Show resolved Hide resolved

MackinnonBuck added 4 commits

September 11, 2025 12:03


          Don't handle OperationCanceledException

56f4bdd


          More PR feedback

b2583ec


          PR feedback + other improvements

491ff72


          Merge remote-tracking branch 'origin/main' into mbuck/tool-reduction

d05b989

jeffhandley requested a review from ericstj

September 30, 2025 17:22

ericstj reviewed

View reviewed changes

src/Libraries/Microsoft.Extensions.AI/ToolReduction/EmbeddingToolReductionStrategy.cs Show resolved Hide resolved

MackinnonBuck mentioned this pull request

Tool grouping #6865

Open


          Enable asynchronous chat history embedding text generation

b3f7f85

MackinnonBuck marked this pull request as ready for review

October 14, 2025 23:53

MackinnonBuck requested a review from a team as a code owner

October 14, 2025 23:54

Copilot AI review requested due to automatic review settings

October 14, 2025 23:54

MackinnonBuck requested a review from a team as a code owner

October 14, 2025 23:54


          Merge branch 'main' into mbuck/tool-reduction

62d1ae9

This was referenced Nov 17, 2025

Bump Microsoft.Bcl.AsyncInterfaces and Microsoft.Extensions.Http.Resilience dotnet/aspire-samples#1276

Closed

Bump the minor-dependencies group with 5 updates markwhitaker/saturday-quiz-web#251

Closed

deps: Bump the microsoft-packages group with 16 updates johnyvmware/TPL-v2#77

Closed

deps: Bump the production-dependencies group with 18 updates johnyvmware/TPL-v2#78

Open

Bump Microsoft.Extensions.AI from 9.7.1 to 10.0.0 YEONSEO93/GenAI-console-game#78

Open

Bump Microsoft.Extensions.Http.Resilience from 9.9.0 to 10.0.0 jcoliz/YoFi.V3#8

Open

Bump Microsoft.Extensions.ServiceDiscovery from 9.5.2 to 10.0.0 jcoliz/YoFi.V3#9

Open

Bump AWSSDK.Extensions.NETCore.Setup and 9 others DEFRA/trade-imports-data-api#313

Open

Bump Microsoft.Extensions.Http.Resilience from 9.10.0 to 10.0.0 Freeesia/korenan#113

Merged

Bump Microsoft.Extensions.ServiceDiscovery from 9.5.2 to 10.0.0 Freeesia/korenan#114

Open

Bump Microsoft.Extensions.AI from 9.7.1 to 10.0.0 gremh97/Generative-AI-for-beginners-dotnet_#149

Open

build [dependabot]: Bump the ms-ai group with 1 update Said-Nadji/PeakLimsApi#55

Open

Bump Microsoft.Extensions.AI from 9.10.1 to 10.0.0 mitch-b/dotnet-mcp-template#22

Open

Bump Microsoft.Extensions.Http.Resilience from 9.10.0 to 10.0.0 mitch-b/dotnet-mcp-template#25

Open

Bump the all group with 9 updates tryAGI/CSharpToJsonSchema#63

Merged

Bump Microsoft.Extensions.Http.Resilience from 9.10.0 to 10.0.0 nefarius/WinDbgSymbolsCachingProxy#350

Open

Bump Microsoft.Extensions.Diagnostics.Testing from 9.10.0 to 10.0.0 markwhitaker/saturday-quiz-web#253

Closed

Bump the minor group with 22 updates qin-guan/Homer#48

Open

fix: Bump the non-major-deps group with 11 updates ganhammar/AspNetCore.Identity.AmazonDynamoDB#154

Merged

Bump the all group with 4 updates tryAGI/AssemblyAI#139

Merged

Bump Microsoft.Extensions.Http.Resilience from 9.10.0 to 10.0.0 mailtrap/mailtrap-dotnet#183

Open

Bump Microsoft.Extensions.Http.Resilience from 9.9.0 to 10.0.0 rogerbriggen/aspire_otel_test#4

Open

Bump Microsoft.Extensions.ServiceDiscovery from 9.5.1 to 10.0.0 rogerbriggen/aspire_otel_test#6

Open

deps: Bump Microsoft.Extensions.Caching.Abstractions and 2 others Scetrov/FrontierSharp#81

Open

build: Bump Microsoft.Extensions.Http.Resilience from 9.10.0 to 10.0.0 renebentes/3054#73

Open

build: Bump Microsoft.Extensions.ServiceDiscovery from 9.5.2 to 10.0.0 renebentes/3054#74

Open

Bump Microsoft.Extensions.AI from 9.8.0 to 10.0.0 tripvik/Miniblog.Core#12

Open

Bump Microsoft.Extensions.Http.Resilience from 9.10.0 to 10.0.0 ESCd/wadio#94

Open

chore: Bump the microsoft-packages group with 7 updates mo-esmp/RickAndMorty#10

Closed

Bump the dotnet-microsoft-next group with 3 updates escendit/extensions-hosting#197

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

stephentoub stephentoub left review comments

Copilot code review Copilot Copilot left review comments

jeffhandley jeffhandley approved these changes

ericstj ericstj approved these changes

+1 more reviewer

PederHP PederHP left review comments

Labels

area-ai