[mcp-analysis] MCP Structural Analysis - 2026-02-22 #17738
Closed
Replies: 1 comment
-
|
This discussion was automatically closed because it expired on 2026-03-01T15:01:41.591Z.
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
12 GitHub MCP tools analyzed across 10 toolsets on 2026-02-22. Average usefulness rating: 3.08/5. Two toolsets (
context,notifications) are inaccessible in the Actions integration environment (403). Three toolsets (pull_requests,actions,code_security) produce oversized responses requiring a payload file intermediary. Three tools (list_discussions,search_repositories,get_label) deliver compact, high-value responses ideal for agentic use.Full Structural Analysis Report
Executive Summary
list_discussions— 5/5get_me/list_notifications— 1/5 (403 errors)get_label— 25 tokenslist_code_scanning_alerts— 25,476 tokensUsefulness Ratings for Agentic Work
list_discussionssearch_repositorieslist_issueslist_commitsget_labellist_pull_requestslist_workflowslist_labelget_labelinsteadlist_code_scanning_alertsget_file_contentsget_melist_notificationsSchema Analysis
get_meget_file_contentslist_commitslist_issueslist_pull_requestslist_workflowslist_code_scanning_alertslist_discussionslist_labelget_labelsearch_repositorieslist_notificationsResponse Size Analysis
Tool-by-Tool Analysis
get_meget_file_contentslist_commitslist_issueslist_pull_requestslist_workflowslist_code_scanning_alertslist_discussionslist_labelget_labelfor individual items insteadget_labelsearch_repositorieslist_notifications30-Day Trend Summary
get_me,list_notifications)Recommendations
High-value tools (rating 4–5, prefer these):
list_discussions— Best balance of data completeness and token efficiencysearch_repositories— Rich multi-field metadata in a single compact calllist_commits— Good commit metadata with reasonable sizeget_label— Perfect for targeted label lookupsTools needing improvement:
list_code_scanning_alerts— No pagination enforcement; returns massive payload even for exploratory calls; needs per_page support and field reductionlist_workflows—perPageparameter appears ignored; returns all 205 workflowsget_file_contents— Should surface file content directly, not just a success acknowledgmentContext-efficient tools (low tokens, high rating):
get_label(25 tokens, ⭐⭐⭐⭐),list_discussions(100 tokens, ⭐⭐⭐⭐⭐),search_repositories(150 tokens, ⭐⭐⭐⭐⭐)Context-heavy tools to use cautiously:
list_code_scanning_alerts(25,476 tokens),list_pull_requests(5,911 tokens),list_workflows(3,885 tokens) — all trigger the payload file intermediary which requires an extra file-read stepVisualizations
Tool Response Sizes
Usefulness Ratings by Tool
Toolset: Avg Rating vs Avg Token Size
Token Size vs Usefulness Scatter
References:
Beta Was this translation helpful? Give feedback.
All reactions