This is a benchmark of existing, previously triaged issues. We use it to measure changes to our triage classification prompt - to see if changes materially improve the classification performance.
| Issue | Expected |
|---|---|
| #56366 | area-dart2wasm, type-enhancement |
| #56365 | area-core-library, type-enhancement |
| #56364 | area-front-end, type-bug |
| #56363 | area-core-library, type-enhancement |
| #56362 | area-vm, type-bug |
| #56361 | area-analyzer |
| #56360 | area-core-library |
| #56358 | area-web |
| #56355 | area-analyzer, type-bug, type-performance |
| #56354 | area-web, type-bug |
| #56353 | area-dart2wasm |
| #56350 | area-analyzer, type-enhancement |
| #56347 | area-dart-cli, type-bug |
| #56346 | area-pkg, pkg-json, type-enhancement |
| #56345 | area-analyzer, type-enhancement |
| #56344 | area-language, type-question |
| #56343 | area-analyzer, type-enhancement |
| #56342 | area-analyzer, type-enhancement |
| #56341 | area-analyzer |
| #56340 | area-vm |
| #56339 | area-core-library |
| #56337 | area-language, type-enhancement |
| #56330 | area-native-interop, type-bug |
| #56329 | area-language, type-enhancement |
| #56327 | area-web, type-question |
| #56325 | area-web, type-question |
| #56324 | area-dart-cli |
| #56323 | area-core-library, type-question |
| #56322 | area-web, type-bug |
| #56321 | area-dart2wasm, type-bug |
| #56319 | area-vm, type-enhancement |
| #56317 | area-core-library, type-enhancement |
| #56316 | area-web |
| #56315 | area-web |
| #56314 | area-web, type-bug |
| #56308 | area-vm breaking-change-request |
| #56306 | area-vm, type-bug |
| #56305 | area-front-end, type-bug, type-question |
| #56304 | area-core-library, type-enhancement |
| #56303 | area-dart-cli, type-bug |
| #56302 | area-vm |
| #56297 | area-language, type-enhancement |
| #56284 | area-core-library, type-enhancement |
| #56283 | area-dart2wasm |
| #56256 | area-front-end, type-bug |
| #56254 | area-pkg, pkg-vm-service, type-bug |
| #56240 | needs-info |
| #56229 | area-infrastructure |
| #56227 | area-native-interop |
| #56220 | area-infrastructure, type-code-health |
| #56217 | area-meta |
| #56216 | needs-info |
| #56214 | area-native-interop |
| #56208 | area-google3, type-enhancement |
| #56207 | area-google3 |
| #56206 | area-google3, type-enhancement |
| #56196 | area-meta, type-enhancement |
| #56195 | area-test, type-enhancement |
| #56193 | area-front-end, type-enhancement |
| #56192 | area-test, type-enhancement |
| #56189 | area-meta, type-enhancement |
| #56188 | area-meta, type-enhancement |
| #56178 | area-pkg, pkg-dtd, type-enhancement |
| #56177 | area-pkg, pkg-dtd, type-enhancement |
| #56168 | area-google3 |
| #56161 | area-build, type-enhancement |
| #56156 | area-test |
| #56154 | area-front-end, type-enhancement |
| #56153 | area-test, type-enhancement |
| #56138 | area-front-end, type-bug |
| #56122 | area-front-end, area-language |
| #56107 | area-front-end, type-bug |
| #56081 | area-sdk, type-enhancement, type-infra |
| #56058 | area-native-interop |
| #56008 | area-infrastructure |
| #55990 | area-infrastructure |
| #55727 | area-google3 |
| #55669 | area-build |
| #55385 | area-sdk |
| #54306 | area-build |
| #53635 | area-build, area-vm |
We need more information from the user before we can triage these issues.
| Issue | Expected | Notes |
|---|---|---|
| #55291 | needs-info | unmodified ‘create an issue’ template |
| #55144 | needs-info | |
| #54595 | needs-info | |
| #54134 | needs-info | unmodified ‘create an issue’ template |
| #56348 | needs-info | ‘Analyzer Feedback from IntelliJ’ |
| #56246 | needs-info | ‘Analyzer Feedback from IntelliJ’ |
| #56349 | needs-info | Or, potentially should-close |
2024-08-27: 55.6% using gemini-1.5-flash-latest 2024-08-30: 64.8% using gemini-1.5-flash-latest