Multi-SWE-Bench: Evaluation Changes#47

Draft

Vladislav0Art wants to merge 35 commits intomainfrom

vartiukhov/evaluation

Commits on Apr 16, 2026

feat: cherry-pick method renaming with overload families

dragoi75
authored and
Vladislav0Art
committed
feat: add some changes in `configureCodeStyle` (cannot fully prevent unused import optimization)
Vladislav0Art
committed
feat: parameterize `searchInComments` of `RenameProcessor` in all renaming transformations
Vladislav0Art
committed

Commits on Apr 17, 2026

feat: print whitelisted annotations and log whether class/method is whitelisted
Vladislav0Art
committed
feat: print filter-out reason for classes/methods
Vladislav0Art
committed
feat: filter out method overload families + check when super class is `java.lang.Object` (don't filter)
Vladislav0Art
committed
feat: remove Public API Guard filter (allow public API with no refs be renamed)
Vladislav0Art
committed
feat: print override methods in log
Vladislav0Art
committed
feat: separate static and instance methods in overload grouping and filter overrides before grouping
Vladislav0Art
committed
feat: log overload family details in `RenameMethodTransformation`
Vladislav0Art
committed
feat: group overload families by class and improve logging in `RenameMethodTransformation`
Vladislav0Art
committed
feat: add annotation filtering mode (whitelist/blacklist) in `RenameMethodTransformation`
Vladislav0Art
committed
feat: add annotation filtering mode (whitelist/blacklist) in `RenameClassTransformation`
Vladislav0Art
committed
feat: support default blacklist merging and improve blacklist logging in `RenameMethodTransformation`
Vladislav0Art
committed
feat: support default blacklist merging and improve blacklist logging in `RenameClassTransformation`
Vladislav0Art
committed
feat: update readme and agents md files
Vladislav0Art
committed

Commits on Apr 18, 2026

Commits on Apr 21, 2026

feat: Add support for transforming `problem_statement` using transformation memory.

dragoi75
authored and
Vladislav0Art
committed

Commits on Apr 23, 2026

feat: delete transform_metamorphic_texts.py
Vladislav0Art
committed

Commits on Apr 25, 2026

Commits on Apr 27, 2026

Commits on Apr 29, 2026