-
Notifications
You must be signed in to change notification settings - Fork 45
Open
Labels
I3Minimal impactMinimal impactS4RoutineRoutineU4Nothing urgentNothing urgentenhancementImproving existing functionalityImproving existing functionalityneofs-storageStorage node application issuesStorage node application issuesperformanceMore of something per secondMore of something per second
Description
Is your feature request related to a problem? Please describe.
I'm always frustrated when shard evacuation takes more time than it could. We're pulling one object after another and writing them one after another, it's not very productive.
Describe the solution you'd like
Pull objects and push them into write queues (when pushing into multiple shards), accumulate small objects into batches and write batches of objects. Source shard iteration can be done by size if metabase is available.
Metadata
Metadata
Assignees
Labels
I3Minimal impactMinimal impactS4RoutineRoutineU4Nothing urgentNothing urgentenhancementImproving existing functionalityImproving existing functionalityneofs-storageStorage node application issuesStorage node application issuesperformanceMore of something per secondMore of something per second