Improve storage manager and merge it with creation_management
module
#147
Labels
enhancement
New feature or request.
t-tooling
Issues with this label are in the ownership of the tooling team.
Milestone
The current Crawlee / StorageClientManager is more or less just copied from the Python SDK / StorageClientManager and is extremely simple. Its primary role is to maintain and provide access to storage client instances based on specific input parameters.
The Crawlee TS / StorageManager is more complex and it takes care of more things - creating instances of storages & their caching.
Currently, we have a helper module "creation_management" in
storages/
which helps with it.Let's move logic from
storages/creation_management
toStorageClientManager
and improve the creation & caching process.Functions
get_or_create
,find_or_create_client_by_id_or_name
acreate_*_from_directory
should be refactored.The text was updated successfully, but these errors were encountered: