Aerospike DB Community Editoin Database size limit

[KeyvanJS]

I am trying to sync mainnet with teranode, and Aerospike is hitting a storage limit.

When I try to increase the [storage-engine device] past 1TB it returns an error with a limit for the Community edition.

Do we have to buy an aerospike license to operate a fully synced node?

Even if Aerospike is run in cluster mode it still has a 5TB limit, which would not be enough.

[oskarszoon]

@KeyvanJS Aerospike community edition limits are 640GB per node, up to a maximum of 5 nodes, so ~5TB total. After that you will need to get a license. If you are using Aerospike docker setup, we have a 3 cluster example here: https://github.com/bsv-blockchain/teranode/blob/main/deploy/docker/aerospike/docker-compose-cluster.yml which will be 3 Aerospike instances using 640GB each.

But at the moment, with a pruned mainnet node, mainnet storage requirements are ~320GB. We don't recommend storing all spent UTXOs in Aerospike, for that we have the blockpersister service that can persist all information to disk.

And you can reduce Aerospike storage a bit by lowering the utxostore_utxoBatchSize value, in docker environments it defaults to 512. By lowering the value you would have more transactions that would be treated as external transactions and stored on disk instead of Aerospike. Please note that adjusting this value requires a full data reset.