BlobIt filesystem

[eolivelli]

We can create a layer over BlobIt in order to create a virtual file system, with these features:

• a FS-tree-like structure (introduce the concept of "directory")
  -- directory listing
  -- create directory
  -- remove directory
• information about file size, disk size (virtual and real), possibly per directory (without needing a full scan)
• fileExists
• getFileInfo (type, size, lastmodification)
• setLastModified
• renameFile into same directory
• renameFile into other directory (move)
• delete file
• read file (partial reads, offset+length)
• overwrite file
• truncate file to length (pre-allocate??)
• write a file (full write of the whole blob)
• streaming write without knowing the length in advance (not yet supported by BlobIt)
• streaming write in "append mode" of a byte[] (something like 'concat', not yet supported by BlobIt)
  -- streaming write in "append mode" without knowing the length in advance (not yet supported by BlobIt)

We expect that one Filesystem resides on a single Bucket.
We can add one or more metadata tables in order to store directory metadata, this will ease lookups and queries

No need for ACLs, file locks or other POSIX features

[amitvc]

@eolivelli I would like to work on this if there is no one already working on it.

[eolivelli]

Okay @amitvc but I have to share some ideas with you.
Current master introduced the concept of NamedObject, which support 'appends' and it will support 'replace'.

After implementing replace operation we have to introduce another layer on top the NamedObjects layer, in order to represent a tree-like structure, the 'directories'

The implementation you did on herddb about the typed primary key violation is needed here.

I don't have time today.
You can start by playing with the API and the project.
Just follow the getting started guide on the wiki.

We need to release herddb soon indeed, in order to be able to make progress here.

We are going to cut a release of blobit soon anyway, because it is needed by the new release of emailsuccess.com