The source project of this merge request has been removed.
Store dataset contents in index docstore
This enables reading datasets with fewer system calls, atomically updates the index with the backing documents and efficiently compresses datasets in bulk.
The downside is an opaque representation with a significantly more complex access code path which however seems palatable as long as it is a secondary representation.