HACKER Q&A
📣 trauco

Distributed Data Management Solutions?


I run a small earth sciences research group. I have a need for a good distributed management solution so group members can access data, contribute changes, etc. The aim is to be able to track changes to both data processing scripts, civ-type data text files, and processed binary files (think MatLab .mat files or NetCDF).

I've been experimenting with DataLad (https://www.datalad.org) which is a front-end for git+git-annex. It's ok although painfully slow as we have many small files to put into git-annex. It also requires quite granular understanding of how git-annex and git work, and it doesn't have any nice front-ends.

Are there any other open source solutions for this out there?


  👤 PaulHoule Accepted Answer ✓