dat – Share and Sync Data Instantly
Dat is an grant funded, open source project housed in US Open Data. While dat is a general purpose tool, they focus on science. The high level goal of the dat project is to build a streaming interface between every database and file storage backend in the world. By building tools to build and share data pipelines they aim to bring to data a style of collaboration similar to what git brings to source code. The first code went into dat on August 17th 2013. The first six months were spent making a prototype (thanks to the Knight foundation Prototype Fund) and the last six months have been spent on taking dat beyond the prototype phase and into something more concrete (the Dat Alpha release). In April 2014 they were able to expand the team working on dat from 1 person to 3 persons, thanks to support from the Sloan foundation. Sloan’s proposition was that they like the initial dat prototype but wanted to see scientific data use cases be treated as top priority. As a result they expanded the scope of the project from its tabular data specific beginnings and have focused on adding features that will help us work with larger open scientific datasets. This will be added to Statistics Resources and Big Data Subject Tracer™. This will be added to the tools section of Research Resources Subject Tracer™ Information Blog.