Coord ^{an open source project for large-scale data analysis}

Coord is an open source implementation of a SBA(Space-based Architecture) built on DHT(Distributed Hash Table). In a technical point of view, Coord is similar to Tuple Space which is an implementation of the associative memory paradigm for parallel/distributed computing. Coord transparently manages such a space which can be mapped to the memory, file, or even database, and converge those into a large-scale virtual space. In the virtual space, data is located by one or more hash functions as if a point is placed on the "coordinates", a process communicates with another only through the space which looks like "coordinator ". In result, Coord provides a large-scale sharable object storage for parallel/distributed computing.

Nevertheless, Coord is NOT just for the emerging distributed key-value storage systems such as Bigtable, Hbase, Dynamo, MemcacheDB, CouchDB, and Cassandra. That is because Coord provides a distributed computing framework, Coord MapReduce, for large-scale data analysis, which is coined in new semantics by Google. Coord MapReduce is worked on a simple distributed file system, dust . It splits and scatters a file by the chunk, but does not have a centralized metadata server to locate the chunks. In this point, dust differs from GFS/HDFS. In order to take advantage of Coord MapReduce, there is no need to install a special distributed file system. By means of using dust, Coord MapReduce finally helps users to parallelize map/reduce tasks with massive data.

Moreover, Coord provides a better capability for remote execution and parallel processing, warp . It is NOT just a remote or parallel execution tool such as ssh/gexec since it supports load-balance. In a real time, warp assigns the best node to run legacy codes such as c/c++, java, python, or scripts. With warp, users do not need to worry about where to perform their tasks any more. It enables users to easily parallelize their codes programmed in a single machine over the cluster.

Now, Coord is being evolved into a cloud computing platform for large-scale data analysis such as infromation retrival, data/text mining, and machine learning.