Gourt Home::Gourt :: Metakit
Metakit is an embedded database library with a small footprint. It fills the gap between flat-file, relational, object-oriented, and tree-structured databases, supporting relational joins, serialization, nested structures, and instant schema evolution. Interfaces for C++ (native), Python and Tcl are the most used.
History
Metakit was written by Jean-Claude Wippler, a software developer from the Netherlands. Its development had started around 1997 and in 2001 it was made open source (with MIT X11 license). The author provides commercial support. In last few years (written in 2005) Wippler concentrates less on Metakit and more on his other projects.
The database is used in several commercial products (most notable being probably Address Book in Mac OS X) and in several open source and in-house projects (typically using Python or TCL interface). Derived project Starkit (virtual file system for TCL), written also by Wippler, reached popularity among TCL programmers.
Mail-list of Metakit has around 200 subscribers and is regularly visited by Wippler. Other developers had contributed to the project with bugfixes and suggestions.
Features
Unlike most other database systems which store row of a database table in one place (row-oriented architecture) Metakit stores individual columns separately (column-oriented architecture). For many years only linear access to the tables was possible (with O(N) complexity), later hash structures and B-tree like structures were added (reducing typical search complexity to O(1)). Relational operations (like group-by and joins) were also added over years. It is possible to combine and process table data via flexible mechanims called views. The database data are portable among platforms. Disk space overhead of Metakit is very low - several techniques are employed automatically to reduce it as much as possible. Viewer of Metakit database structures (named Kitview) is provided.
Practical limit to database size is around 1GB (even on 64-bit platforms). Multithreaded and multiuser access requires manual support from the programmer and is discouraged (in C++, TCL and Python use automatically one global lock). Combinations of more advanced features are often not tested and may fail. It is possible to obtain somewhat better performance than with other databases (published benchmarks include SQLite and Berkeley DB) but it requires lot of testing and lot of knowledge of Metakit internals. Metakit's API is low level, compared to SQL.
The biggest weakness of Metakit is its rather spotty and sometimes obsolete documentation. Full understanding of its API and performance tuning requires deep study of library's source code. Metakits terminology has many differences to standard database terminology. The API and file format has changed several times over time.
Metakit is tested on Windows, Unix and Mac OS X.
Language bindings
- C++ (native): Metakit is written in C++ (without using its new features so even very old compilers can handle it).
- Python: called Mk4py
- Tcl: called Mk4tcl, with an optional OO binding on top called Oomk.
- Other languages can be interfaced with help of SWIG.
External links
- Metakit site
- e4Graph: library that allows programs to store and manipulate graph-like data persistently, built on top of Metakit
"Metakit"