Shogun (toolbox)
| Original author(s) | Gunnar Rätsch Soeren Sonnenburg |
|---|---|
| Developer(s) | Soeren Sonnenburg Sergey Lisitsyn Heiko Strathmann |
| Stable release | 1.1.0 / December 1, 2011 |
| Written in | C++ |
| Operating system | Linux, Mac OS X, Cygwin |
| Type | Machine learning |
| License | GNU General Public License v3 |
| Website | http://www.shogun-toolbox.org/ |
Shogun is an Free software, open source toolbox written in C++. It offers numerous algorithms and data structures for machine learning problems.
Shogun is licensed under the terms of the GNU General Public License version 3 or later.
Contents |
[edit] Description
The focus of Shogun is on kernel machines such as support vector machines for regression and classification problems. Shogun also offers a full implementation of Hidden Markov models. The core of Shogun is written in C++ and offers interfaces for MATLAB, Octave, Python, R, Java, Lua, Ruby and C#. Shogun has been under active development since 1999. Today there is a vibrant user community all over the world using Shogun as a base for research and education, and contributing to the core package.
[edit] Supported algorithms
Currently Shogun supports the following algorithms:
- Support vector machines
- Dimensionality reduction algorithms, such as PCA, Kernel PCA, Locally Linear Embedding, Hessian Locally Linear Embedding, Local Tangent Space Alignment, Kernel Locally Linear Embedding, Kernel Local Tangent Space Alignment, Multidimensional Scaling, Isomap, Diffusion Maps, Laplacian Eigenmaps
- Online learning algorithms such as SGD-QN, Vowpal Wabbit
- Clustering algorithms: k-means and GMM
- Kernel Ridge Regression, Support Vector Regression
- Hidden Markov Models
- K-Nearest Neighbors
- Linear discriminant analysis
- Kernel Perceptrons.
Many different kernels are implemented, ranging from kernels for numerical data (such as gaussian or linear kernels) to kernels on special data (such as strings over certain alphabets). The currently implemented kernels for numeric data include:
- linear
- gaussian
- polynomial
- sigmoid kernels
The supported kernels for special data include:
- Spectrum
- Weighted Degree
- Weighted Degree with Shifts
The latter group of kernels allows processing of arbitrary sequences over fixed alphabets such as DNA sequences as well as whole e-mail texts.
[edit] Special features
As Shogun was developed with bioinformatics applications in mind it is capable of processing huge datasets consisting of up to 10 million samples. Shogun supports the use of pre-calculated kernels. It is also possible to use a combined kernel i.e. a kernel consisting of a linear combination of arbitrary kernels over different domains. The coefficients or weights of the linear combination can be learned as well. For this purpose Shogun offers a multiple kernel learning functionality.
[edit] References
- C.Cortes and V.N. Vapnik. Support-vector networks Machine Learning, 20(3):273—297, 1995.
- S.Sonnenburg, G.Rätsch, C.Schäfer and B.Schölkopf:, Large Scale Multiple Kernel Learning. Journal of Machine Learning Research, 7:1531-1565, July 2006, K.Bennett and E.P.-Hernandez Editors.
- T.Joachims. Making large-scale SVM learning practical In B.Schölkopf, C.J.C. Burges, and A.J. Smola, editors, Advances in Kernel Methods - Support Vector Learning, pages 169—184, Cambridge, MA, 1999. MIT Press.
- C.-C. Chang and C.-J. Lin, LIBSVM : a library for support vector machines, 2001.
- S. Sonnenburg, G. Rätsch, S. Henschel, C. Widmer, J. Behr, A. Zien, F. De Bona, A. Binder, C. Gehl and V. Franc: The SHOGUN Machine Learning Toolbox, Journal of Machine Learning Research, 11:1799−1802, June 11, 2010.
