Feature Selection Toolbox (FST) is software primarily for
feature selection
In machine learning and statistics, feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant Feature (machine learning), features (variables, predictors ...
in the machine learning domain, written in C++, developed at the Institute of Information Theory and Automation (UTIA), of the Czech Academy of Sciences.
Version 1
The first generation of Feature Selection Toolbox (FST1) was a Windows application with user interface allowing users to apply several sub-optimal, optimal and mixture-based feature selection methods on data stored in a trivial proprietary textual flat file format.
Version 3
The third generation of Feature Selection Toolbox (FST3) was a Library (computing), library without user interface, written to be more efficient and versatile than the original FST1.
FST3 supports several standard data mining tasks, more specifically, data preprocessing and Statistical classification, classification, but its main focus is on
feature selection
In machine learning and statistics, feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant Feature (machine learning), features (variables, predictors ...
. In feature selection context, it implements several common as well as less usual techniques, with particular emphasis put on Thread (computer science), threaded implementation of various sequential search methods (a form of hill-climbing). Implemented methods include individual feature ranking, floating search, oscillating search (suitable for very high-dimension problems) in randomized or deterministic form, optimal methods of branch and bound type, probabilistic class distance criteria, various classifier accuracy estimators, feature subset size optimization, feature selection with pre-specified feature weights, criteria ensembles, hybrid methods, detection of all equivalent solutions, or two-criterion optimization. FST3 is more narrowly specialized than popular software like the Waikato Environment for Knowledge Analysis Weka (machine learning), Weka, RapidMiner or PRTools.
PRTools
/ref>
By default, techniques implemented in the toolbox are predicated on the assumption that the data is available as a single flat file in a simple proprietary format or in Weka format ARFF, where each data point is described by a fixed number of numeric attributes. FST3 is provided without user interface, and is meant to be used by users familiar both with machine learning and C++ programming. The older FST1 software is more suitable for simple experimenting or educational purposes because it can be used with no need to code in C++.
History
* In 1999, development of the first Feature Selection Toolbox version started at UTIA as part of a PhD thesis. It was originally developed in Optima++ (later renamed Power++) RAD C++ environment.
* In 2002, the development of the first FST generation has been suspended, mainly due to end of Sybase's support of the then used development environment.
* In 2002–2008, FST kernel was recoded and used for research experimentation within UTIA only.
* In 2009, 3rd FST kernel recoding from scratch begun.
* In 2010, FST3 was made publicly available in form of a C++ library without GUI. The accompanying webpage collects feature selection related links, references, documentation and the original FST1 available for download.
* In 2011, an update of FST3 to version 3.1 included new methods (particularly a novel dependency-aware feature ranking suitable for very-high-dimension recognition problems) and core code improvements.
See also
* Feature selection
* Pattern recognition
* Machine learning
* Data mining
* OpenNN, Open neural networks library for predictive analytics
* Weka (machine learning), Weka, comprehensive and popular Java (programming language), Java open-source software from University of Waikato
* RapidMiner, formerly ''Yet Another Learning Environment'' (YALE) a commercial machine learning framework
PRTools
of the Delft University of Technology
Infosel++
specialized in information theory based feature selection
Tooldiag
a C++ pattern recognition toolbox
* List of numerical analysis software
References
External links
{{Official website, fst.utia.cz
Classification algorithms
Data mining and machine learning software
C++ software
Data modeling tools
Computer libraries
Cross-platform software