SMART Information Retrieval System
The SMART (System for the Mechanical Analysis and Retrieval of Text) Information Retrieval System is an information retrieval system developed at Cornell University in the 1960s. Many important concepts in information retrieval were developed as part of research on the SMART[dead link] system, including the vector space model, relevance feedback, and Rocchio classification.
The SMART system also provides a set of corpora, queries and reference rankings, taken from different subjects, notably
- ADI[dead link]: publications from information science reviews
- CACM[dead link]: computer science
- Cranfield collection[dead link]: publications from aeronautic reviews
- CISI[dead link]: library science
- Medlars collection[dead link]: publications from medical reviews
- Time magazine collection[dead link]: archives of the generalist review Time in 1963
To the legacy of the SMART system belongs the so-called SMART triple notation, a mnemonic scheme for denoting tf-idf weighting variants in the vector space model. The mnemonic for representing a combination of weights takes the form
ddd.qqq, where the first three letters represents the term weighting of the collection document vector and the second three letters represents the term weighting for the query document vector. For example,
ltc.lnn represents the
ltc weighting applied to a collection document and the
lnn weighting applied to a query document.
The following tables establish the SMART notation:
|represents a document vector, where is the weight of the term in and is the number of unique terms in . Positive features characterize terms that are present in a document, and the weight of zero is used for terms that are absent from a document.|
|Occurrence frequency of term in document||Number of unique terms in document|
|Number of collection documents||Average number of unique terms in a document|
|Number of documents with term present||Number of characters in document|
|Occurrence frequency of the most common term in document||Average number of characters in a document|
|Average occurrence frequency of a term in document||Global collection statistics|
|The slope in the context of pivoted document length normalization|
|Term frequency||Document frequency||Document length normalization|
||Disregards the collection frequency||
||No document length normalization|
||Raw term frequency||
||Inverse collection frequency||
||Augmented normalized term frequency||
||Inverse collection frequency||
||Pivoted unique normalization|
||Probabilistic inverse collection frequency||
||Pivoted characted length normalization|
The gray letters in the first, fifth, and ninth columns are the scheme used by Salton and Buckley in their 1988 paper. The bold letters in the second, sixth, and tenth columns are the scheme used in experiments reported thereafter.
- Palchowdhury, Sauparna (2016). "On The Provenance of tf-idf". sauparna.sdf.org. Retrieved 2019-07-29.
- Singhal, A., Buckley, C., & Mitra, M. (1996). Pivoted Document Length Normalization. SIGIR Forum, 51, 176-184.
- Salton, G., & Buckley, C. (1988). Term-Weighting Approaches in Automatic Text Retrieval. Inf. Process. Manage., 24, 513-523.
- Software and test collections[dead link] (FTP at Cornell University)
- Interactive SMART tutorial[dead link]
|This software-engineering-related article is a stub. You can help Wikipedia by expanding it.|