Median trick: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
→‎top: Expanding article
Tag: harv-error
→‎Sources: added source
Line 10: Line 10:
* {{cite book | last=Kogler | first=Alexander | last2=Traxler | first2=Patrick | title=Mathematical Aspects of Computer and Information Sciences | chapter=Parallel and Robust Empirical Risk Minimization via the Median Trick | publisher=Springer International Publishing | publication-place=Cham | year=2017 | isbn=978-3-319-72452-2 | issn=0302-9743 | doi=10.1007/978-3-319-72453-9_31}}
* {{cite book | last=Kogler | first=Alexander | last2=Traxler | first2=Patrick | title=Mathematical Aspects of Computer and Information Sciences | chapter=Parallel and Robust Empirical Risk Minimization via the Median Trick | publisher=Springer International Publishing | publication-place=Cham | year=2017 | isbn=978-3-319-72452-2 | issn=0302-9743 | doi=10.1007/978-3-319-72453-9_31}}
* {{cite journal | last=Jerrum | first=Mark R. | last2=Valiant | first2=Leslie G. | last3=Vazirani | first3=Vijay V. | title=Random generation of combinatorial structures from a uniform distribution | journal=Theoretical Computer Science | publisher=Elsevier BV | volume=43 | year=1986 | issn=0304-3975 | doi=10.1016/0304-3975(86)90174-x | pages=169–188}}
* {{cite journal | last=Jerrum | first=Mark R. | last2=Valiant | first2=Leslie G. | last3=Vazirani | first3=Vijay V. | title=Random generation of combinatorial structures from a uniform distribution | journal=Theoretical Computer Science | publisher=Elsevier BV | volume=43 | year=1986 | issn=0304-3975 | doi=10.1016/0304-3975(86)90174-x | pages=169–188}}
* {{cite book | last=Wang | first=Dan | last2=Han | first2=Zhu | title=Sublinear Algorithms for Big Data Applications | chapter=Basics for Sublinear Algorithms | publisher=Springer International Publishing | publication-place=Cham | year=2015 | isbn=978-3-319-20447-5 | issn=2191-5768 | doi=10.1007/978-3-319-20448-2_2}}


{{algorithm-stub}}
{{algorithm-stub}}

Revision as of 22:19, 11 September 2023

The median trick is a generic approach that increases the chances of a probabilistic algorithm to succeed.[1] Probably first used in 1986[2] by Jerrum et al.[3] for approximate counting algorithms, the technique was later applied to a broad selection of classification and regression problems.[2]

The idea of median trick is very simple: run the randomized algorithm with real number-output multiple times, and output the median of the obtained results. For example, for sublinear algorithms, the same algorithm can be run repeatedly over random subsets of input data, and, per Chernoff inequality, the median of the results will converge to solution very fast.[4]

References

  1. ^ Kogler & Traxler 2017, p. 378.
  2. ^ a b Kogler & Traxler 2017, p. 380.
  3. ^ Jerrum, Valiant & Vazirani 1986, p. 182, Lemma 6.1.
  4. ^ Wang & Han 2015, p. 11.

Sources

  • Kogler, Alexander; Traxler, Patrick (2017). "Parallel and Robust Empirical Risk Minimization via the Median Trick". Mathematical Aspects of Computer and Information Sciences. Cham: Springer International Publishing. doi:10.1007/978-3-319-72453-9_31. ISBN 978-3-319-72452-2. ISSN 0302-9743.
  • Jerrum, Mark R.; Valiant, Leslie G.; Vazirani, Vijay V. (1986). "Random generation of combinatorial structures from a uniform distribution". Theoretical Computer Science. 43. Elsevier BV: 169–188. doi:10.1016/0304-3975(86)90174-x. ISSN 0304-3975.
  • Wang, Dan; Han, Zhu (2015). "Basics for Sublinear Algorithms". Sublinear Algorithms for Big Data Applications. Cham: Springer International Publishing. doi:10.1007/978-3-319-20448-2_2. ISBN 978-3-319-20447-5. ISSN 2191-5768.