Talk:Boosting (machine learning)

From Wikipedia, the free encyclopedia
Jump to: navigation, search
WikiProject Robotics (Rated Start-class, Mid-importance)
WikiProject icon Boosting (machine learning) is within the scope of WikiProject Robotics, which aims to build a comprehensive and detailed guide to Robotics on Wikipedia. If you would like to participate, you can choose to edit this article, or visit the project page (Talk), where you can join the project and see a list of open tasks.
Start-Class article Start  This article has been rated as Start-Class on the project's quality scale.
 Mid  This article has been rated as Mid-importance on the project's importance scale.

Bias vs. Variance[edit]

The first sentence of the article defines boosting as a method for reducing bias. Isn't this incorrect? If boosting provides generalization, and variance refers to the variance of the model for different training sets (i.e. high variance means overfitting), then boosting should reduce variance and thereby increase bias. I'm confused about this, could someone please comment?

--EmanueleLM (talk) 07:43, 1 June 2016 (UTC) No that's basicallt right since the wrt number of weak learners you can end up with bias (too few of them) or overfitting (too many of them). That's the best paper you can read about Boosting:

Anyway boosting almost always reduces bias and in practice unless you use a lot of learners does not increase variance significantly.

Strong vs. Weak[edit]

The explanation of strong vs. week learner is a bit confusing. Unfortunately, I am not the right person to explain it better. —Preceding unsigned comment added by (talk) 08:42, 7 December 2010 (UTC)


Boosting is also a method for increasing the yield of a fisson bomb (Boosted fission weapon). Is that something that should be linked from this article? Or maybe put on the disambig. page for boost? -- 12:53, 1 June 2006 (UTC)

It should be in the disambug. page. Grokmenow 16:27, 10 July 2007 (UTC)

Oh, didnt see the date. Sorry about that. Grokmenow 16:27, 10 July 2007 (UTC)

Computer vision category[edit]

I removed this article from the computer vision category. Boosting is probably used by some people to solve CV problems but

  1. It is not a methodology developed within CV or specific to CV
  2. Boosting is already listed under the ensemble learning category which is linked to the CV category via maching learning.

--KYN 22:36, 27 July 2007 (UTC)

Recent Articles[edit]

I removed two articles from the references section. Perhaps another references section should be started to include some of the additional research on boosting.

-- AaronArvey —Preceding unsigned comment added by AaronArvey (talkcontribs) 01:15, 3 September 2007 (UTC)

"branching program based boosters"[edit]

The paper cited in reference to "convex potential boosters [not being able to] withstand random classification noise" states that "branching program based boosters" can withstand noise.

It would be really swell if someone knowledgeable could explain what "branching program based boosters" are. (Sorry that I can't) —Preceding unsigned comment added by (talk) 14:14, 23 March 2011 (UTC)

Agreed! -- (talk) 09:30, 27 August 2014 (UTC)

Merging article[edit]

I think that this article :

should be merge with this one. Anyone agree ? — Preceding unsigned comment added by (talk) 20:21, 4 December 2012 (UTC)

Yes (even if rather belatedly). Klbrain (talk) 14:23, 26 July 2016 (UTC)