Talk:Machine learning

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

neuromorphic computing[edit]

someone should really include neuromorphic a discusion on memristors and thair connection to neural networks would also be nice

Wrong date[edit]

The date when Arthur Samuel wrote the first program is 1952 as wikipedia and many other online websites say, however this article says 1959, which should be corrected.

overlooked randomness[edit]

could someone possibly add some thoughts on how randomness is needed for ml?

i wish i could do it, but i lack the expertise or the time to bring this up in Wikipedia style, as it is evident by this very post and the chain of links in it, if you care enough to dig.

cheers! 😁😘 16:11, 27 February 2020 (UTC) — Preceding unsigned comment added by Cregox (talkcontribs)

@Cregox: Random forests and conditional random fields are often used in machine learning, for example. Jarble (talk) 16:45, 18 August 2020 (UTC)

both ideas sound interesting, but they both look like optional techniques rather than necessary tools.

in my mind and from my understanding machine learning would never exist without random number generators.

as i also mentioned in my link there, i'll basically just copy and paste it here:

perhaps we're missing words here. randomness is the apparent lack of pattern or predictability in events. the more predictable something is, the dumber it becomes. of course just a bunch of random numbers doesn't make anything intelligent. it's much to the opposite: randomness is an artifact of intelligence. but if while we're reverse engineering intelligence (making ai) we can in practice see it does need rng to exist, then there's evidently something there between randomness and intelligence that's not just artifacts. could we call it chaos? rather continue there: 11:12, 21 August 2020 (UTC) — Preceding unsigned comment added by Cregox (talkcontribs)

Simple definition of machine learning is inaccurate[edit]

There is no reference to the below definition and it is inaccurate as a definition of Machine learning should not include AI. There are many textbook definitions of machine learning which could be used.

The current text without reference: Simple Definition: Machine learning is an application of artificial intelligence (AI) that provides systems the ability to automatically learn and improve from experience without being explicitly programmed. Machine learning focuses on the development of computer programs that can access data and use it to learn for themselves.

Definition with reference: Machine learning is the study of computer algorithms that allow computer programs to automatically improve through experience.

Machine Learning, Tom Mitchell, McGraw Hill, 1997. — Preceding unsigned comment added by Tolgaors (talkcontribs) 09:55, 29 October 2020 (UTC)

They are both commonly used terms of the English language with meanings defined by such. Any claim that there is no overlap is an extra-ordinary implausible claim. A discussion within some specialized view within some specialized topic venue is no basis for such a broad claim. North8000 (talk) 13:43, 29 October 2020 (UTC)
This was recently added. It was unsourced and redundant, so I just removed it. - MrOllie (talk) 13:45, 29 October 2020 (UTC)
"Machine learning (ML) is the study of computer algorithms that improve automatically through experience." this is a very bad lede. (1) almost not machine learning improves "automatically". Instead, models are trained and deployed manually. (2) "through experience" same. Models are build from some training data, which is not in any meaningful way what is later on "experienced" by the classifier. E.g., a machine learning method to improve picture quality of cell phone cameras is likely trained on artificially corrupted imagery, not by giving it the actual sensor readings and a improved imagery result. I think the old lede was much better! (talk) 15:49, 30 October 2020 (UTC)

Proposed contents removal[edit]

The below text is inaccurate and none of the cited references support the statement:

Yet some practitioners, for example, Dr Daniel Hulme, who teaches AI and runs a company operating in the field, argues that machine learning and AI are separate.[1][2] This quoted reference states that ML is part of AI: [3]

They are both commonly used terms of the English language with meanings defined by such. Any claim that there is no overlap is an extra-ordinary implausible claim. A discussion within some specialized view within some specialized topic venue is no basis for such a broad claim. Also, the insertion looks like spam to insert the person into the article. North8000 (talk) 13:45, 29 October 2020 (UTC)


I think that a paragraph be added about the issues that can arise from maximizing a mis-aligned objective function. As an example, just take the ethical challenges arising from recommendation algorithms in social media,[4] with negative effects such as creating distrust in traditional information channels,[5] actively spreading misinformation,[6] and creating addiction.[7] --MountBrew (talk) 18:37, 20 November 2020 (UTC)


Training models[edit]

  • Should optimization algorithms (in general) be discussed on this Wikipedia page? If so, this is likely the best place to do so.
  • There is currently no mention of fully decentralized machine learning methods, such as CHOCO-SGD.[8][9] This should definitely be fixed!


  1. ^ This quoted reference states that ML is part of AI: − {{cite web − |url= − |title= The Elements of AI − |publisher= University of Helsinki − |date = Dec 2019 − |accessdate=7 April 2020}} −
  2. ^ This reference is broken and does not work: − {{cite web − |url= − |title= Satalia CEO Daniel Hulme has a plan to overcome the limitations of machine learning − |publisher= Techworld − |date = October 2019 − |accessdate=7 April 2020}} −
  3. ^ Cite error: The named reference Alpaydin2020 was invoked but never defined (see the help page).
  4. ^ Milano, Silvia; Mariarosaria, Taddeo; Luciano, Floridi (April 26, 2019). "Recommender Systems and their Ethical Challenges". SSRN. doi:10.2139/ssrn.3378581. Retrieved 20 November 2020.
  5. ^ Chaslot, Guillaume. "How Algorithms Can Learn to Discredit "the Media"". Medium. Medium. Retrieved 20 November 2020.
  6. ^ Johnson, Neil F.; Velásquez, Nicolas; Restrepo, Nicholas Johnson; Leahy, Rhys; Gabriel, Nicholas; El Oud, Sara; Zheng, Minzhang; Manrique, Pedro; Wuchty, Stefan; Lupu, Yonathan (13 May 2020). "The online competition between pro- and anti-vaccination views". Nature. 582: 230–233. doi:10.1038/s41586-020-2281-1. Retrieved 20 November 2020.
  7. ^ Burr, Christopher; Cristianini, Nello; Ladyman, James (25 September 2018). "An Analysis of the Interaction Between Intelligent Software Agents and Human Users" (PDF). Minds and Machines (28): 735–774. doi:10.1007/s11023-018-9479-0. Retrieved 20 November 2020.
  8. ^ Kairouz, Peter; McMahan, H. Brendan; et al. (10 December 2019). "Advances and Open Problems in Federated Learning". arXiv preprint. Retrieved 20 November 2020. Explicit use of et al. in: |last3= (help)
  9. ^ Koloskova, Anastasia; Stich, Sebastian U.; Jaggi, Martin (1 February 2019). "Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication". arXiv preprint. Retrieved 20 November 2020.

Edit request[edit]

Under the "Proprietary" subheading, please add a link to PolyAnalyst. Sam at Megaputer (talk) 02:14, 17 February 2021 (UTC)

Done FeydHuxtable (talk) 21:46, 19 February 2021 (UTC)