List of datasets for machine-learning research

From Wikipedia, the free encyclopedia

These datasets are applied for machine learning (ML) research and have been cited in peer-reviewed academic journals. Datasets are an integral part of the field of machine learning. Major advances in this field can result from advances in learning algorithms (such as deep learning), computer hardware, and, less-intuitively, the availability of high-quality training datasets.[1] High-quality labeled training datasets for supervised and semi-supervised machine learning algorithms are usually difficult and expensive to produce because of the large amount of time needed to label the data. Although they do not need to be labeled, high-quality datasets for unsupervised learning can also be difficult and costly to produce.[2][3][4][5]

Many organizations including governments publish and share their datasets . The datasets are classified, based on the licenses, as Open data and Non-Open data.

The datasets from various governmental-bodies are presented in List of open government data sites. The datasets are ported on open data portals. They are made available for searching, depositing and accessing through interfaces like Open API. The datasets are made available as various sorted types and subtypes.

List of sorting used for Datasets[edit]

Type Subtypes
Specific category Finance, Economics, Commerce, Societal, Health, Academy, Sports, Food, Agriculture, Travel, Geospatial, Political, Consumer, Transport, Logistics, Environmental, Real-Estate, Legal, Entertainment, Energy, Hospitality
Scope Supranational Union, National, Subnational, Municipality, Urban, Rural
Language Mandarin Chinese, Spanish, English, Arabic, Hindi, Bengali
Type Tabular, Graph, Text, Image, Sound, Video
Usage Training, validating, and testing
File-Formats CSV, JSON, XML, KML, GeoJSON, Shapefile, GML
Licenses Creative-Commons, GPL, Other Non-Open data licenses
Last-Updated Last-Hour, Last-Day, Last-Week, Last-Month, Last-Year
File-Size Minimum, Maximum, Range
Status Verified, In-Preparation, Deactivated(or Deprecated)
Number of records 100s, 1000s, 10000s, 100000s, Millions
Number of variables Less than 10, 10s, 100s, 1000s, 10000s
Services Individual, Aggregation

The data portal is classified based on its type of license. The open source license based data portals are known as open data portals which are used by many government organizations and academic institutions.

List of Open Data Portals[edit]

Portal-Name License List of Installations of the Portal Typical Usages
Comprehensive Knowledge Archive Network (CKAN) AGPL

Data repository for government or non-profit organisations, Data Management Solution for Research Institutes
DKAN GPL Data repository for government or non-profit organisations, Data Management Solution for Research Institutes
Dataverse Apache

Data Management Solution for Research Institutes
DSpace BSD Data Management Solution for Research Institutes
OpenML BSD Data Management Solution to share datasets, algorithms, and experiments results through APIs.

List of portals suitable for multiple types of ML applications[edit]

The data portal sometimes lists a wide variety of subtypes of datasets pertaining to many machine learning applications.

Academic Torrents
Amazon Datasets
Awesome Public Datasets Collection
Datahub – Core Datasets
Global Open Data Index – Open Knowledge Foundation Archived 25 May 2020 at the Wayback Machine
Google Dataset Search
Hugging Face
IBM's Data Asset Exchange
Jupyter – Tutorial Data
Machine learning datasets
Major Smart Cities with Open Data
Microsoft Datasets
Open Data Inception
Papers with Code
Penn Machine Learning Benchmarks
Public APIs
Registry of Open Access Repositories 
REgistry of REsearch Data REpositories 
UCI Machine Learning Repository
Speech Dataset
Visual Data Discovery

List of portals suitable for a specific subtype of ML application[edit]

The data portals which are suitable for a specific subtype of machine learning application are listed in the subsequent sections.

Image data[edit]

These datasets consist primarily of images or videos for tasks such as object detection, facial recognition, and multi-label classification.

Facial recognition[edit]

In computer vision, face images have been used extensively to develop facial recognition systems, face detection, and many other projects that use images of faces.

Dataset name Brief description Preprocessing Instances Format Default task Created (updated) Reference Creator
Aff-Wild 298 videos of 200 individuals, ~1,250,000 manually annotated images: annotated in terms of dimensional affect (valence-arousal); in-the-wild setting; color database; various resolutions (average = 640x360) the detected faces, facial landmarks and valence-arousal annotations ~1,250,000 manually annotated images video (visual + audio modalities) affect recognition (valence-arousal estimation) 2017 CVPR[6]


D.Kollias et al.
Aff-Wild2 558 videos of 458 individuals, ~2,800,000 manually annotated images: annotated in terms of i) categorical affect (7 basic expressions: neutral, happiness, sadness, surprise, fear, disgust, anger); ii) dimensional affect (valence-arousal); iii) action units (AUs 1,2,4,6,12,15,20,25); in-the-wild setting; color database; various resolutions (average = 1030x630) the detected faces, detected and aligned faces and annotations ~2,800,000 manually annotated images video (visual + audio modalities) affect recognition (valence-arousal estimation, basic expression classification, action unit detection) 2019 BMVC[8]


D.Kollias et al.
FERET (facial recognition technology) 11338 images of 1199 individuals in different positions and at different times. None. 11,338 Images Classification, face recognition 2003 [10][11] United States Department of Defense
Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) 7,356 video and audio recordings of 24 professional actors. 8 emotions each at two intensities. Files labelled with expression. Perceptual validation ratings provided by 319 raters. 7,356 Video, sound files Classification, face recognition, voice recognition 2018 [12][13] S.R. Livingstone and F.A. Russo
SCFace Color images of faces at various angles. Location of facial features extracted. Coordinates of features given. 4,160 Images, text Classification, face recognition 2011 [14][15] M. Grgic et al.
Yale Face Database Faces of 15 individuals in 11 different expressions. Labels of expressions. 165 Images Face recognition 1997 [16][17] J. Yang et al.
Cohn-Kanade AU-Coded Expression Database Large database of images with labels for expressions. Tracking of certain facial features. 500+ sequences Images, text Facial expression analysis 2000 [18][19] T. Kanade et al.
JAFFE Facial Expression Database 213 images of 7 facial expressions (6 basic facial expressions + 1 neutral) posed by 10 Japanese female models. Images are cropped to the facial region. Includes semantic ratings data on emotion labels. 213 Images, text Facial expression cognition 1998 [20][21] Lyons, Kamachi, Gyoba
FaceScrub Images of public figures scrubbed from image searching. Name and m/f annotation. 107,818 Images, text Face recognition 2014 [22][23] H. Ng et al.
BioID Face Database Images of faces with eye positions marked. Manually set eye positions. 1521 Images, text Face recognition 2001 [24][25] BioID
Skin Segmentation Dataset Randomly sampled color values from face images. B, G, R, values extracted. 245,057 Text Segmentation, classification 2012 [26][27] R. Bhatt.
Bosphorus 3D Face image database. 34 action units and 6 expressions labeled; 24 facial landmarks labeled. 4652

Images, text

Face recognition, classification 2008 [28][29] A Savran et al.
UOY 3D-Face neutral face, 5 expressions: anger, happiness, sadness, eyes closed, eyebrows raised. labeling. 5250

Images, text

Face recognition, classification 2004 [30][31] University of York
CASIA 3D Face Database Expressions: Anger, smile, laugh, surprise, closed eyes. None. 4624

Images, text

Face recognition, classification 2007 [32][33] Institute of Automation, Chinese Academy of Sciences
CASIA NIR Expressions: Anger Disgust Fear Happiness Sadness Surprise None. 480 Annotated Visible Spectrum and Near Infrared Video captures at 25 frames per second Face recognition, classification 2011 [34] Zhao, G. et al.
BU-3DFE neutral face, and 6 expressions: anger, happiness, sadness, surprise, disgust, fear (4 levels). 3D images extracted. None. 2500 Images, text Facial expression recognition, classification 2006 [35] Binghamton University
Face Recognition Grand Challenge Dataset Up to 22 samples for each subject. Expressions: anger, happiness, sadness, surprise, disgust, puffy. 3D Data. None. 4007 Images, text Face recognition, classification 2004 [36][37] National Institute of Standards and Technology
Gavabdb Up to 61 samples for each subject. Expressions neutral face, smile, frontal accentuated laugh, frontal random gesture. 3D images. None. 549 Images, text Face recognition, classification 2008 [38][39] King Juan Carlos University
3D-RMA Up to 100 subjects, expressions mostly neutral. Several poses as well. None. 9971 Images, text Face recognition, classification 2004 [40][41] Royal Military Academy (Belgium)
SoF 112 persons (66 males and 46 females) wear glasses under different illumination conditions. A set of synthetic filters (blur, occlusions, noise, and posterization ) with different level of difficulty. 42,592 (2,662 original image × 16 synthetic image) Images, Mat file Gender classification, face detection, face recognition, age estimation, and glasses detection 2017 [42][43] Afifi, M. et al.
IMDb-WIKI IMDb and Wikipedia face images with gender and age labels. None 523,051 Images Gender classification, face detection, face recognition, age estimation 2015 [44] R. Rothe, R. Timofte, L. V. Gool

Action recognition[edit]

Dataset name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
TV Human Interaction Dataset Videos from 20 different TV shows for prediction social actions: handshake, high five, hug, kiss and none. None. 6,766 video clips video clips Action prediction 2013 [45] Patron-Perez, A. et al.
Berkeley Multimodal Human Action Database (MHAD) Recordings of a single person performing 12 actions MoCap pre-processing 660 action samples 8 PhaseSpace Motion Capture, 2 Stereo Cameras, 4 Quad Cameras, 6 accelerometers, 4 microphones Action classification 2013 [46] Ofli, F. et al.
THUMOS Dataset Large video dataset for action classification. Actions classified and labeled. 45M frames of video Video, images, text Classification, action detection 2013 [47][48] Y. Jiang et al.
MEXAction2 Video dataset for action localization and spotting Actions classified and labeled. 1000 Video Action detection 2014 [49] Stoian et al.

Object detection and recognition[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Visual Genome Images and their description 108,000 images, text Image captioning 2016 [50] R. Krishna et al.
Berkeley 3-D Object Dataset 849 images taken in 75 different scenes. About 50 different object classes are labeled. Object bounding boxes and labeling. 849 labeled images, text Object recognition 2014 [51][52] A. Janoch et al.
Berkeley Segmentation Data Set and Benchmarks 500 (BSDS500) 500 natural images, explicitly separated into disjoint train, validation and test subsets + benchmarking code. Based on BSDS300. Each image segmented by five different subjects on average. 500 Segmented images Contour detection and hierarchical image segmentation 2011 [53] University of California, Berkeley
Microsoft Common Objects in Context (COCO) complex everyday scenes of common objects in their natural context. Object highlighting, labeling, and classification into 91 object types. 2,500,000 Labeled images, text Object recognition 2015 [54][55][56] T. Lin et al.
SUN Database Very large scene and object recognition database. Places and objects are labeled. Objects are segmented. 131,067 Images, text Object recognition, scene recognition 2014 [57][58] J. Xiao et al.
ImageNet Labeled object image database, used in the ImageNet Large Scale Visual Recognition Challenge Labeled objects, bounding boxes, descriptive words, SIFT features 14,197,122 Images, text Object recognition, scene recognition 2009 (2014) [59][60][61] J. Deng et al.
Open Images A Large set of images listed as having CC BY 2.0 license with image-level labels and bounding boxes spanning thousands of classes. Image-level labels, Bounding boxes 9,178,275 Images, text Classification, Object recognition 2017

(V7 : 2022)

TV News Channel Commercial Detection Dataset TV commercials and news broadcasts. Audio and video features extracted from still images. 129,685 Text Clustering, classification 2015 [63][64] P. Guha et al.
Statlog (Image Segmentation) Dataset The instances were drawn randomly from a database of 7 outdoor images and hand-segmented to create a classification for every pixel. Many features calculated. 2310 Text Classification 1990 [65] University of Massachusetts
Caltech 101 Pictures of objects. Detailed object outlines marked. 9146 Images Classification, object recognition. 2003 [66][67] F. Li et al.
Caltech-256 Large dataset of images for object classification. Images categorized and hand-sorted. 30,607 Images, Text Classification, object detection 2007 [68][69] G. Griffin et al.
COYO-700M Image-Text Pair Dataset 10 billion pairs of alt-text and image sources in HTML documents in CommonCrawl 746,972,269 Images, Text Classification, Image-Language 2022 [70]
SIFT10M Dataset SIFT features of Caltech-256 dataset. Extensive SIFT feature extraction. 11,164,866 Text Classification, object detection 2016 [71] X. Fu et al.
LabelMe Annotated pictures of scenes. Objects outlined. 187,240 Images, text Classification, object detection 2005 [72] MIT Computer Science and Artificial Intelligence Laboratory
Cityscapes Dataset Stereo video sequences recorded in street scenes, with pixel-level annotations. Metadata also included. Pixel-level segmentation and labeling 25,000 Images, text Classification, object detection 2016 [73] Daimler AG et al.
PASCAL VOC Dataset Large number of images for classification tasks. Labeling, bounding box included 500,000 Images, text Classification, object detection 2010 [74][75] M. Everingham et al.
CIFAR-10 Dataset Many small, low-resolution, images of 10 classes of objects. Classes labelled, training set splits created. 60,000 Images Classification 2009 [60][76] A. Krizhevsky et al.
CIFAR-100 Dataset Like CIFAR-10, above, but 100 classes of objects are given. Classes labelled, training set splits created. 60,000 Images Classification 2009 [60][76] A. Krizhevsky et al.
CINIC-10 Dataset A unified contribution of CIFAR-10 and Imagenet with 10 classes, and 3 splits. Larger than CIFAR-10. Classes labelled, training, validation, test set splits created. 270,000 Images Classification 2018 [77] Luke N. Darlow, Elliot J. Crowley, Antreas Antoniou, Amos J. Storkey
Fashion-MNIST A MNIST-like fashion product database Classes labelled, training set splits created. 60,000 Images Classification 2017 [78] Zalando SE
notMNIST Some publicly available fonts and extracted glyphs from them to make a dataset similar to MNIST. There are 10 classes, with letters A-J taken from different fonts. Classes labelled, training set splits created. 500,000 Images Classification 2011 [79] Yaroslav Bulatov
German Traffic Sign Detection Benchmark Dataset Images from vehicles of traffic signs on German roads. These signs comply with UN standards and therefore are the same as in other countries. Signs manually labeled 900 Images Classification 2013 [80][81] S Houben et al.
KITTI Vision Benchmark Dataset Autonomous vehicles driving through a mid-size city captured images of various areas using cameras and laser scanners. Many benchmarks extracted from data. >100 GB of data Images, text Classification, object detection 2012 [82][83][84] A Geiger et al.
Linnaeus 5 dataset Images of 5 classes of objects. Classes labelled, training set splits created. 8000 Images Classification 2017 [85] Chaladze & Kalatozishvili
FieldSAFE Multi-modal dataset for obstacle detection in agriculture including stereo camera, thermal camera, web camera, 360-degree camera, lidar, radar, and precise localization. Classes labelled geographically. >400 GB of data Images and 3D point clouds Classification, object detection, object localization 2017 [86] M. Kragh et al.
11K Hands 11,076 hand images (1600 x 1200 pixels) of 190 subjects, of varying ages between 18 – 75 years old, for gender recognition and biometric identification. None 11,076 hand images Images and (.mat, .txt, and .csv) label files Gender recognition and biometric identification 2017 [87] M Afifi
CORe50 Specifically designed for Continuous/Lifelong Learning and Object Recognition, is a collection of more than 500 videos (30fps) of 50 domestic objects belonging to 10 different categories. Classes labelled, training set splits created based on a 3-way, multi-runs benchmark. 164,866 RBG-D images images (.png or .pkl)

and (.pkl, .txt, .tsv) label files

Classification, Object recognition 2017 [88] V. Lomonaco and D. Maltoni
OpenLORIS-Object Lifelong/Continual Robotic Vision dataset (OpenLORIS-Object) collected by real robots mounted with multiple high-resolution sensors, includes a collection of 121 object instances (1st version of dataset, 40 categories daily necessities objects under 20 scenes). The dataset has rigorously considered 4 environment factors under different scenes, including illumination, occlusion, object pixel size and clutter, and defines the difficulty levels of each factor explicitly. Classes labelled, training/validation/testing set splits created by benchmark scripts. 1,106,424 RBG-D images images (.png and .pkl)

and (.pkl) label files

Classification, Lifelong object recognition, Robotic Vision 2019 [89] Q. She et al.
THz and thermal video data set This multispectral data set includes terahertz, thermal, visual, near infrared, and three-dimensional videos of objects hidden under people's clothes. 3D lookup tables are provided that allow you to project images onto 3D point clouds. More than 20 videos. The duration of each video is about 85 seconds (about 345 frames). AP2J Experiments with hidden object detection 2019 [90][91] Alexei A. Morozov and Olga S. Sushkova
Daimler Monocular Pedestrian Detection dataset It is a dataset of pedestrians in urban environments. Pedestrians are box-wise labeled. Labeled part contains 15560 samples with pedestrians and 6744 samples without. Test set contains 21790 images without labels. Images Object recognition and classification 2006 [92][93][94] Daimler AG
CamVid The Cambridge-driving Labeled Video Database (CamVid) is a collection of videos. The dataset is labeled with semantic labels for 32 semantic classes. over 700 images Images Object recognition and classification 2008 [95][96][97] Gabriel J. Brostow, Jamie Shotton, Julien Fauqueur, Roberto Cipolla
RailSem19 RailSem19 is a dataset for understanding scenes for vision systems on railways. The dataset is labeled semanticly and box-wise. 8500 Images Object recognition and classification, scene recognition 2019 [98][99] Oliver Zendel, Markus Murschitz, Marcel Zeilinger, Daniel Steininger, Sara Abbasi, Csaba Beleznai
BOREAS BOREAS is a multi-season autonomous driving dataset. It includes data from includes a Velodyne Alpha-Prime (128-beam) lidar, a FLIR Blackfly S camera, a Navtech CIR304-H radar, and an Applanix POS LV GNSS-INS. The data is annotated by 3D bounding boxes. 350km of driving data Images, Lidar and Radar data Object recognition and classification, scene recognition 2023 [100][101] Keenan Burnett, David J. Yoon, Yuchen Wu, Andrew Zou Li, Haowei Zhang, Shichen Lu, Jingxing Qian, Wei-Kang Tseng, Andrew Lambert, Keith Y.K. Leung, Angela P. Schoellig, Timothy D. Barfoot
Bosch Small Traffic Lights Dataset It is a dataset of traffic lights. The labeling include bounding boxes of traffic lights together with their state (active light). 5000 images for training and a video sequence of 8334 frames for evaluation Images Traffic light recognition 2017 [102][103] Karsten Behrendt, Libor Novak, Rami Botros
FRSign It is a dataset of French railway signals. The labeling include bounding boxes of railway signals together with their state (active light). more than 100000 Images Railway signal recognition 2020 [104][105] Jeanine Harb, Nicolas Rébéna, Raphaël Chosidow, Grégoire Roblin, Roman Potarusov, Hatem Hajri
GERALD It is a dataset of German railway signals. The labeling include bounding boxes of railway signals together with their state (active light). 5000 Images Railway signal recognition 2023 [106][107] Philipp Leibner, Fabian Hampel, Christian Schindler
Multi-cue pedestrian Multi-cue onboard pedestrian detection dataset is a dataset for detection of pedestrians. The databaset is labeled box-wise. 1092 image pairs with 1776 boxes for pedestrians Images Object recognition and classification 2009 [108] Christian Wojek, Stefan Walk, Bernt Schiele
RAWPED RAWPED is a dataset for detection of pedestrians in the context of railways. The dataset is labeled box-wise. 26000 Images Object recognition and classification 2020 [109][110] Tugce Toprak, Burak Belenlioglu, Burak Aydın, Cuneyt Guzelis, M. Alper Selver
OSDaR23 OSDaR23 is a multi-sensory dataset for detection of objects in the context of railways. The databaset is labeled box-wise. 16874 frames Images, Lidar, Radar and Infrared Object recognition and classification 2023 [111][112] DZSF, Digitale Schiene Deutschland and FusionSystems
Agroverse Argoverse is a multi-sensory dataset for detection of objects in the context of roads. The dataset is annotated box-wise. 320 hours of recording Data from 7 cameras and LiDAR Object recognition and classification, object tracking 2022 [113][114] Argo AI, Carnegie Mellon University, Georgia Institute of Technology

Handwriting and character recognition[edit]

Dataset name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Artificial Characters Dataset Artificially generated data describing the structure of 10 capital English letters. Coordinates of lines drawn given as integers. Various other features. 6000 Text Handwriting recognition, classification 1992 [115] H. Guvenir et al.
Letter Dataset Upper-case printed letters. 17 features are extracted from all images. 20,000 Text OCR, classification 1991 [116][117] D. Slate et al.
CASIA-HWDB Offline handwritten Chinese character database. 3755 classes in the GB 2312 character set. Gray-scaled images with background pixels labeled as 255. 1,172,907 Images, Text Handwriting recognition, classification 2009 [118] CASIA
CASIA-OLHWDB Online handwritten Chinese character database, collected using Anoto pen on paper. 3755 classes in the GB 2312 character set. Provides the sequences of coordinates of strokes. 1,174,364 Images, Text Handwriting recognition, classification 2009 [119][118] CASIA
Character Trajectories Dataset Labeled samples of pen tip trajectories for people writing simple characters. 3-dimensional pen tip velocity trajectory matrix for each sample 2858 Text Handwriting recognition, classification 2008 [120][121] B. Williams
Chars74K Dataset Character recognition in natural images of symbols used in both English and Kannada 74,107 Character recognition, handwriting recognition, OCR, classification 2009 [122] T. de Campos
EMNIST dataset Handwritten characters from 3600 contributors Derived from NIST Special Database 19. Converted to 28x28 pixel images, matching the MNIST dataset.[123] 800,000 Images character recognition, classification, handwriting recognition 2016 EMNIST dataset[124]


Gregory Cohen, et al.
UJI Pen Characters Dataset Isolated handwritten characters Coordinates of pen position as characters were written given. 11,640 Text Handwriting recognition, classification 2009 [126][127] F. Prat et al.
Gisette Dataset Handwriting samples from the often-confused 4 and 9 characters. Features extracted from images, split into train/test, handwriting images size-normalized. 13,500 Images, text Handwriting recognition, classification 2003 [128] Yann LeCun et al.
Omniglot dataset 1623 different handwritten characters from 50 different alphabets. Hand-labeled. 38,300 Images, text, strokes Classification, one-shot learning 2015 [129][130] American Association for the Advancement of Science
MNIST database Database of handwritten digits. Hand-labeled. 60,000 Images, text Classification 1994 [131][132] National Institute of Standards and Technology
Optical Recognition of Handwritten Digits Dataset Normalized bitmaps of handwritten data. Size normalized and mapped to bitmaps. 5620 Images, text Handwriting recognition, classification 1998 [133] E. Alpaydin et al.
Pen-Based Recognition of Handwritten Digits Dataset Handwritten digits on electronic pen-tablet. Feature vectors extracted to be uniformly spaced. 10,992 Images, text Handwriting recognition, classification 1998 [134][135] E. Alpaydin et al.
Semeion Handwritten Digit Dataset Handwritten digits from 80 people. All handwritten digits have been normalized for size and mapped to the same grid. 1593 Images, text Handwriting recognition, classification 2008 [136] T. Srl
HASYv2 Handwritten mathematical symbols All symbols are centered and of size 32px x 32px. 168233 Images, text Classification 2017 [137] Martin Thoma
Noisy Handwritten Bangla Dataset Includes Handwritten Numeral Dataset (10 classes) and Basic Character Dataset (50 classes), each dataset has three types of noise: white gaussian, motion blur, and reduced contrast. All images are centered and of size 32x32. Numeral Dataset:


Character Dataset:




Handwriting recognition,


2017 [138][139] M. Karki et al.

Aerial images[edit]

Dataset name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
iSAID: Instance Segmentation in Aerial Images Dataset Precise instance-level annotatio carried out by professional annotators, cross-checked and validated by expert annotators complying with well-defined guidelines. 655,451 (15 classes) Images, jpg, json Aerial Classification, Object Detection, Instance Segmentation 2019 [140][141] Syed Waqas Zamir,

Aditya Arora,

Akshita Gupta,

Salman Khan,

Guolei Sun,

Fahad Shahbaz Khan, Fan Zhu,

Ling Shao, Gui-Song Xia, Xiang Bai

Aerial Image Segmentation Dataset 80 high-resolution aerial images with spatial resolution ranging from 0.3 to 1.0. Images manually segmented. 80 Images Aerial Classification, object detection 2013 [142][143] J. Yuan et al.
KIT AIS Data Set Multiple labeled training and evaluation datasets of aerial images of crowds. Images manually labeled to show paths of individuals through crowds. ~ 150 Images with paths People tracking, aerial tracking 2012 [144][145] M. Butenuth et al.
Wilt Dataset Remote sensing data of diseased trees and other land cover. Various features extracted. 4899 Images Classification, aerial object detection 2014 [146][147] B. Johnson
MASATI dataset Maritime scenes of optical aerial images from the visible spectrum. It contains color images in dynamic marine environments, each image may contain one or multiple targets in different weather and illumination conditions. Object bounding boxes and labeling. 7389 Images Classification, aerial object detection 2018 [148][149] A.-J. Gallego et al.
Forest Type Mapping Dataset Satellite imagery of forests in Japan. Image wavelength bands extracted. 326 Text Classification 2015 [150][151] B. Johnson
Overhead Imagery Research Data Set Annotated overhead imagery. Images with multiple objects. Over 30 annotations and over 60 statistics that describe the target within the context of the image. 1000 Images, text Classification 2009 [152][153] F. Tanner et al.
SpaceNet SpaceNet is a corpus of commercial satellite imagery and labeled training data. GeoTiff and GeoJSON files containing building footprints. >17533 Images Classification, Object Identification 2017 [154][155][156] DigitalGlobe, Inc.
UC Merced Land Use Dataset These images were manually extracted from large images from the USGS National Map Urban Area Imagery collection for various urban areas around the US. This is a 21 class land use image dataset meant for research purposes. There are 100 images for each class. 2,100 Image chips of 256x256, 30 cm (1 foot) GSD Land cover classification 2010 [157] Yi Yang and Shawn Newsam
SAT-4 Airborne Dataset Images were extracted from the National Agriculture Imagery Program (NAIP) dataset. SAT-4 has four broad land cover classes, includes barren land, trees, grassland and a class that consists of all land cover classes other than the above three. 500,000 Images Classification 2015 [158][159] S. Basu et al.
SAT-6 Airborne Dataset Images were extracted from the National Agriculture Imagery Program (NAIP) dataset. SAT-6 has six broad land cover classes, includes barren land, trees, grassland, roads, buildings and water bodies. 405,000 Images Classification 2015 [158][159] S. Basu et al.

Underwater images[edit]

Dataset name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
SUIM Dataset The images have been rigorously collected during oceanic explorations and human-robot collaborative experiments, and annotated by human participants. Images with pixel annotations for eight object categories: fish (vertebrates), reefs (invertebrates), aquatic plants, wrecks/ruins, human divers, robots, and sea-floor. 1,635 Images Segmentation 2020 [160] Md Jahidul Islam et al.
LIACI Dataset Images have been collected during underwater ship inspections and annotated by human domain experts. Images with pixel annotations for ten object categories: defects, corrosion, paint peel, marine growth, sea chest gratings, overboard valves, propeller, anodes, bilge keel and ship hull. 1,893 Images Segmentation 2022 [161] Waszak et al.

Other images[edit]

Dataset name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
NRC-GAMMA A novel benchmark gas meter image dataset None 28,883 Image, Label Classification 2021 [162][163] A. Ebadi, P. Paul, S. Auer, & S. Tremblay
The SUPATLANTIQUE dataset Images of scanned official and Wikipedia documents None 4908 TIFF/pdf Source device identification, forgery detection, Classification,.. 2020 [164] C. Ben Rabah et al.
Density functional theory quantum simulations of graphene Labelled images of raw input to a simulation of graphene Raw data (in HDF5 format) and output labels from density functional theory quantum simulation 60744 test and 501473 training files Labeled images Regression 2019 [165] K. Mills & I. Tamblyn
Quantum simulations of an electron in a two dimensional potential well Labelled images of raw input to a simulation of 2d Quantum mechanics Raw data (in HDF5 format) and output labels from quantum simulation 1.3 million images Labeled images Regression 2017 [166] K. Mills, M.A. Spanner, & I. Tamblyn
MPII Cooking Activities Dataset Videos and images of various cooking activities. Activity paths and directions, labels, fine-grained motion labeling, activity class, still image extraction and labeling. 881,755 frames Labeled video, images, text Classification 2012 [167][168] M. Rohrbach et al.
FAMOS Dataset 5,000 unique microstructures, all samples have been acquired 3 times with two different cameras. Original PNG files, sorted per camera and then per acquisition. MATLAB datafiles with one 16384 times 5000 matrix per camera per acquisition. 30,000 Images and .mat files Authentication 2012 [169] S. Voloshynovskiy, et al.
PharmaPack Dataset 1,000 unique classes with 54 images per class. Class labeling, many local descriptors, like SIFT and aKaZE, and local feature agreators, like Fisher Vector (FV). 54,000 Images and .mat files Fine-grain classification 2017 [170] O. Taran and S. Rezaeifar, et al.
Stanford Dogs Dataset Images of 120 breeds of dogs from around the world. Train/test splits and ImageNet annotations provided. 20,580 Images, text Fine-grain classification 2011 [171][172] A. Khosla et al.
StanfordExtra Dataset 2D keypoints and segmentations for the Stanford Dogs Dataset. 2D keypoints and segmentations provided. 12,035 Labelled images 3D reconstruction/pose estimation 2020 [173] B. Biggs et al.
The Oxford-IIIT Pet Dataset 37 categories of pets with roughly 200 images of each. Breed labeled, tight bounding box, foreground-background segmentation. ~ 7,400 Images, text Classification, object detection 2012 [172][174] O. Parkhi et al.
Corel Image Features Data Set Database of images with features extracted. Many features including color histogram, co-occurrence texture, and colormoments, 68,040 Text Classification, object detection 1999 [175][176] M. Ortega-Bindenberger et al.
Online Video Characteristics and Transcoding Time Dataset. Transcoding times for various different videos and video properties. Video features given. 168,286 Text Regression 2015 [177] T. Deneke et al.
Microsoft Sequential Image Narrative Dataset (SIND) Dataset for sequential vision-to-language Descriptive caption and storytelling given for each photo, and photos are arranged in sequences 81,743 Images, text Visual storytelling 2016 [178] Microsoft Research
Caltech-UCSD Birds-200-2011 Dataset Large dataset of images of birds. Part locations for birds, bounding boxes, 312 binary attributes given 11,788 Images, text Classification 2011 [179][180] C. Wah et al.
YouTube-8M Large and diverse labeled video dataset YouTube video IDs and associated labels from a diverse vocabulary of 4800 visual entities 8 million Video, text Video classification 2016 [181][182] S. Abu-El-Haija et al.
YFCC100M Large and diverse labeled image and video dataset Flickr Videos and Images and associated description, titles, tags, and other metadata (such as EXIF and geotags) 100 million Video, Image, Text Video and Image classification 2016 [183][184] B. Thomee et al.
Discrete LIRIS-ACCEDE Short videos annotated for valence and arousal. Valence and arousal labels. 9800 Video Video emotion elicitation detection 2015 [185] Y. Baveye et al.
Continuous LIRIS-ACCEDE Long videos annotated for valence and arousal while also collecting Galvanic Skin Response. Valence and arousal labels. 30 Video Video emotion elicitation detection 2015 [186] Y. Baveye et al.
MediaEval LIRIS-ACCEDE Extension of Discrete LIRIS-ACCEDE including annotations for violence levels of the films. Violence, valence and arousal labels. 10900 Video Video emotion elicitation detection 2015 [187] Y. Baveye et al.
Leeds Sports Pose Articulated human pose annotations in 2000 natural sports images from Flickr. Rough crop around single person of interest with 14 joint labels 2000 Images plus .mat file labels Human pose estimation 2010 [188] S. Johnson and M. Everingham
Leeds Sports Pose Extended Training Articulated human pose annotations in 10,000 natural sports images from Flickr. 14 joint labels via crowdsourcing 10000 Images plus .mat file labels Human pose estimation 2011 [189] S. Johnson and M. Everingham
MCQ Dataset 6 different real multiple choice-based exams (735 answer sheets and 33,540 answer boxes) to evaluate computer vision techniques and systems developed for multiple choice test assessment systems. None 735 answer sheets and 33,540 answer boxes Images and .mat file labels Development of multiple choice test assessment systems 2017 [190][191] Afifi, M. et al.
Surveillance Videos Real surveillance videos cover a large surveillance time (7 days with 24 hours each). None 19 surveillance videos (7 days with 24 hours each). Videos Data compression 2016 [192] Taj-Eddin, I. A. T. F. et al.
LILA BC Labeled Information Library of Alexandria: Biology and Conservation. Labeled images that support machine learning research around ecology and environmental science. None ~10M images Images Classification 2019 [193] LILA working group
Can We See Photosynthesis? 32 videos for eight live and eight dead leaves recorded under both DC and AC lighting conditions. None 32 videos Videos Liveness detection of plants 2017 [194] Taj-Eddin, I. A. T. F. et al.
Mathematical Mathematics Memes Collection of 10,000 memes on mathematics. None ~10,000 Images Visual storytelling, object detection. 2021 [195] Mathematical Mathematics Memes
Flickr-Faces-HQ Dataset Collection of images containing a face each, crawled from Flickr Pruned with "various automatic filters", cropped and aligned to faces, and had images of statues, paintings, or photos of photos removed via crowdsourcing 70,000 Images Face Generation 2019 [196] Karras et al.

Text data[edit]

These datasets consist primarily of text for tasks such as natural language processing, sentiment analysis, translation, and cluster analysis.


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Amazon reviews US product reviews from None. 233.1 million Text Classification, sentiment analysis 2015 (2018) [197][198] McAuley et al.
OpinRank Review Dataset Reviews of cars and hotels from and TripAdvisor respectively. None. 42,230 / ~259,000 respectively Text Sentiment analysis, clustering 2011 [199][200] K. Ganesan et al.
MovieLens 22,000,000 ratings and 580,000 tags applied to 33,000 movies by 240,000 users. None. ~ 22M Text Regression, clustering, classification 2016 [201] GroupLens Research
Yahoo! Music User Ratings of Musical Artists Over 10M ratings of artists by Yahoo users. None described. ~ 10M Text Clustering, regression 2004 [202][203] Yahoo!
Car Evaluation Data Set Car properties and their overall acceptability. Six categorical features given. 1728 Text Classification 1997 [204][205] M. Bohanec
YouTube Comedy Slam Preference Dataset User vote data for pairs of videos shown on YouTube. Users voted on funnier videos. Video metadata given. 1,138,562 Text Classification 2012 [206][207] Google
Skytrax User Reviews Dataset User reviews of airlines, airports, seats, and lounges from Skytrax. Ratings are fine-grain and include many aspects of airport experience. 41396 Text Classification, regression 2015 [208] Q. Nguyen
Teaching Assistant Evaluation Dataset Teaching assistant reviews. Features of each instance such as class, class size, and instructor are given. 151 Text Classification 1997 [209][210] W. Loh et al.
Vietnamese Students’ Feedback Corpus (UIT-VSFC) Students’ Feedback. Comments 16,000 Text Classification 1997 [211] Nguyen et al.
Vietnamese Social Media Emotion Corpus (UIT-VSMEC) Users’ Facebook Comments. Comments 6,927 Text Classification 1997 [212] Nguyen et al.
Vietnamese Open-domain Complaint Detection dataset (ViOCD) Customer product reviews Comments 5,485 Text Classification 2021 [213] Nguyen et al.
ViHOS: Hate Speech Spans Detection for Vietnamese Social Media Texts Comments Containing 26k spans on 11k comments Text Span Detection 2021 [214] Hoang et al.

News articles[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
NYSK Dataset English news articles about the case relating to allegations of sexual assault against the former IMF director Dominique Strauss-Kahn. Filtered and presented in XML format. 10,421 XML, text Sentiment analysis, topic extraction 2013 [215] Dermouche, M. et al.
The Reuters Corpus Volume 1 Large corpus of Reuters news stories in English. Fine-grain categorization and topic codes. 810,000 Text Classification, clustering, summarization 2002 [216] Reuters
The Reuters Corpus Volume 2 Large corpus of Reuters news stories in multiple languages. Fine-grain categorization and topic codes. 487,000 Text Classification, clustering, summarization 2005 [217] Reuters
Thomson Reuters Text Research Collection Large corpus of news stories. Details not described. 1,800,370 Text Classification, clustering, summarization 2009 [218] T. Rose et al.
Saudi Newspapers Corpus 31,030 Arabic newspaper articles. Metadata extracted. 31,030 JSON Summarization, clustering 2015 [219] M. Alhagri
RE3D (Relationship and Entity Extraction Evaluation Dataset) Entity and Relation marked data from various news and government sources. Sponsored by Dstl Filtered, categorisation using Baleen types not known JSON Classification, Entity and Relation recognition 2017 [220] Dstl
Examiner Spam Clickbait Catalogue Clickbait, spam, crowd-sourced headlines from 2010 to 2015 Publish date and headlines 3,089,781 CSV Clustering, Events, Sentiment 2016 [221] R. Kulkarni
ABC Australia News Corpus Entire news corpus of ABC Australia from 2003 to 2019 Publish date and headlines 1,186,018 CSV Clustering, Events, Sentiment 2020 [222] R. Kulkarni
Worldwide News – Aggregate of 20K Feeds One week snapshot of all online headlines in 20+ languages Publish time, URL and headlines 1,398,431 CSV Clustering, Events, Language Detection 2018 [223] R. Kulkarni
Reuters News Wire Headline 11 Years of timestamped events published on the news-wire Publish time, Headline Text 16,121,310 CSV NLP, Computational Linguistics, Events 2018 [224] R. Kulkarni
The Irish Times Ireland News Corpus 24 Years of Ireland News from 1996 to 2019 Publish time, Headline Category and Text 1,484,340 CSV NLP, Computational Linguistics, Events 2020 [225] R. Kulkarni
News Headlines Dataset for Sarcasm Detection High quality dataset with Sarcastic and Non-sarcastic news headlines. Clean, normalized text 26,709 JSON NLP, Classification, Linguistics 2018 [226] Rishabh Misra


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Enron Email Dataset Emails from employees at Enron organized into folders. Attachments removed, invalid email addresses converted to or ~ 500,000 Text Network analysis, sentiment analysis 2004 (2015) [227][228] Klimt, B. and Y. Yang
Ling-Spam Dataset Corpus containing both legitimate and spam emails. Four version of the corpus involving whether or not a lemmatiser or stop-list was enabled. 2,412 Ham 481 Spam Text Classification 2000 [229][230] Androutsopoulos, J. et al.
SMS Spam Collection Dataset Collected SMS spam messages. None. 5,574 Text Classification 2011 [231][232] T. Almeida et al.
Twenty Newsgroups Dataset Messages from 20 different newsgroups. None. 20,000 Text Natural language processing 1999 [233] T. Mitchell et al.
Spambase Dataset Spam emails. Many text features extracted. 4,601 Text Spam detection, classification 1999 [234] M. Hopkins et al.

Twitter and tweets[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
MovieTweetings Movie rating dataset based on public and well-structured tweets ~710,000 Text Classification, regression 2018 [235] S. Dooms
Twitter100k Pairs of images and tweets 100,000 Text and Images Cross-media retrieval 2017 [236][237] Y. Hu, et al.
Sentiment140 Tweet data from 2009 including original text, time stamp, user and sentiment. Classified using distant supervision from presence of emoticon in tweet. 1,578,627 Tweets, comma, separated values Sentiment analysis 2009 [238][239] A. Go et al.
ASU Twitter Dataset Twitter network data, not actual tweets. Shows connections between a large number of users. None. 11,316,811 users, 85,331,846 connections Text Clustering, graph analysis 2009 [240][241] R. Zafarani et al.
SNAP Social Circles: Twitter Database Large Twitter network data. Node features, circles, and ego networks. 1,768,149 Text Clustering, graph analysis 2012 [242][243] J. McAuley et al.
Twitter Dataset for Arabic Sentiment Analysis Arabic tweets. Samples hand-labeled as positive or negative. 2000 Text Classification 2014 [244][245] N. Abdulla
Buzz in Social Media Dataset Data from Twitter and Tom's Hardware. This dataset focuses on specific buzz topics being discussed on those sites. Data is windowed so that the user can attempt to predict the events leading up to social media buzz. 140,000 Text Regression, Classification 2013 [246][247] F. Kawala et al.
Paraphrase and Semantic Similarity in Twitter (PIT) This dataset focuses on whether tweets have (almost) same meaning/information or not. Manually labeled. tokenization, part-of-speech and named entity tagging 18,762 Text Regression, Classification 2015 [248][249] Xu et al.
Geoparse Twitter benchmark dataset This dataset contains tweets during different news events in different countries. Manually labeled location mentions. location annotations added to JSON metadata 6,386 Tweets, JSON Classification, Information Extraction 2014 [250][251] S.E. Middleton et al.
Dutch Social media collection This dataset contains COVID-19 tweets made by Dutch speakers or users from Netherlands. The data has been machine labeled classified for sentiment, tweet text & user description translated to English. Industry mention are extracted 271,342 JSONL Sentiment, multi-label classification, machine translation 2020 [252][253][254] Aaaksh Gupta, CoronaWhy


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
NPS Chat Corpus Posts from age-specific online chat rooms. Hand privacy masked, tagged for part of speech and dialogue-act. ~ 500,000 XML NLP, programming, linguistics 2007 [255] Forsyth, E., Lin, J., & Martell, C.
Twitter Triple Corpus A-B-A triples extracted from Twitter. 4,232 Text NLP 2016 [256] Sordini, A. et al.
UseNet Corpus UseNet forum postings. Anonymized e-mails and URLs. Omitted documents with lengths <500 words or >500,000 words, or that were <90% English. 7 billion Text 2011 [257] Shaoul, C., & Westbury C.
NUS SMS Corpus SMS messages collected between two users, with timing analysis. ~ 10,000 XML NLP 2011 [258] KAN, M
Reddit All Comments Corpus All Reddit comments (as of 2015). ~ 1.7 billion JSON NLP, research 2015 [259] Stuck_In_the_Matrix
Ubuntu Dialogue Corpus Dialogues extracted from Ubuntu chat stream on IRC. 930 thousand dialogues, 7.1 million utterances CSV Dialogue Systems Research 2015 [260] Lowe, R. et al.
Dialog State Tracking Challenge The Dialog State Tracking Challenges 2 & 3 (DSTC2&3) were research challenge focused on improving the state of the art in tracking the state of spoken dialog systems. Transcription of spoken dialogs with labelling DSTC2 contains ~3.2k calls – DSTC3 contains ~2.3k calls Json Dialogue state tracking 2014 [261] Henderson, Matthew and Thomson, Blaise and Williams, Jason D


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
FreeLaw Filtered data from Court Listener, part of the FreeLaw project. Cleaned and normalized text 4,940,710 Json NLP, linguistics 2020 [262] T. Hoppe
Pile of Law Corpus of legal and administrative data Cleaned, normalized, and privatized ~50,000,000 Json NLP, linguistics, sentiment 2022 [263][264] L. Zheng; N. Guha; B. Anderson; P. Henderson; D. Ho
Caselaw Access Project All official, book-published state and federal United States case law — every volume or case designated as an official report of decisions by a court within the United States. Cleaned and normalized text ~10,000 Json NLP, linguistics 2022 [265] A. Aizman; S. Chapman; J. Cushman; K. Dulin; H. Eidolon; et all

Other text[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Web of Science Dataset Hierarchical Datasets for Text Classification None. 46,985 Text Classification,


2017 [266][267] K. Kowsari et al.
Legal Case Reports Federal Court of Australia cases from 2006 to 2009. None. 4,000 Text Summarization,

citation analysis

2012 [268][269] F. Galgani et al.
Blogger Authorship Corpus Blog entries of 19,320 people from Blogger self-provided gender, age, industry, and astrological sign. 681,288 Text Sentiment analysis, summarization, classification 2006 [270][271] J. Schler et al.
Social Structure of Facebook Networks Large dataset of the social structure of Facebook. None. 100 colleges covered Text Network analysis, clustering 2012 [272][273] A. Traud et al.
Dataset for the Machine Comprehension of Text Stories and associated questions for testing comprehension of text. None. 660 Text Natural language processing, machine comprehension 2013 [274][275] M. Richardson et al.
The Penn Treebank Project Naturally occurring text annotated for linguistic structure. Text is parsed into semantic trees. ~ 1M words Text Natural language processing, summarization 1995 [276][277] M. Marcus et al.
DEXTER Dataset Task given is to determine, from features given, which articles are about corporate acquisitions. Features extracted include word stems. Distractor features included. 2600 Text Classification 2008 [278] Reuters
Google Books N-grams N-grams from a very large corpus of books None. 2.2 TB of text Text Classification, clustering, regression 2011 [279][280] Google
Personae Corpus Collected for experiments in Authorship Attribution and Personality Prediction. Consists of 145 Dutch-language essays. In addition to normal texts, syntactically annotated texts are given. 145 Text Classification, regression 2008 [281][282] K. Luyckx et al.
PushShift Archives of social media websites, including Reddit, Twitter, and Hackernews. Text extracted and normalized from WARCs ~100,000,000 posts Json NLP, sentiment, linguistics 2022 [283][284] J. Baumgartner
CNAE-9 Dataset Categorization task for free text descriptions of Brazilian companies. Word frequency has been extracted. 1080 Text Classification 2012 [285][286] P. Ciarelli et al.
Sentiment Labeled Sentences Dataset 3000 sentiment labeled sentences. Sentiment of each sentence has been hand labeled as positive or negative. 3000 Text Classification, sentiment analysis 2015 [287][288] D. Kotzias
BlogFeedback Dataset Dataset to predict the number of comments a post will receive based on features of that post. Many features of each post extracted. 60,021 Text Regression 2014 [289][290] K. Buza
Stanford Natural Language Inference (SNLI) Corpus Image captions matched with newly constructed sentences to form entailment, contradiction, or neutral pairs. Entailment class labels, syntactic parsing by the Stanford PCFG parser 570,000 Text Natural language inference/recognizing textual entailment 2015 [291] S. Bowman et al.
DSL Corpus Collection (DSLCC) A multilingual collection of short excerpts of journalistic texts in similar languages and dialects. None 294,000 phrases Text Discriminating between similar languages 2017 [292] Tan, Liling et al.
Urban Dictionary Dataset Corpus of words, votes and definitions User names anonymised 2,580,925 CSV NLP, Machine comprehension 2016 May [293] Anonymous
T-REx Wikipedia abstracts aligned with Wikidata entities Alignment of Wikidata triples with Wikipedia abstracts 11M aligned triples JSON and NIF [2] NLP, Relation Extraction 2018 [294] H. Elsahar et al.
General Language Understanding Evaluation (GLUE) Benchmark of nine tasks Various ~1M sentences and sentence pairs NLU 2018 [295][296][297] Wang et al.
Contract Understanding Atticus Dataset (CUAD) (formerly known as Atticus Open Contract Dataset (AOK)) Dataset of legal contracts with rich expert annotations ~13,000 labels CSV and PDF Natural language processing, QnA 2021 The Atticus Project
Vietnamese Image Captioning Dataset (UIT-ViIC) Vietnamese Image Captioning Dataset 19,250 captions for 3,850 images CSV and PDF Natural language processing, Computer vision 2020 [298] Lam et al.
Vietnamese Names annotated with Genders (UIT-ViNames) Vietnamese Names annotated with Genders 26,850 Vietnamese full names annotated with genders CSV Natural language processing 2020 [299] To et al.
Vietnamese Constructive and Toxic Speech Detection Dataset (UIT-ViCTSD) Vietnamese Constructive and Toxic Speech Detection Dataset 10,000 Vietnamese users' comments on online newspapers on 10 domains CSV Natural Language Processing 2021 [300] Nguyen et al.

Sound data[edit]

These datasets consist of sounds and sound features used for tasks such as speech recognition and speech synthesis.


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Zero Resource Speech Challenge 2015 Spontaneous speech (English), Read speech (Xitsonga). None, raw WAV files. English: 5h, 12 speakers; Xitsonga: 2h30, 24 speakers WAV (audio only) Unsupervised discovery of speech features/subword units/word units 2015 [301][302] Versteegh et al.
Parkinson Speech Dataset Multiple recordings of people with and without Parkinson's Disease. Voice features extracted, disease scored by physician using unified Parkinson's disease rating scale. 1,040 Text Classification, regression 2013 [303][304] B. E. Sakar et al.
Spoken Arabic Digits Spoken Arabic digits from 44 male and 44 female. Time-series of mel-frequency cepstrum coefficients. 8,800 Text Classification 2010 [305][306] M. Bedda et al.
ISOLET Dataset Spoken letter names. Features extracted from sounds. 7797 Text Classification 1994 [307][308] R. Cole et al.
Japanese Vowels Dataset Nine male speakers uttered two Japanese vowels successively. Applied 12-degree linear prediction analysis to it to obtain a discrete-time series with 12 cepstrum coefficients. 640 Text Classification 1999 [309][310] M. Kudo et al.
Parkinson's Telemonitoring Dataset Multiple recordings of people with and without Parkinson's Disease. Sound features extracted. 5875 Text Classification 2009 [311][312] A. Tsanas et al.
TIMIT Recordings of 630 speakers of eight major dialects of American English, each reading ten phonetically rich sentences. Speech is lexically and phonemically transcribed. 6300 Text Speech recognition, classification. 1986 [313][314] J. Garofolo et al.
Arabic Speech Corpus A single-speaker, Modern Standard Arabic (MSA) speech corpus with phonetic and orthographic transcripts aligned to phoneme level. Speech is orthographically and phonetically transcribed with stress marks. ~1900 Text, WAV Speech Synthesis, Speech Recognition, Corpus Alignment, Speech Therapy, Education. 2016 [315] N. Halabi
Common Voice A public domain database of crowdsourced data across a wide range of dialects. Validation by other users . English: 1,118 hours MP3 with corresponding text files Speech recognition June 2017 (December 2019) [316] Mozilla
LJSpeech A single-speaker corpus of English public-domain audiobook recordings, split into short clips at punctuation marks. Quality check, normalized transcription alongside the original. 13,100 CSV, WAV Speech synthesis 2017 [317] Keith Ito, Linda Johnson


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Geographic Origin of Music Data Set Audio features of music samples from different locations. Audio features extracted using MARSYAS software. 1,059 Text Geographic classification, clustering 2014 [318][319] F. Zhou et al.
Million Song Dataset Audio features from one million different songs. Audio features extracted. 1M Text Classification, clustering 2011 [320][321] T. Bertin-Mahieux et al.
MUSDB18 Multi-track popular music recordings Raw audio 150 MP4, WAV Source Separation 2017 [322] Z. Rafii et al.
Free Music Archive Audio under Creative Commons from 100k songs (343 days, 1TiB) with a hierarchy of 161 genres, metadata, user data, free-form text. Raw audio and audio features. 106,574 Text, MP3 Classification, recommendation 2017 [323] M. Defferrard et al.
Bach Choral Harmony Dataset Bach chorale chords. Audio features extracted. 5665 Text Classification 2014 [324][325] D. Radicioni et al.

Other sounds[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
UrbanSound Labeled sound recordings of sounds like air conditioners, car horns and children playing. Sorted into folders by class of events as well as metadata in a JSON file and annotations in a CSV file. 1,059 Sound


Classification 2014 [326][327] J. Salamon et al.
AudioSet 10-second sound snippets from YouTube videos, and an ontology of over 500 labels. 128-d PCA'd VGG-ish features every 1 second. 2,084,320 Text (CSV) and TensorFlow Record files Classification 2017 [328] J. Gemmeke et al., Google
Bird Audio Detection challenge Audio from environmental monitoring stations, plus crowdsourced recordings 17,000+ Classification 2016 (2018) [329][330] Queen Mary University and IEEE Signal Processing Society
WSJ0 Hipster Ambient Mixtures Audio from WSJ0 mixed with noise recorded in the San Francisco Bay Area Noise clips matched to WSJ0 clips 28,000 Sound (WAV) Audio source separation 2019 [331] Wichern, G., et al., Whisper and MERL
Clotho 4,981 audio samples of 15 to 30 seconds long, each audio sample having five different captions of eight to 20 words long. 24,905 Sound (WAV) and text (CSV) Automated audio captioning 2020 [332][333] K. Drossos, S. Lipping, and T. Virtanen

Signal data[edit]

Datasets containing electric signal information requiring some sort of signal processing for further analysis.


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Witty Worm Dataset Dataset detailing the spread of the Witty worm and the infected computers. Split into a publicly available set and a restricted set containing more sensitive information like IP and UDP headers. 55,909 IP addresses Text Classification 2004 [334][335] Center for Applied Internet Data Analysis
Cuff-Less Blood Pressure Estimation Dataset Cleaned vital signals from human patients which can be used to estimate blood pressure. 125 Hz vital signs have been cleaned. 12,000 Text Classification, regression 2015 [336][337] M. Kachuee et al.
Gas Sensor Array Drift Dataset Measurements from 16 chemical sensors utilized in simulations for drift compensation. Extensive number of features given. 13,910 Text Classification 2012 [338][339] A. Vergara
Servo Dataset Data covering the nonlinear relationships observed in a servo-amplifier circuit. Levels of various components as a function of other components are given. 167 Text Regression 1993 [340][341] K. Ullrich
UJIIndoorLoc-Mag Dataset Indoor localization database to test indoor positioning systems. Data is magnetic field based. Train and test splits given. 40,000 Text Classification, regression, clustering 2015 [342][343] D. Rambla et al.
Sensorless Drive Diagnosis Dataset Electrical signals from motors with defective components. Statistical features extracted. 58,508 Text Classification 2015 [344][345] M. Bator


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Wearable Computing: Classification of Body Postures and Movements (PUC-Rio) People performing five standard actions while wearing motion trackers. None. 165,632 Text Classification 2013 [346][347] Pontifical Catholic University of Rio de Janeiro
Gesture Phase Segmentation Dataset Features extracted from video of people doing various gestures. Features extracted aim at studying gesture phase segmentation. 9900 Text Classification, clustering 2014 [348][349] R. Madeo et a
Vicon Physical Action Data Set Dataset 10 normal and 10 aggressive physical actions that measure the human activity tracked by a 3D tracker. Many parameters recorded by 3D tracker. 3000 Text Classification 2011 [350][351] T. Theodoridis
Daily and Sports Activities Dataset Motor sensor data for 19 daily and sports activities. Many sensors given, no preprocessing done on signals. 9120 Text Classification 2013 [352][353] B. Barshan et al.
Human Activity Recognition Using Smartphones Dataset Gyroscope and accelerometer data from people wearing smartphones and performing normal actions. Actions performed are labeled, all signals preprocessed for noise. 10,299 Text Classification 2012 [354][355] J. Reyes-Ortiz et al.
Australian Sign Language Signs Australian sign language signs captured by motion-tracking gloves. None. 2565 Text Classification 2002 [356][357] M. Kadous
Weight Lifting Exercises monitored with Inertial Measurement Units Five variations of the biceps curl exercise monitored with IMUs. Some statistics calculated from raw data. 39,242 Text Classification 2013 [358][359] W. Ugulino et al.
sEMG for Basic Hand movements Dataset Two databases of surface electromyographic signals of 6 hand movements. None. 3000 Text Classification 2014 [360][361] C. Sapsanis et al.
REALDISP Activity Recognition Dataset Evaluate techniques dealing with the effects of sensor displacement in wearable activity recognition. None. 1419 Text Classification 2014 [361][362] O. Banos et al.
Heterogeneity Activity Recognition Dataset Data from multiple different smart devices for humans performing various activities. None. 43,930,257 Text Classification, clustering 2015 [363][364] A. Stisen et al.
Indoor User Movement Prediction from RSS Data Temporal wireless network data that can be used to track the movement of people in an office. None. 13,197 Text Classification 2016 [365][366] D. Bacciu
PAMAP2 Physical Activity Monitoring Dataset 18 different types of physical activities performed by 9 subjects wearing 3 IMUs. None. 3,850,505 Text Classification 2012 [367] A. Reiss
OPPORTUNITY Activity Recognition Dataset Human Activity Recognition from wearable, object, and ambient sensors is a dataset devised to benchmark human activity recognition algorithms. None. 2551 Text Classification 2012 [368][369] D. Roggen et al.
Real World Activity Recognition Dataset Human Activity Recognition from wearable devices. Distinguishes between seven on-body device positions and comprises six different kinds of sensors. None. 3,150,000 (per sensor) Text Classification 2016 [370] T. Sztyler et al.
Toronto Rehab Stroke Pose Dataset 3D human pose estimates (Kinect) of stroke patients and healthy participants performing a set of tasks using a stroke rehabilitation robot. None. 10 healthy person and 9 stroke survivors (3500–6000 frames per person) CSV Classification 2017 [371][372][373] E. Dolatabadi et al.
Corpus of Social Touch (CoST) 7805 gesture captures of 14 different social touch gestures performed by 31 subjects. The gestures were performed in three variations: gentle, normal and rough, on a pressure sensor grid wrapped around a mannequin arm. Touch gestures performed are segmented and labeled. 7805 gesture captures CSV Classification 2016 [374][375] M. Jung et al.

Other signals[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Wine Dataset Chemical analysis of wines grown in the same region in Italy but derived from three different cultivars. 13 properties of each wine are given 178 Text Classification, regression 1991 [376][377] M. Forina et al.
Combined Cycle Power Plant Data Set Data from various sensors within a power plant running for 6 years. None 9568 Text Regression 2014 [378][379] P. Tufekci et al.

Physical data[edit]

Datasets from physical systems.

High-energy physics[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
HIGGS Dataset Monte Carlo simulations of particle accelerator collisions. 28 features of each collision are given. 11M Text Classification 2014 [380][381][382] D. Whiteson
HEPMASS Dataset Monte Carlo simulations of particle accelerator collisions. Goal is to separate the signal from noise. 28 features of each collision are given. 10,500,000 Text Classification 2016 [381][382][383] D. Whiteson


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Yacht Hydrodynamics Dataset Yacht performance based on dimensions. Six features are given for each yacht. 308 Text Regression 2013 [384][385] R. Lopez
Robot Execution Failures Dataset 5 data sets that center around robotic failure to execute common tasks. Integer valued features such as torque and other sensor measurements. 463 Text Classification 1999 [386] L. Seabra et al.
Pittsburgh Bridges Dataset Design description is given in terms of several properties of various bridges. Various bridge features are given. 108 Text Classification 1990 [387][388] Y. Reich et al.
Automobile Dataset Data about automobiles, their insurance risk, and their normalized losses. Car features extracted. 205 Text Regression 1987 [389][390] J. Schimmer et al.
Auto MPG Dataset MPG data for cars. Eight features of each car given. 398 Text Regression 1993 [391] Carnegie Mellon University
Energy Efficiency Dataset Heating and cooling requirements given as a function of building parameters. Building parameters given. 768 Text Classification, regression 2012 [392][393] A. Xifara et al.
Airfoil Self-Noise Dataset A series of aerodynamic and acoustic tests of two and three-dimensional airfoil blade sections. Data about frequency, angle of attack, etc., are given. 1503 Text Regression 2014 [394] R. Lopez
Challenger USA Space Shuttle O-Ring Dataset Attempt to predict O-ring problems given past Challenger data. Several features of each flight, such as launch temperature, are given. 23 Text Regression 1993 [395][396] D. Draper et al.
Statlog (Shuttle) Dataset NASA space shuttle datasets. Nine features given. 58,000 Text Classification 2002 [397] NASA


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Volcanoes on Venus – JARtool experiment Dataset Venus images returned by the Magellan spacecraft. Images are labeled by humans. not given Images Classification 1991 [398][399] M. Burl
MAGIC Gamma Telescope Dataset Monte Carlo generated high-energy gamma particle events. Numerous features extracted from the simulations. 19,020 Text Classification 2007 [399][400] R. Bock
Solar Flare Dataset Measurements of the number of certain types of solar flare events occurring in a 24-hour period. Many solar flare-specific features are given. 1389 Text Regression, classification 1989 [401] G. Bradshaw
CAMELS Multifield Dataset 2D maps and 3D grids from thousands of N-body and state-of-the-art hydrodynamic simulations spanning a broad range in the value of the cosmological and astrophysical parameters Each map and grid has 6 cosmological and astrophysical parameters associated to it 405,000 2D maps and 405,000 3D grids 2D maps and 3D grids Regression 2021 [402] Francisco Villaescusa-Navarro et al.

Earth science[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Volcanoes of the World Volcanic eruption data for all known volcanic events on earth. Details such as region, subregion, tectonic setting, dominant rock type are given. 1535 Text Regression, classification 2013 [403] E. Venzke et al.
Seismic-bumps Dataset Seismic activities from a coal mine. Seismic activity was classified as hazardous or not. 2584 Text Classification 2013 [404][405] M. Sikora et al.
CAMELS-US Catchment hydrology dataset with hydrometeorological timeseries and various attributes see Reference 671 CSV, Text, Shapefile Regression 2017 [406][407] N. Addor et al. / A. Newman et al.
CAMELS-Chile Catchment hydrology dataset with hydrometeorological timeseries and various attributes see Reference 516 CSV, Text, Shapefile Regression 2018 [408] C. Alvarez-Garreton et al.
CAMELS-Brazil Catchment hydrology dataset with hydrometeorological timeseries and various attributes see Reference 897 CSV, Text, Shapefile Regression 2020 [409] V. Chagas et al.
CAMELS-GB Catchment hydrology dataset with hydrometeorological timeseries and various attributes see Reference 671 CSV, Text, Shapefile Regression 2020 [410] G. Coxon et al.
CAMELS-Australia Catchment hydrology dataset with hydrometeorological timeseries and various attributes see Reference 222 CSV, Text, Shapefile Regression 2021 [411] K. Fowler et al.
LamaH-CE Catchment hydrology dataset with hydrometeorological timeseries and various attributes see Reference 859 CSV, Text, Shapefile Regression 2021 [412] C. Klingler et al.

Other physical[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Concrete Compressive Strength Dataset Dataset of concrete properties and compressive strength. Nine features are given for each sample. 1030 Text Regression 2007 [413][414] I. Yeh
Concrete Slump Test Dataset Concrete slump flow given in terms of properties. Features of concrete given such as fly ash, water, etc. 103 Text Regression 2009 [415][416] I. Yeh
Musk Dataset Predict if a molecule, given the features, will be a musk or a non-musk. 168 features given for each molecule. 6598 Text Classification 1994 [417] Arris Pharmaceutical Corp.
Steel Plates Faults Dataset Steel plates of 7 different types. 27 features given for each sample. 1941 Text Classification 2010 [418] Semeion Research Center

Biological data[edit]

Datasets from biological systems.


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Age Dataset A structured general-purpose dataset on life, work, and death of 1.22 million distinguished people. Public domain. A five-step method to infer birth and death years, gender, and occupation from community-submitted data to all language versions of the Wikipedia project. 1,223,009 Text Regression, Classification 2022 Paper[419]


Amoradnejad et al.
Synthetic Fundus Dataset[421] Photorealistic retinal images and vessel segmentations. Public domain. 2500 images with 1500*1152 pixels useful for segmentation and classification of veins and arteries on a single background. 2500 Images Classification, Segmentation 2020 [422] C. Valenti et al.
EEG Database Study to examine EEG correlates of genetic predisposition to alcoholism. Measurements from 64 electrodes placed on the scalp sampled at 256 Hz (3.9 ms epoch) for 1 second. 122 Text Classification 1999 [423] H. Begleiter
P300 Interface Dataset Data from nine subjects collected using P300-based brain-computer interface for disabled subjects. Split into four sessions for each subject. MATLAB code given. 1,224 Text Classification 2008 [424][425] U. Hoffman et al.
Heart Disease Data Set Attributed of patients with and without heart disease. 75 attributes given for each patient with some missing values. 303 Text Classification 1988 [426][427] A. Janosi et al.
Breast Cancer Wisconsin (Diagnostic) Dataset Dataset of features of breast masses. Diagnoses by physician is given. 10 features for each sample are given. 569 Text Classification 1995 [428][429] W. Wolberg et al.
National Survey on Drug Use and Health Large scale survey on health and drug use in the United States. None. 55,268 Text Classification, regression 2012 [430] United States Department of Health and Human Services
Lung Cancer Dataset Lung cancer dataset without attribute definitions 56 features are given for each case 32 Text Classification 1992 [431][432] Z. Hong et al.
Arrhythmia Dataset Data for a group of patients, of which some have cardiac arrhythmia. 276 features for each instance. 452 Text Classification 1998 [433][434] H. Altay et al.
Diabetes 130-US hospitals for years 1999–2008 Dataset 9 years of readmission data across 130 US hospitals for patients with diabetes. Many features of each readmission are given. 100,000 Text Classification, clustering 2014 [435][436] J. Clore et al.
Diabetic Retinopathy Debrecen Dataset Features extracted from images of eyes with and without diabetic retinopathy. Features extracted and conditions diagnosed. 1151 Text Classification 2014 [437][438] B. Antal et al.
Diabetic Retinopathy Messidor Dataset Methods to evaluate segmentation and indexing techniques in the field of retinal ophthalmology (MESSIDOR) Features retinopathy grade and risk of macular edema 1200 Images, Text Classification, Segmentation 2008 [439][440] Messidor Project
Liver Disorders Dataset Data for people with liver disorders. Seven biological features given for each patient. 345 Text Classification 1990 [441][442] Bupa Medical Research Ltd.
Thyroid Disease Dataset 10 databases of thyroid disease patient data. None. 7200 Text Classification 1987 [443][444] R. Quinlan
Mesothelioma Dataset Mesothelioma patient data. Large number of features, including asbestos exposure, are given. 324 Text Classification 2016 [445][446] A. Tanrikulu et al.
Parkinson's Vision-Based Pose Estimation Dataset 2D human pose estimates of Parkinson's patients performing a variety of tasks. Camera shake has been removed from trajectories. 134 Text Classification, regression 2017 [447][448][449] M. Li et al.
KEGG Metabolic Reaction Network (Undirected) Dataset Network of metabolic pathways. A reaction network and a relation network are given. Detailed features for each network node and pathway are given. 65,554 Text Classification, clustering, regression 2011 [450] M. Naeem et al.
Modified Human Sperm Morphology Analysis Dataset (MHSMA) Human sperm images from 235 patients with male factor infertility, labeled for normal or abnormal sperm acrosome, head, vacuole, and tail. Cropped around single sperm head. Magnification normalized. Training, validation, and test set splits created. 1,540 .npy files Classification 2019 [451][452] S. Javadi and S.A. Mirroshandel


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Abalone Dataset Physical measurements of Abalone. Weather patterns and location are also given. None. 4177 Text Regression 1995 [453] Marine Research Laboratories – Taroona
Zoo Dataset Artificial dataset covering 7 classes of animals. Animals are classed into 7 categories and features are given for each. 101 Text Classification 1990 [454] R. Forsyth
Demospongiae Dataset Data about marine sponges. 503 sponges in the Demosponge class are described by various features. 503 Text Classification 2010 [455] E. Armengol et al.
Farm animals data PLF data inventory (cows, pigs; location, acceleration, etc.). Labeled datasets. List is constantly updated Text Classification 2020 [456] V. Bloch
Splice-junction Gene Sequences Dataset Primate splice-junction gene sequences (DNA) with associated imperfect domain theory. None. 3190 Text Classification 1992 [432] G. Towell et al.
Mice Protein Expression Dataset Expression levels of 77 proteins measured in the cerebral cortex of mice. None. 1080 Text Classification, Clustering 2015 [457][458] C. Higuera et al.


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
UCI Mushroom Dataset Mushroom attributes and classification. Many properties of each mushroom are given. 8124 Text Classification 1987 [459] J. Schlimmer
Secondary Mushroom Dataset Mushroom attributes and classification Simulated data from larger and more realistic primary mushroom entries. Fully reproducible. 61069 Text Classification 2020 [460][461] D. Wagner et al.


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Forest Fires Dataset Forest fires and their properties. 13 features of each fire are extracted. 517 Text Regression 2008 [462][463] P. Cortez et al.
Iris Dataset Three types of iris plants are described by 4 different attributes. None. 150 Text Classification 1936 [464][465] R. Fisher
Plant Species Leaves Dataset Sixteen samples of leaf each of one-hundred plant species. Shape descriptor, fine-scale margin, and texture histograms are given. 1600 Text Classification 2012 [466][467] J. Cope et al.
Soybean Dataset Database of diseased soybean plants. 35 features for each plant are given. Plants are classified into 19 categories. 307 Text Classification 1988 [468] R. Michalski et al.
Seeds Dataset Measurements of geometrical properties of kernels belonging to three different varieties of wheat. None. 210 Text Classification, clustering 2012 [469][470] Charytanowicz et al.
Covertype Dataset Data for predicting forest cover type strictly from cartographic variables. Many geographical features given. 581,012 Text Classification 1998 [471][472] J. Blackard et al.
Abscisic Acid Signaling Network Dataset Data for a plant signaling network. Goal is to determine set of rules that governs the network. None. 300 Text Causal-discovery 2008 [473] J. Jenkens et al.
Folio Dataset 20 photos of leaves for each of 32 species. None. 637 Images, text Classification, clustering 2015 [474][475] T. Munisami et al.
Oxford Flower Dataset 17 category dataset of flowers. Train/test splits, labeled images, 1360 Images, text Classification 2006 [174][476] M-E Nilsback et al.
Plant Seedlings Dataset 12 category dataset of plant seedlings. Labelled images, segmented images, 5544 Images Classification, detection 2017 [477] Giselsson et al.
Fruits 360 dataset Database with images of 120 fruits and vegetables. 100x100 pixels, White background. 82213 Images (jpg) Classification 2017–2019 [478][479] Mihai Oltean, Horea Muresan


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Ecoli Dataset Protein localization sites. Various features of the protein localizations sites are given. 336 Text Classification 1996 [480][481] K. Nakai et al.
MicroMass Dataset Identification of microorganisms from mass-spectrometry data. Various mass spectrometer features. 931 Text Classification 2013 [482][483] P. Mahe et al.
Yeast Dataset Predictions of Cellular localization sites of proteins. Eight features given per instance. 1484 Text Classification 1996 [484][485] K. Nakai et al.

Drug Discovery[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Tox21 Dataset Prediction of outcome of biological assays. Chemical descriptors of molecules are given. 12707 Text Classification 2016 [486] A. Mayr et al.

Anomaly data[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Numenta Anomaly Benchmark (NAB) Data are ordered, timestamped, single-valued metrics. All data files contain anomalies, unless otherwise noted. None 50+ files Comma separated values Anomaly detection 2016 (continually updated) [487] Numenta
Skoltech Anomaly Benchmark (SKAB) Each file represents a single experiment and contains a single anomaly. The dataset represents a multivariate time series collected from the sensors installed on the testbed. There are two markups for Outlier detection (point anomalies) and Changepoint detection (collective anomalies) problems 30+ files (v0.9) Comma separated values Anomaly detection 2020 (continually updated)

[488] [489]

Iurii D. Katser and Vyacheslav O. Kozitsin
On the Evaluation of Unsupervised Outlier Detection: Measures, Datasets, and an Empirical Study Most data files are adapted from UCI Machine Learning Repository data, some are collected from the literature. treated for missing values, numerical attributes only, different percentages of anomalies, labels 1000+ files ARFF Anomaly detection 2016 (possibly updated with new datasets and/or results)


Campos et al.

Question Answering data[edit]

This section includes datasets that deals with structured data.

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
DBpedia Neural Question Answering (DBNQA) Dataset A large collection of Question to SPARQL specially design for Open Domain Neural Question Answering over DBpedia Knowledgebase. This dataset contains a large collection of Open Neural SPARQL Templates and instances for training Neural SPARQL Machines; it was pre-processed by semi-automatic annotation tools as well as by three SPARQL experts. 894,499 Question-query pairs Question Answering 2018 [491][492] Hartmann, Soru, and Marx et al.
Vietnamese Question Answering Dataset (UIT-ViQuAD) A large collection of Vietnamese questions for evaluating MRC models. This dataset comprises over 23,000 human-generated question-answer pairs based on 5,109 passages of 174 Vietnamese articles from Wikipedia. 23,074 Question-answer pairs Question Answering 2020 [493] Nguyen et al.
Vietnamese Multiple-Choice Machine Reading Comprehension Corpus(ViMMRC) A collection of Vietnamese multiple-choice questions for evaluating MRC models. This corpus includes 2,783 Vietnamese multiple-choice questions. 2,783 Question-answer pairs Question Answering/Machine Reading Comprehension 2020 [494] Nguyen et al.
Open-Domain Question Answering Goes Conversational via Question Rewriting An end-to-end open-domain question answering. This dataset includes 14,000 conversations with 81,000 question-answer pairs. Context, Question, Rewrite, Answer, Answer_URL, Conversation_no, Turn_no, Conversation_source

Further details are provided in the project's GitHub repository and respective Hugging Face dataset card.

Question Answering 2021 [495] Anantha and Vakulenko et al.
UnifiedQA Question-answer data Processed dataset Question Answering 2020 [496] Khashabi et al.

Dialog or Instruction Prompted data[edit]

This section includes datasets that ...

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Taskmaster "The Taskmaster corpus consists of THREE datasets, Taskmaster-1 (TM-1), Taskmaster-2 (TM-2), and Taskmaster-3 (TM-3), comprising over 55,000 spoken and written task-oriented dialogs in over a dozen domains."[497] Taskmaster-1: goal-oriented conversational dataset. It includes 13,215 task-based dialogs comprising six domains.

Taskmaster-2: 17,289 dialogs in the seven domains (restaurants, food ordering, movies, hotels, flights, music and sports).

Taskmaster-3: 23,757 movie ticketing dialogs.

Taskmaster-1 and Taskmaster-2: conversation id, utterances, Instruction id

Taskmaster-3: conversation id, utterances, vertical, scenario, instructions.

For further details check the project's GitHub repository or the Hugging Face dataset cards (taskmaster-1, taskmaster-2, taskmaster-3).

Dialog/Instruction prompted 2019 [498] Byrne and Krishnamoorthi et al.
DrRepair A labeled dataset for program repair. Pre-processed data Check format details in the project's worksheet. Dialog/Instruction prompted 2020 [499] Michihiro et al.
Natural Instructions v2 Large dataset that covers a wider range of reasoning abilities Each task consists of input/output, and a task definition.

Additionally, each ask contains a task definition.

Further information is provided in the GitHub repository of the project and the Hugging Face data card.

Input/Output and task definition 2022 [500] Wang et al.
LAMBADA " LAMBADA is a collection of narrative passages sharing the characteristic that human subjects are able to guess their last word if they are exposed to the whole passage, but not if they only see the last sentence preceding the target word."[501] Information about this dataset's format is available in the HuggingFace dataset card and the project's website.

The dataset can be downloaded here, and the rejected data here.

[502] Paperno et al.
FLAN A re-preprocessed version of the FLAN dataset with updates since the original FLAN dataset was released is available in Hugging Face:
  1. test data
  2. train data
  3. validation data

The scripts to process the data are available in the GitHub repo mentioned on the paper:

Another FLAN GitHub repo was created as well. This is the one associated with the dataset card in Hugging Face.

2021 [503] Wei et al.


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
MITRE ATTACK The ATT&CK is a globally-accessible knowledge base of adversary tactics and techniques. Data can be downloaded from these two GitHub repositories: version 2.1 and version 2.0 [504] MITRE ATTACK
CAPEC Common Attack Pattern Enumeration and Classification Data can be downloaded from CAPEC's website:

Mechanisms of Attack Domains of Attack

[505] CAPEC
CVE CVE is a list of publicly disclosed cybersecurity vulnerabilities that is free to search, use, and incorporate into products and services. Data can be downloaded from: Allitems [506] CVE
CWE Common Weakness Enumeration data. Data can be downloaded from:

Software Development Hardware DesignResearch Concepts

[507] CWE
MalwareTextDB Annotated database of malware texts. The GitHub repository of the project contains the data to download. [508] Kiat et al.
USENIX Security Symposium proceedings Collection of security proceedings from USENIX Security Symposium – technical sessions from 1995 to 2022. This data is not pre-processed. 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008,

2009, 2010 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022.

[509] USENIX Security Symposium
APTNotes Collection of public documents, whitepapers and articles about APT campaigns. All the documents arepublicly available data. This data is not pre-processed. The GitHub repository of the project contains a file with links to the data stored in box.

Data files can also be downloaded here.

[510] APT Notes
arXiv Cryptography and Security papers Collection of articles about cybersecurity This data is not pre-processed. All articles available here. [511][512] arXiv
Security eBooks for free Small collection of security eBooks, and security presentations publicly available. This data is not pre-processed. [513][514][515][516][517][518][519][520][521][522][523][524]
National Cyber Security strategy repository Repository of worldwide strategy documents about cybersecurity. This data is not pre-processed. [525]
Cyber Security Natural Language Processing Data about cybersecurity strategies from more than 75 countries. Tokenization, meaningless-frequent words removal. [526] Yanlin Chen, Yunjian Wei, Yifan Yu, Wen Xue, Xianya Qin
APT Reports collection Sample of APT reports, malware, technology, and intelligence collection Raw and tokenize data available. All data is available in this GitHub repository. [527] blackorbird
Offensive Language Identification Dataset (OLID) Data available in the project's website.

Data is also available here.

[528] Zampieri et al.
Cyber reports from the National Cyber Security Centre This data is not pre-processed. Threat reports, reports and advisory, news, blog-posts, speeches.

Alternate list of reports.

APT reports by Kaspersky This data is not pre-processed. [530]
The cyberwire This data is not pre-processed. Newsletters, podcasts, and stories. [531]
Databreaches news This data is not pre-processed. News, list of news from Aug 2022 to Feb 2023 [532]
Cybernews This data is not pre-processed. News, curated list of news [533]
Hipaajournal This data is not pre-processed. News [534]
Bleepingcomputer This data is not pre-processed. News [535]
Therecord This data is not pre-processed. Cybercrime news [536]
Hackread This data is not pre-processed. Hacking news [537]
Securelist This data is not pre-processed. APT reports, archive, DDOS reports, incidents, Kaspersky security bulletin, industrial threats, malware-reports, opinions, publications, research, and SAS. [538]
Stucco project The Stucco project collects data not typically integrated into security systems. This data is not pre-processed Project's website with data informationReviewed source with links to data sources [539]
Farsightsecurity Website with technical information, reports, and more about security topics. This data is not pre-processed Technical information, research, reports. [540]
Schneier Website with academic papers about security topics. This data is not pre-processed Papers per category, papers archive by date. [541]
Trendmicro Website with research, news, and perspectives bout security topics. This data is not pre-processed Reviwed list of Trendmicro research, news, and pespectives. [542]
The Hacker News News about cybersecurity topics. This data is not pre-processed data breaches, cyberattacks, vulnerabilities, malware news. [543]
Krebsonsecurity Security news and investigation This data is not pre-processed curated list of news [544]
Mitre Defend Matrix of Defend artifacts json files [545]
Mitre Atlas Mitre Atlas is a knowledge base of adversary tactics, techniques, and case studies for machine learning (ML) systems based on real-world observations. This data is not pre-processed [546]
Mitre Engage MITRE Engage is a framework for planning and discussing adversary engagement operations that empowers you to engage your adversaries and achieve your cybersecurity goals. This data is not pre-processed [547]
Hacking Tutorials This data is not pre-processed [548]

Climate and Sustainability[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
TCFD reports Database of company reports that include TCFD-related disclosures. This data is not pre-processed Direct link to reportsCurated list of reports [549] TCFD Knowledge Hub
Corporate Social Responsibility Reports A listing of responsibility reports on the internet. This data is not pre-processed Curated list of repots [550] ResponsibilityReports
The Intergovernmental Panel on Climate Change (IPCC) A collection of comprehensive assessment reports about knowledge on climate change, its causes, potential impacts and response options This data is not pre-processed ReportsCurated list of reports [551] IPCC
Alliance for Research on Corporate Sustainability This data is not pre-processed Curated list of blog posts [552] ARCS
ESG corpus: Knowledge Hub of the Accounting for Sustainability This data is not pre-processed Guides, case studies, blogs, and reports & surveys. [553] Mehra et al.
CLIMATE-FEVER A dataset adopting the FEVER methodology that consists of 1,535 real-world claims regarding climate-change collected on the internet. Each claim is accompanied by five manually annotated evidence sentences retrieved from the English Wikipedia that support, refute or do not give enough information to validate the claim totalling in 7,675 claim-evidence pairs.[554] Dataset HF card, and project's GitHub repository. [555] Diggelmann et al.
Climate News dataset A dataset for NLP and climate change media researchers The dataset is made up of a number of data artifacts (JSON, JSONL & CSV text files & SQLite database) Climate news DB, Project's GitHub repository [556] ADGEfficiency
Climatext Climatext is a dataset for sentence-based climate change topic detection. HF dataset [557] University of Zurich
GreenBiz Collection of articles and news about climate and sustainability This data is not pre-processed Curated list of climate articlesCurated list of sustainability articles [558]
Top research pre-prints in climate and sustainability List of pre-prints from researchers in the reuters hot list This data is not pre-processed Curated list of pre-prints [559] Maurice Tamman
ARCS This data is not pre-processed Curated list of corporate sustainability blogs [560]
GreenBiz Website with articles about climate and sustainability This data is not pre-processed [561] GreenBiz
CSRWIRE This data is not pre-processed Curated list of articles [562] CSRWIRE
CDP Articles about climate, water, and forests This data is not pre-processed [563] CDP

Code data[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
GitHub repositories This data is not pre-processed Curated lis of repositories from GitHub: 61 62 63 64 65 66 67 68 69 70 71 , 72, 73, 74, 75, 76, 77 101
IBM Public GitHub repositories This data is not pre-processed Curated list of repositories from GitHub
RedHat Public GitHub repositories This data is not pre-processed Curated list of repositories from GitHub
StackExchange Public files This data is not pre-processed Curated list of files from
Gitlab Public repositories This data is not pre-processed Curated list of repositories from Gitlab: 1 2
Ansible Collections public repositories This data is not pre-processed Curated list of repositories from GitHub.
CodeParrot GitHub Code Dataset This data is not pre-processed Curated list of repositories from Hugging Face: 1 2 3 4 5 6 7 8 9 10
OKD The Community Distribution of Kubernetes that powers Red Hat OpenShift This data is not pre-processed List of GitHub repositories of the project
OpenShift The developer and operations friendly Kubernetes distro List of GitHub repositories of the project
Kubernetes This data is not pre-processed List of GitHub repositories of the project
Red Hat Developer GitHub home of the Red Hat Developer program This data is not pre-processed List of GitHub repositories of the project
Red Hat


This data is not pre-processed List of GitHub repositories of the project
Kubernetes SIGs This data is not pre-processed List of GitHub repositories of the project
Konveyor This data is not pre-processed List of GitHub repositories of the project
RedHat Marketplace This data is not pre-processed List of GitHub repositories of the project
Redhat blog This data is not pre-processed [564]
Kubernetes io This data is not pre-processed [565]
Docs Openshift This data is not pre-processed [566]
cncf io This data is not pre-processed [567]
Kubernetes presentations List of publicly available Kubernetes presentations This data is not pre-processed data link
Red Hat Open Innovation Labs This data is not pre-processed List of GitHub repositories of the project
Red Hat Demos This data is not pre-processed List of GitHub repositories of the project
Red Hat OpenShift Online This data is not pre-processed List of GitHub repositories of the project
Software Collections This data is not pre-processed List of GitHub repositories of the project
Red Hat Insights This data is not pre-processed List of GitHub repositories of the project
Red Hat Government This data is not pre-processed List of GitHub repositories of the project
Red Hat Consulting This data is not pre-processed List of GitHub repositories of the project
Red Hat Communities of Practice This data is not pre-processed List of GitHub repositories of the project
Red Hat Partner Tech This data is not pre-processed List of GitHub repositories of the project
Red Hat Documentation This data is not pre-processed List of GitHub repositories of the project
IBM This data is not pre-processed List of GitHub repositories of the project
IBM Cloud This data is not pre-processed List of GitHub repositories of the project
Build Lab Team This data is not pre-processed List of GitHub repositories of the project
Terraform IBM Modules This data is not pre-processed List of GitHub repositories of the project
Cloud Schematics This data is not pre-processed List of GitHub repositories of the project
OCP Power Demos This data is not pre-processed List of GitHub repositories of the project
IBM App Modernization  This data is not pre-processed List of GitHub repositories of the project
Kubernetes OperatorHub  This data is not pre-processed List of GitHub repositories of the project
Cloud Native Computing Foundation (CNCF)  This data is not pre-processed List of GitHub repositories of the project
Operator Framework This data is not pre-processed List of GitHub repositories of the project [568]
GitHub repositories referenced in This data is not pre-processed List of GitHub repositories in
Red Hat Communities of Practice This data is not pre-processed List of GitHub repositories of the project
Red Hat partner This data is not pre-processed List of GitHub repositories of the project
IBM Repositories This data is not pre-processed List of GitHub repositories for the project
Build Lab Team This data is not pre-processed List of GitHub repositories for the project
Operator Framework This data is not pre-processed List of GitHub repositories for the project
GitHub repositories This data is not pre-processed List of GitHub repositories for the project
Red Hat This data is not pre-processed List of GitHub repositories of the project
Kubernetes Patterns This data is not pre-processed List of GitHub repositories of the project
Kubernetes Deployment & Security Patterns This data is not pre-processed List of GitHub repositories of the project
Kubernetes for Full-Stack Developers This data is not pre-processed List of GitHub repositories of the project
Load Balancer Cloudwatch Metrics This data is not pre-processed GitHub repository of the project
Dynatrace This data is not pre-processed [3]
AIOps Challenge 2020 Data This data is not pre-processed GitHub repository of the project
Loghub This data is not pre-processed List of repositories
HTML Pages This data is not pre-processed List of HTML pages
Opensift ebooks This data is not pre-processed [569]
Kubernetes ebooks This data is not pre-processed Kubernetes Patterns, Kubernetes Deployment, Kubernetes for Full-Stack Developers
Kubernetes for Full-Stack Developers This data is not pre-processed Kubernetes for Full-Stack Developers
List of public and licensed Github repositories This data is not pre-processed List of repositories

Multivariate Data[edit]


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Dow Jones Index Weekly data of stocks from the first and second quarters of 2011. Calculated values included such as percentage change and a lags. 750 Comma separated values Classification, regression, Time series 2014 [570][571] M. Brown et al.
Statlog (Australian Credit Approval) Credit card applications either accepted or rejected and attributes about the application. Attribute names are removed as well as identifying information. Factors have been relabeled. 690 Comma separated values Classification 1987 [572][573] R. Quinlan
eBay auction data Auction data from various objects over various length auctions Contains all bids, bidderID, bid times, and opening prices. ~ 550 Text Regression, classification 2012 [574][575] G. Shmueli et al.
Statlog (German Credit Data) Binary credit classification into "good" or "bad" with many features Various financial features of each person are given. 690 Text Classification 1994 [576] H. Hofmann
Bank Marketing Dataset Data from a large marketing campaign carried out by a large bank . Many attributes of the clients contacted are given. If the client subscribed to the bank is also given. 45,211 Text Classification 2012 [577][578] S. Moro et al.
Istanbul Stock Exchange Dataset Several stock indexes tracked for almost two years. None. 536 Text Classification, regression 2013 [579][580] O. Akbilgic
Default of Credit Card Clients Credit default data for Taiwanese creditors. Various features about each account are given. 30,000 Text Classification 2016 [581][582] I. Yeh


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Cloud DataSet Data about 1024 different clouds. Image features extracted. 1024 Text Classification, clustering 1989 [583] P. Collard
El Nino Dataset Oceanographic and surface meteorological readings taken from a series of buoys positioned throughout the equatorial Pacific. 12 weather attributes are measured at each buoy. 178080 Text Regression 1999 [584] Pacific Marine Environmental Laboratory
Greenhouse Gas Observing Network Dataset Time-series of greenhouse gas concentrations at 2921 grid cells in California created using simulations of the weather. None. 2921 Text Regression 2015 [585] D. Lucas
Atmospheric CO2 from Continuous Air Samples at Mauna Loa Observatory Continuous air samples in Hawaii, USA. 44 years of records. None. 44 years Text Regression 2001 [586] Mauna Loa Observatory
Ionosphere Dataset Radar data from the ionosphere. Task is to classify into good and bad radar returns. Many radar features given. 351 Text Classification 1989 [444][587] Johns Hopkins University
Ozone Level Detection Dataset Two ground ozone level datasets. Many features given, including weather conditions at time of measurement. 2536 Text Classification 2008 [588][589] K. Zhang et al.


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Adult Dataset Census data from 1994 containing demographic features of adults and their income. Cleaned and anonymized. 48,842 Comma separated values Classification 1996 [590] United States Census Bureau
Census-Income (KDD) Weighted census data from the 1994 and 1995 Current Population Surveys. Split into training and test sets. 299,285 Comma separated values Classification 2000 [591][592] United States Census Bureau
IPUMS Census Database Census data from the Los Angeles and Long Beach areas. None 256,932 Text Classification, regression 1999 [593] IPUMS
US Census Data 1990 Partial data from 1990 US census. Results randomized and useful attributes selected. 2,458,285 Text Classification, regression 1990 [594] United States Census Bureau


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Bike Sharing Dataset Hourly and daily count of rental bikes in a large city. Many features, including weather, length of trip, etc., are given. 17,389 Text Regression 2013 [595][596] H. Fanaee-T
New York City Taxi Trip Data Trip data for yellow and green taxis in New York City. Gives pick up and drop off locations, fares, and other details of trips. 6 years Text Classification, clustering 2015 [597] New York City Taxi and Limousine Commission
Taxi Service Trajectory ECML PKDD Trajectories of all taxis in a large city. Many features given, including start and stop points. 1,710,671 Text Clustering, causal-discovery 2015 [598][599] M. Ferreira et al.
METR-LA Speed from loop detectors in the highway of Los Angeles County. Average speed in 5 minutes timesteps. 7,094,304 from 207 sensors and 34,272 timesteps Comma separated values Regression, Forecasting 2014 [600] Jagadish et al.
PeMS Speed, flow, occupancy and other metrics from loop detectors and other sensors in the freeway of the State of California, U.S.A.. Metric usually aggregated via Average into 5 minutes timesteps. 39,000 individual detectors, each containing years of timeseries Comma separated values Regression, Forecasting, Nowcasting, Interpolation (updated realtime) [601] California Department of Transportation


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Webpages from Common Crawl 2012 Large collection of webpages and how they are connected via hyperlinks None. 3.5B Text clustering, classification 2013 [602] V. Granville
Internet Advertisements Dataset Dataset for predicting if a given image is an advertisement or not. Features encode geometry of ads and phrases occurring in the URL. 3279 Text Classification 1998 [603][604] N. Kushmerick
Internet Usage Dataset General demographics of internet users. None. 10,104 Text Classification, clustering 1999 [605] D. Cook
URL Dataset 120 days of URL data from a large conference. Many features of each URL are given. 2,396,130 Text Classification 2009 [606][607] J. Ma
Phishing Websites Dataset Dataset of phishing websites. Many features of each site are given. 2456 Text Classification 2015 [608] R. Mustafa et al.
Online Retail Dataset Online transactions for a UK online retailer. Details of each transaction given. 541,909 Text Classification, clustering 2015 [609] D. Chen
Freebase Simple Topic Dump Freebase is an online effort to structure all human knowledge. Topics from Freebase have been extracted. large Text Classification, clustering 2011 [610][611] Freebase
Farm Ads Dataset The text of farm ads from websites. Binary approval or disapproval by content owners is given. SVMlight sparse vectors of text words in ads calculated. 4143 Text Classification 2011 [612][613] C. Masterharm et al.
The Pile Assembling several large datasets of diverse and unstructured texts Various (removing HTML and Javascript from websites, removing duplicated sentences) 825 GiB English text JSON Lines[614][615] Natural Language Processing, Text Prediction 2021 [616][614] Gao et al.
OpenWebText An open-source recreation of the WebText corpus. The text is web content extracted from URLs shared on Reddit with at least three upvotes. Extracted non-HTML content, deduplicated, and tokenized. 8,013,769 Documents, 38GB Text Natural Language Processing, Text Prediction 2019 [617][618] A. Gokaslan, V. Cohen


Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Poker Hand Dataset 5 card hands from a standard 52 card deck. Attributes of each hand are given, including the Poker hands formed by the cards it contains. 1,025,010 Text Regression, classification 2007 [619] R. Cattral
Connect-4 Dataset Contains all legal 8-ply positions in the game of connect-4 in which neither player has won yet, and in which the next move is not forced. None. 67,557 Text Classification 1995 [620] J. Tromp
Chess (King-Rook vs. King) Dataset Endgame Database for White King and Rook against Black King. None. 28,056 Text Classification 1994 [621][622] M. Bain et al.
Chess (King-Rook vs. King-Pawn) Dataset King+Rook versus King+Pawn on a7. None. 3196 Text Classification 1989 [623] R. Holte
Tic-Tac-Toe Endgame Dataset Binary classification for win conditions in tic-tac-toe. None. 958 Text Classification 1991 [624] D. Aha

Other multivariate[edit]

Dataset Name Brief description Preprocessing Instances Format Default Task Created (updated) Reference Creator
Housing Data Set Median home values of Boston with associated home and neighborhood attributes. None. 506 Text Regression 1993 [625] D. Harrison et al.
The Getty Vocabularies structured terminology for art and other material culture, archival materials, visual surrogates, and bibliographic materials. None. large Text Classification 2015 [626] Getty Center
Yahoo! Front Page Today Module User Click Log User click log for news articles displayed in the Featured Tab of the Today Module on Yahoo! Front Page. Conjoint analysis with a bilinear model. 45,811,883 user visits Text Regression, clustering 2009 [627][628] Chu et al.
British Oceanographic Data Centre Biological, chemical, physical and geophysical data for oceans. 22K variables tracked. Various. 22K variables, many instances Text Regression, clustering 2015 [629] British Oceanographic Data Centre
Congressional Voting Records Dataset Voting data for all USA representatives on 16 issues. Beyond the raw voting data, various other features are provided. 435 Text Classification 1987 [630] J. Schlimmer
Entree Chicago Recommendation Dataset Record of user interactions with Entree Chicago recommendation system. Details of each users usage of the app are recorded in detail. 50,672 Text Regression, recommendation 2000 [631] R. Burke
Insurance Company Benchmark (COIL 2000) Information on customers of an insurance company. Many features of each customer and the services they use. 9,000 Text Regression, classification 2000 [632][633] P. van der Putten
Nursery Dataset Data from applicants to nursery schools. Data about applicant's family and various other factors included. 12,960 Text Classification 1997 [634][635] V. Rajkovic et al.
University Dataset Data describing attributed of a large number of universities. None. 285 Text Clustering, classification 1988 [636] S. Sounders et al.
Blood Transfusion Service Center Dataset Data from blood transfusion service center. Gives data on donors return rate, frequency, etc. None. 748 Text Classification 2008 [637][638] I. Yeh
Record Linkage Comparison Patterns Dataset Large dataset of records. Task is to link relevant records together. Blocking procedure applied to select only certain record pairs. 5,749,132 Text Classification 2011 [639][640] University of Mainz
Nomao Dataset Nomao collects data about places from many different sources. Task is to detect items that describe the same place. Duplicates labeled. 34,465 Text Classification 2012 [641][642] Nomao Labs
Movie Dataset Data for 10,000 movies. Several features for each movie are given. 10,000 Text Clustering, classification 1999 [643] G. Wiederhold
Open University Learning Analytics Dataset Information about students and their interactions with a virtual learning environment. None. ~ 30,000 Text Classification, clustering, regression 2015 [644][645] J. Kuzilek et al.
Mobile phone records Telecommunications activity and interactions Aggregation per geographical grid cells and every 15 minutes. large Text Classification, Clustering, Regression 2015 [646] G. Barlacchi et al.

Curated repositories of datasets[edit]

As datasets come in myriad formats and can sometimes be difficult to use, there has been considerable work put into curating and standardizing the format of datasets to make them easier to use for machine learning research.

  • OpenML:[647] Web platform with Python, R, Java, and other APIs for downloading hundreds of machine learning datasets, evaluating algorithms on datasets, and benchmarking algorithm performance against dozens of other algorithms.
  • PMLB:[648] A large, curated repository of benchmark datasets for evaluating supervised machine learning algorithms. Provides classification and regression datasets in a standardized format that are accessible through a Python API.
  • Metatext NLP: web repository maintained by community, containing nearly 1000 benchmark datasets, and counting. Provides many tasks from classification to QA, and various languages from English, Portuguese to Arabic.
  • Appen: Off The Shelf and Open Source Datasets hosted and maintained by the company. These biological, image, physical, question answering, signal, sound, text, and video resources number over 250 and can be applied to over 25 different use cases.[649][650]

See also[edit]


  1. ^ Wissner-Gross, A. "Datasets Over Algorithms". Retrieved 8 January 2016.
  2. ^ Weiss, G. M.; Provost, F. (1 September 2003). "Learning When Training Data are Costly: The Effect of Class Distribution on Tree Induction". Journal of Artificial Intelligence Research. AI Access Foundation. 19: 315–354. doi:10.1613/jair.1199. ISSN 1076-9757. S2CID 2344521.
  3. ^ Turney, Peter (2000). "Types of cost in inductive concept learning". arXiv:cs/0212034.
  4. ^ Abney, Steven (17 September 2007). Semisupervised Learning for Computational Linguistics. CRC Press. ISBN 978-1-4200-1080-0.
  5. ^ Žliobaitė, Indrė; Bifet, Albert; Pfahringer, Bernhard; Holmes, Geoff (2011). "Active Learning with Evolving Streaming Data". Machine Learning and Knowledge Discovery in Databases. Berlin, Heidelberg: Springer Berlin Heidelberg. pp. 597–612. doi:10.1007/978-3-642-23808-6_39. ISBN 978-3-642-23807-9. ISSN 0302-9743.
  6. ^ Zafeiriou, S.; Kollias, D.; Nicolaou, M.A.; Papaioannou, A.; Zhao, G.; Kotsia, I. (2017). "Aff-Wild: Valence and Arousal in-the-wild Challenge" (PDF). Computer Vision and Pattern Recognition Workshops (CVPRW), 2017: 1980–1987. doi:10.1109/CVPRW.2017.248. ISBN 978-1-5386-0733-6. S2CID 3107614.
  7. ^ Kollias, D.; Tzirakis, P.; Nicolaou, M.A.; Papaioannou, A.; Zhao, G.; Schuller, B.; Kotsia, I.; Zafeiriou, S. (2019). "Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond". International Journal of Computer Vision (IJCV), 2019. 127 (6–7): 907–929. doi:10.1007/s11263-019-01158-4. S2CID 13679040.
  8. ^ Kollias, D.; Zafeiriou, S. (2019). "Expression, affect, action unit recognition: Aff-wild2, multi-task learning and arcface" (PDF). British Machine Vision Conference (BMVC), 2019. arXiv:1910.04855.
  9. ^ Kollias, D.; Schulc, A.; Hajiyev, E.; Zafeiriou, S. (2020). "Analysing affective behavior in the first abaw 2020 competition". IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2020: 637–643. arXiv:2001.11409. doi:10.1109/FG47880.2020.00126. ISBN 978-1-7281-3079-8. S2CID 210966051.
  10. ^ Phillips, P. Jonathon; et al. (1998). "The FERET database and evaluation procedure for face-recognition algorithms". Image and Vision Computing. 16 (5): 295–306. doi:10.1016/s0262-8856(97)00070-x.
  11. ^ Wiskott, Laurenz; et al. (1997). "Face recognition by elastic bunch graph matching". IEEE Transactions on Pattern Analysis and Machine Intelligence. 19 (7): 775–779. CiteSeerX doi:10.1109/34.598235. S2CID 30523165.
  12. ^ Livingstone, Steven R.; Russo, Frank A. (2018). "The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English". PLOS ONE. 13 (5): e0196391. Bibcode:2018PLoSO..1396391L. doi:10.1371/journal.pone.0196391. PMC 5955500. PMID 29768426.
  13. ^ Livingstone, Steven R.; Russo, Frank A. (2018). "Emotion". The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS). doi:10.5281/zenodo.1188976.
  14. ^ Grgic, Mislav; Delac, Kresimir; Grgic, Sonja (2011). "SCface–surveillance cameras face database". Multimedia Tools and Applications. 51 (3): 863–879. doi:10.1007/s11042-009-0417-2. S2CID 207218990.
  15. ^ Wallace, Roy, et al. "Inter-session variability modelling and joint factor analysis for face authentication." Biometrics (IJCB), 2011 International Joint Conference on. IEEE, 2011.
  16. ^ Georghiades, A. "Yale face database". Center For Computational Vision And Control At Yale University, 2: 1997. {{cite journal}}: External link in |journal= (help)
  17. ^ Nguyen, Duy; et al. (2006). "Real-time face detection and lip feature extraction using field-programmable gate arrays". IEEE Transactions on Systems, Man, and Cybernetics – Part B: Cybernetics. 36 (4): 902–912. CiteSeerX doi:10.1109/tsmcb.2005.862728. PMID 16903373. S2CID 7334355.
  18. ^ Kanade, Takeo, Jeffrey F. Cohn, and Yingli Tian. "Comprehensive database for facial expression analysis." Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference on. IEEE, 2000.
  19. ^ Zeng, Zhihong; et al. (2009). "A survey of affect recognition methods: Audio, visual, and spontaneous expressions". IEEE Transactions on Pattern Analysis and Machine Intelligence. 31 (1): 39–58. CiteSeerX doi:10.1109/tpami.2008.52. PMID 19029545.
  20. ^ Lyons, Michael; Kamachi, Miyuki; Gyoba, Jiro (1998). "Facial expression images". The Japanese Female Facial Expression (JAFFE) Database. doi:10.5281/zenodo.3451524.
  21. ^ Lyons, Michael; Akamatsu, Shigeru; Kamachi, Miyuki; Gyoba, Jiro "Coding facial expressions with Gabor wavelets." Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on. IEEE, 1998.
  22. ^ Ng, Hong-Wei, and Stefan Winkler. "A data-driven approach to cleaning large face datasets." Image Processing (ICIP), 2014 IEEE International Conference on. IEEE, 2014.
  23. ^ RoyChowdhury, Aruni; Lin, Tsung-Yu; Maji, Subhransu; Learned-Miller, Erik (2015). "One-to-many face recognition with bilinear CNNs". arXiv:1506.01342 [cs.CV].
  24. ^ Jesorsky, Oliver, Klaus J. Kirchberg, and Robert W. Frischholz. "Robust face detection using the hausdorff distance." Audio-and video-based biometric person authentication. Springer Berlin Heidelberg, 2001.
  25. ^ Huang, Gary B., et al. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Vol. 1. No. 2. Technical Report 07-49, University of Massachusetts, Amherst, 2007.
  26. ^ Bhatt, Rajen B., et al. "Efficient skin region segmentation using low complexity fuzzy decision tree model." India Conference (INDICON), 2009 Annual IEEE. IEEE, 2009.
  27. ^ Lingala, Mounika; et al. (2014). "Fuzzy logic color detection: Blue areas in melanoma dermoscopy images". Computerized Medical Imaging and Graphics. 38 (5): 403–410. doi:10.1016/j.compmedimag.2014.03.007. PMC 4287461. PMID 24786720.
  28. ^ Maes, Chris, et al. "Feature detection on 3D face surfaces for pose normalisation and recognition." Biometrics: Theory Applications and Systems (BTAS), 2010 Fourth IEEE International Conference on. IEEE, 2010.
  29. ^ Savran, Arman, et al. "Bosphorus database for 3D face analysis." Biometrics and Identity Management. Springer Berlin Heidelberg, 2008. 47–56.
  30. ^ Heseltine, Thomas, Nick Pears, and Jim Austin. "Three-dimensional face recognition: An eigensurface approach." Image Processing, 2004. ICIP'04. 2004 International Conference on. Vol. 2. IEEE, 2004.
  31. ^ Ge, Yun; et al. (2011). "3D Novel Face Sample Modeling for Face Recognition". Journal of Multimedia. 6 (5): 467–475. CiteSeerX doi:10.4304/jmm.6.5.467-475.
  32. ^ Wang, Yueming; Liu, Jianzhuang; Tang, Xiaoou (2010). "Robust 3D face recognition by local shape difference boosting". IEEE Transactions on Pattern Analysis and Machine Intelligence. 32 (10): 1858–1870. CiteSeerX doi:10.1109/tpami.2009.200. PMID 20724762. S2CID 15263913.
  33. ^ Zhong, Cheng, Zhenan Sun, and Tieniu Tan. "Robust 3D face recognition using learned visual codebook." Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on. IEEE, 2007.
  34. ^ Zhao, G.; Huang, X.; Taini, M.; Li, S. Z.; Pietikäinen, M. (2011). "Facial expression recognition from near-infrared videos" (PDF). Image and Vision Computing. 29 (9): 607–619. doi:10.1016/j.imavis.2011.07.002.[dead link]
  35. ^ Soyel, Hamit, and Hasan Demirel. "Facial expression recognition using 3D facial feature distances." Image Analysis and Recognition. Springer Berlin Heidelberg, 2007. 831–838.
  36. ^ Bowyer, Kevin W.; Chang, Kyong; Flynn, Patrick (2006). "A survey of approaches and challenges in 3D and multi-modal 3D+ 2D face recognition". Computer Vision and Image Understanding. 101 (1): 1–15. CiteSeerX doi:10.1016/j.cviu.2005.05.005.
  37. ^ Tan, Xiaoyang; Triggs, Bill (2010). "Enhanced local texture feature sets for face recognition under difficult lighting conditions". IEEE Transactions on Image Processing. 19 (6): 1635–1650. Bibcode:2010ITIP...19.1635T. CiteSeerX doi:10.1109/tip.2010.2042645. PMID 20172829. S2CID 4943234.
  38. ^ Mousavi, Mir Hashem, Karim Faez, and Amin Asghari. "Three dimensional face recognition using SVM classifier." Computer and Information Science, 2008. ICIS 08. Seventh IEEE/ACIS International Conference on. IEEE, 2008.
  39. ^ Amberg, Brian, Reinhard Knothe, and Thomas Vetter. "Expression invariant 3D face recognition with a morphable model." Automatic Face & Gesture Recognition, 2008. FG'08. 8th IEEE International Conference on. IEEE, 2008.
  40. ^ İrfanoğlu, M. O., Berk Gökberk, and Lale Akarun. "3D shape-based face recognition using automatically registered facial surfaces." Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on. Vol. 4. IEEE, 2004.
  41. ^ Beumier, Charles; Acheroy, Marc (2001). "Face verification from 3D and grey level clues". Pattern Recognition Letters. 22 (12): 1321–1329. Bibcode:2001PaReL..22.1321B. doi:10.1016/s0167-8655(01)00077-0.
  42. ^ Afifi, Mahmoud; Abdelhamed, Abdelrahman (13 June 2017). "AFIF4: Deep Gender Classification based on AdaBoost-based Fusion of Isolated Facial Features and Foggy Faces". arXiv:1706.04277 [cs.CV].
  43. ^ "SoF dataset". Retrieved 18 November 2017.
  44. ^ "IMDb-WIKI". Retrieved 13 March 2018.
  45. ^ Patron-Perez, A.; Marszalek, M.; Reid, I.; Zisserman, A. (2012). "Structured learning of human interactions in TV shows". IEEE Transactions on Pattern Analysis and Machine Intelligence. 34 (12): 2441–2453. doi:10.1109/tpami.2012.24. PMID 23079467. S2CID 6060568.
  46. ^ Ofli, F., Chaudhry, R., Kurillo, G., Vidal, R., & Bajcsy, R. (January 2013). Berkeley MHAD: A comprehensive multimodal human action database. In Applications of Computer Vision (WACV), 2013 IEEE Workshop on (pp. 53–60). IEEE.
  47. ^ Jiang, Y. G., et al. "THUMOS challenge: Action recognition with a large number of classes." ICCV Workshop on Action Recognition with a Large Number of Classes, 2013.
  48. ^ Simonyan, Karen, and Andrew Zisserman. "Two-stream convolutional networks for action recognition in videos." Advances in Neural Information Processing Systems. 2014.
  49. ^ Stoian, Andrei; Ferecatu, Marin; Benois-Pineau, Jenny; Crucianu, Michel (2016). "Fast Action Localization in Large-Scale Video Archives". IEEE Transactions on Circuits and Systems for Video Technology. 26 (10): 1917–1930. doi:10.1109/TCSVT.2015.2475835. S2CID 31537462.
  50. ^ Krishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A; Bernstein, Michael S; Fei-Fei, Li (2017). "Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations". International Journal of Computer Vision. 123: 32–73. arXiv:1602.07332. doi:10.1007/s11263-016-0981-7. S2CID 4492210.
  51. ^ Karayev, S., et al. "A category-level 3-D object dataset: putting the Kinect to work." Proceedings of the IEEE International Conference on Computer Vision Workshops. 2011.
  52. ^ Tighe, Joseph, and Svetlana Lazebnik. "Superparsing: scalable nonparametric image parsing with superpixels Archived 6 August 2019 at the Wayback Machine." Computer Vision–ECCV 2010. Springer Berlin Heidelberg, 2010. 352–365.
  53. ^ Arbelaez, P.; Maire, M; Fowlkes, C; Malik, J (May 2011). "Contour Detection and Hierarchical Image Segmentation" (PDF). IEEE Transactions on Pattern Analysis and Machine Intelligence. 33 (5): 898–916. doi:10.1109/tpami.2010.161. PMID 20733228. S2CID 206764694. Retrieved 27 February 2016.
  54. ^ Lin, Tsung-Yi; Maire, Michael; Belongie, Serge; Bourdev, Lubomir; Girshick, Ross; Hays, James; Perona, Pietro; Ramanan, Deva; Lawrence Zitnick, C.; Dollár, Piotr (2014). "Microsoft COCO: Common Objects in Context". arXiv:1405.0312 [cs.CV].
  55. ^ Russakovsky, Olga; et al. (2015). "Imagenet large scale visual recognition challenge". International Journal of Computer Vision. 115 (3): 211–252. arXiv:1409.0575. doi:10.1007/s11263-015-0816-y. hdl:1721.1/104944. S2CID 2930547.
  56. ^ "COCO – Common Objects in Context".
  57. ^ Xiao, Jianxiong, et al. "Sun database: Large-scale scene recognition from abbey to zoo." Computer vision and pattern recognition (CVPR), 2010 IEEE conference on. IEEE, 2010.
  58. ^ Donahue, Jeff; Jia, Yangqing; Vinyals, Oriol; Hoffman, Judy; Zhang, Ning; Tzeng, Eric; Darrell, Trevor (2013). "DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition". arXiv:1310.1531 [cs.CV].
  59. ^ Deng, Jia, et al. "Imagenet: A large-scale hierarchical image database."Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, 2009.
  60. ^ a b c Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton. "Imagenet classification with deep convolutional neural networks." Advances in neural information processing systems. 2012.
  61. ^ Russakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; et al. (11 April 2015). "ImageNet Large Scale Visual Recognition Challenge". International Journal of Computer Vision. 115 (3): 211–252. arXiv:1409.0575. doi:10.1007/s11263-015-0816-y. hdl:1721.1/104944. S2CID 2930547.
  62. ^ Ivan Krasin, Tom Duerig, Neil Alldrin, Andreas Veit, Sami Abu-El-Haija, Serge Belongie, David Cai, Zheyun Feng, Vittorio Ferrari, Victor Gomes, Abhinav Gupta, Dhyanesh Narayanan, Chen Sun, Gal Chechik, Kevin Murphy. "OpenImages: A public dataset for large-scale multi-label and multi-class image classification, 2017. Available from"
  63. ^ Vyas, Apoorv, et al. "Commercial Block Detection in Broadcast News Videos." Proceedings of the 2014 Indian Conference on Computer Vision Graphics and Image Processing. ACM, 2014.
  64. ^ Hauptmann, Alexander G., and Michael J. Witbrock. "Story segmentation and detection of commercials in broadcast news video." Research and Technology Advances in Digital Libraries, 1998. ADL 98. Proceedings. IEEE International Forum on. IEEE, 1998.
  65. ^ Tung, Anthony KH, Xin Xu, and Beng Chin Ooi. "Curler: finding and visualizing nonlinear correlation clusters." Proceedings of the 2005 ACM SIGMOD international conference on Management of data. ACM, 2005.
  66. ^ Jarrett, Kevin, et al. "What is the best multi-stage architecture for object recognition?." Computer Vision, 2009 IEEE 12th International Conference on. IEEE, 2009.
  67. ^ Lazebnik, Svetlana, Cordelia Schmid, and Jean Ponce. "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories."Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on. Vol. 2. IEEE, 2006.
  68. ^ Griffin, G., A. Holub, and P. Perona. Caltech-256 object category dataset California Inst. Technol., Tech. Rep. 7694, 2007. Available:, 2007.
  69. ^ Baeza-Yates, Ricardo, and Berthier Ribeiro-Neto. Modern information retrieval. Vol. 463. New York: ACM press, 1999.
  70. ^ 🐺 COYO-700M: Image-Text Pair Dataset, Kakao Brain, 3 November 2022, retrieved 3 November 2022
  71. ^ Fu, Xiping, et al. "NOKMeans: Non-Orthogonal K-means Hashing." Computer Vision—ACCV 2014. Springer International Publishing, 2014. 162–177.
  72. ^ Heitz, Geremy; et al. (2009). "Shape-based object localization for descriptive classification". International Journal of Computer Vision. 84 (1): 40–62. CiteSeerX doi:10.1007/s11263-009-0228-y. S2CID 646320.
  73. ^ M. Cordts, M. Omran, S. Ramos, T. Scharwächter, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele, "The Cityscapes Dataset." In CVPR Workshop on The Future of Datasets in Vision, 2015.
  74. ^ Everingham, Mark; et al. (2010). "The pascal visual object classes (voc) challenge". International Journal of Computer Vision. 88 (2): 303–338. doi:10.1007/s11263-009-0275-4. hdl:20.500.11820/88a29de3-6220-442b-ab2d-284210cf72d6. S2CID 4246903.
  75. ^ Felzenszwalb, Pedro F.; et al. (2010). "Object detection with discriminatively trained part-based models". IEEE Transactions on Pattern Analysis and Machine Intelligence. 32 (9): 1627–1645. CiteSeerX doi:10.1109/tpami.2009.167. PMID 20634557. S2CID 3198903.
  76. ^ a b Gong, Yunchao, and Svetlana Lazebnik. "Iterative quantization: A procrustean approach to learning binary codes." Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, 2011.
  77. ^ "CINIC-10 dataset". Luke N. Darlow, Elliot J. Crowley, Antreas Antoniou, Amos J. Storkey (2018) CINIC-10 is not ImageNet or CIFAR-10. 9 October 2018. Retrieved 13 November 2018.
  78. ^ fashion-mnist: A MNIST-like fashion product database. Benchmark :point_right, Zalando Research, 7 October 2017, retrieved 7 October 2017
  79. ^ "notMNIST dataset". Machine Learning, etc. 8 September 2011. Retrieved 13 October 2017.
  80. ^ Houben, Sebastian, et al. "Detection of traffic signs in real-world images: The German Traffic Sign Detection Benchmark." Neural Networks (IJCNN), The 2013 International Joint Conference on. IEEE, 2013.
  81. ^ Mathias, Mayeul, et al. "Traffic sign recognition—How far are we from the solution?." Neural Networks (IJCNN), The 2013 International Joint Conference on. IEEE, 2013.
  82. ^ Geiger, Andreas, Philip Lenz, and Raquel Urtasun. "Are we ready for autonomous driving? the kitti vision benchmark suite." Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2012.
  83. ^ Sturm, Jürgen, et al. "A benchmark for the evaluation of RGB-D SLAM systems." Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on. IEEE, 2012.
  84. ^ The KITTI Vision Benchmark Suite on YouTube
  85. ^ Chaladze, G., Kalatozishvili, L. (2017). Linnaeus 5 Retrieved 13 November 2017, from
  86. ^ Kragh, Mikkel F.; et al. (2017). "FieldSAFE – Dataset for Obstacle Detection in Agriculture". Sensors. 17 (11): 2579. arXiv:1709.03526. Bibcode:2017Senso..17.2579K. doi:10.3390/s17112579. PMC 5713196. PMID 29120383.
  87. ^ Afifi, Mahmoud (12 November 2017). "Gender recognition and biometric identification using a large dataset of hand images". arXiv:1711.04322 [cs.CV].
  88. ^ Lomonaco, Vincenzo; Maltoni, Davide (18 October 2017). "CORe50: a New Dataset and Benchmark for Continuous Object Recognition". arXiv:1705.03550 [cs.CV].
  89. ^ She, Qi; Feng, Fan; Hao, Xinyue; Yang, Qihan; Lan, Chuanlin; Lomonaco, Vincenzo; Shi, Xuesong; Wang, Zhengwei; Guo, Yao; Zhang, Yimin; Qiao, Fei; Chan, Rosa H.M. (15 November 2019). "OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning". arXiv:1911.06487v2 [cs.CV].
  90. ^ Morozov, Alexei; Sushkova, Olga (13 June 2019). "THz and thermal video data set". Development of the multi-agent logic programming approach to a human behaviour analysis in a multi-channel video surveillance. Moscow: IRE RAS. Retrieved 19 July 2019.
  91. ^ Morozov, Alexei; Sushkova, Olga; Kershner, Ivan; Polupanov, Alexander (9 July 2019). "Development of a method of terahertz intelligent video surveillance based on the semantic fusion of terahertz and 3D video images" (PDF). CEUR. 2391: paper19. Retrieved 19 July 2019.
  92. ^ "Papers with Code - Daimler Monocular Pedestrian Detection Dataset". Retrieved 5 May 2023.
  93. ^ Enzweiler, Markus; Gavrila, Dariu M. (December 2009). "Monocular Pedestrian Detection: Survey and Experiments". IEEE Transactions on Pattern Analysis and Machine Intelligence. 31 (12): 2179–2195. doi:10.1109/TPAMI.2008.260. ISSN 1939-3539. PMID 19834140. S2CID 1192198.
  94. ^ Yin, Guojun; Liu, Bin; Zhu, Huihui; Gong, Tao; Yu, Nenghai (28 July 2020). "A Large Scale Urban Surveillance Video Dataset for Multiple-Object Tracking and Behavior Analysis". arXiv:1904.11784 [cs.CV].
  95. ^ "Object Recognition in Video Dataset". Retrieved 5 May 2023.
  96. ^ Brostow, Gabriel J.; Shotton, Jamie; Fauqueur, Julien; Cipolla, Roberto (2008). "Segmentation and Recognition Using Structure from Motion Point Clouds". Computer Vision – ECCV 2008. Lecture Notes in Computer Science. Springer. 5302: 44–57. doi:10.1007/978-3-540-88682-2_5. ISBN 978-3-540-88681-5.
  97. ^ Brostow, Gabriel J.; Fauqueur, Julien; Cipolla, Roberto (15 January 2009). "Semantic object classes in video: A high-definition ground truth database". Pattern Recognition Letters. 30 (2): 88–97. Bibcode:2009PaReL..30...88B. doi:10.1016/j.patrec.2008.04.005. ISSN 0167-8655.
  98. ^ "WildDash 2 Benchmark". Retrieved 5 May 2023.
  99. ^ Zendel, Oliver; Murschitz, Markus; Zeilinger, Marcel; Steininger, Daniel; Abbasi, Sara; Beleznai, Csaba (June 2019). "RailSem19: A Dataset for Semantic Rail Scene Understanding". 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW): 1221–1229. doi:10.1109/CVPRW.2019.00161. ISBN 978-1-7281-2506-0. S2CID 198166233.
  100. ^ "The Boreas Dataset". Retrieved 5 May 2023.
  101. ^ Burnett, Keenan; Yoon, David J.; Wu, Yuchen; Li, Andrew Zou; Zhang, Haowei; Lu, Shichen; Qian, Jingxing; Tseng, Wei-Kang; Lambert, Andrew; Leung, Keith Y. K.; Schoellig, Angela P.; Barfoot, Timothy D. (26 January 2023). "Boreas: A Multi-Season Autonomous Driving Dataset". arXiv:2203.10168 [cs.RO].
  102. ^ "Bosch Small Traffic Lights Dataset". 1 March 2017. Retrieved 5 May 2023.
  103. ^ Behrendt, Karsten; Novak, Libor; Botros, Rami (May 2017). "A deep learning approach to traffic lights: Detection, tracking, and classification". 2017 IEEE International Conference on Robotics and Automation (ICRA): 1370–1377. doi:10.1109/ICRA.2017.7989163. ISBN 978-1-5090-4633-1. S2CID 6257133.
  104. ^ "FRSign Dataset". Retrieved 5 May 2023.
  105. ^ Harb, Jeanine; Rébéna, Nicolas; Chosidow, Raphaël; Roblin, Grégoire; Potarusov, Roman; Hajri, Hatem (5 February 2020). "FRSign: A Large-Scale Traffic Light Dataset for Autonomous Trains". arXiv:2002.05665 [cs.CY].
  106. ^ "ifs-rwth-aachen/GERALD". Chair and Institute for Rail Vehicles and Transport Systems. 30 April 2023. Retrieved 5 May 2023.
  107. ^ Leibner, Philipp; Hampel, Fabian; Schindler, Christian (3 April 2023). "GERALD: A novel dataset for the detection of German mainline railway signals". Proceedings of the Institution of Mechanical Engineers, Part F: Journal of Rail and Rapid Transit: 095440972311664. doi:10.1177/09544097231166472. ISSN 0954-4097. S2CID 257939937.
  108. ^ Wojek, Christian; Walk, Stefan; Schiele, Bernt (June 2009). "Multi-cue onboard pedestrian detection". 2009 IEEE Conference on Computer Vision and Pattern Recognition: 794–801. doi:10.1109/CVPR.2009.5206638. ISBN 978-1-4244-3992-8. S2CID 18000078.
  109. ^ Toprak, Tuğçe; Aydın, Burak; Belenlioğlu, Burak; Güzeliş, Cüneyt; Selver, M. Alper (5 April 2020). "Railway Pedestrian Dataset (RAWPED)". doi:10.1109/TVT.2020.2983825. S2CID 216510283. Retrieved 5 May 2023. {{cite journal}}: Cite journal requires |journal= (help)
  110. ^ Toprak, Tugce; Belenlioglu, Burak; Aydın, Burak; Guzelis, Cuneyt; Selver, M. Alper (May 2020). "Conditional Weighted Ensemble of Transferred Models for Camera Based Onboard Pedestrian Detection in Railway Driver Support Systems". IEEE Transactions on Vehicular Technology. 69 (5): 5041–5054. doi:10.1109/TVT.2020.2983825. ISSN 1939-9359. S2CID 216510283.
  111. ^ Tilly, Roman; Neumaier, Philipp; Schwalbe, Karsten; Klasek, Pavel; Tagiew, Rustam; Denzler, Patrick; Klockau, Tobias; Boekhoff, Martin; Köppel, Martin (2023). "Open Sensor Data for Rail 2023" (in German). doi:10.57806/9mv146r0. {{cite journal}}: Cite journal requires |journal= (help)
  112. ^ Tagiew, Rustam; Köppel, Martin; Schwalbe, Karsten; Denzler, Patrick; Neumaier, Philipp; Klockau, Tobias; Boekhoff, Martin; Klasek, Pavel; Tilly, Roman (4 May 2023). "OSDaR23: Open Sensor Data for Rail 2023". arXiv:2305.03001 [cs.CV].
  113. ^ "Home". Argoverse. Retrieved 5 May 2023.
  114. ^ Chang, Ming-Fang; Lambert, John; Sangkloy, Patsorn; Singh, Jagjeet; Bak, Slawomir; Hartnett, Andrew; Wang, De; Carr, Peter; Lucey, Simon; Ramanan, Deva; Hays, James (6 November 2019). "Argoverse: 3D Tracking and Forecasting with Rich Maps". arXiv:1911.02620 [cs.CV].
  115. ^ Botta, M., A. Giordana, and L. Saitta. "Learning fuzzy concept definitions." Fuzzy Systems, 1993., Second IEEE International Conference on. IEEE, 1993.
  116. ^ Frey, Peter W.; Slate, David J. (1991). "Letter recognition using Holland-style adaptive classifiers". Machine Learning. 6 (2): 161–182. doi:10.1007/bf00114162.
  117. ^ Peltonen, Jaakko; Klami, Arto; Kaski, Samuel (2004). "Improved learning of Riemannian metrics for exploratory analysis". Neural Networks. 17 (8): 1087–1100. CiteSeerX doi:10.1016/j.neunet.2004.06.008. PMID 15555853.
  118. ^ a b Liu, Cheng-Lin; Yin, Fei; Wang, Da-Han; Wang, Qiu-Feng (January 2013). "Online and offline handwritten Chinese character recognition: Benchmarking on new databases". Pattern Recognition. 46 (1): 155–162. Bibcode:2013PatRe..46..155L. doi:10.1016/j.patcog.2012.06.021.
  119. ^ Wang, D.; Liu, C.; Yu, J.; Zhou, X. (2009). "CASIA-OLHWDB1: A Database of Online Handwritten Chinese Characters". 2009 10th International Conference on Document Analysis and Recognition: 1206–1210. doi:10.1109/ICDAR.2009.163. ISBN 978-1-4244-4500-4. S2CID 5705532.
  120. ^ Williams, Ben H., Marc Toussaint, and Amos J. Storkey. Extracting motion primitives from natural handwriting data. Springer Berlin Heidelberg, 2006.
  121. ^ Meier, Franziska, et al. "Movement segmentation using a primitive library."Intelligent Robots and Systems (IROS), 2011 IEEE/RSJ International Conference on. IEEE, 2011.
  122. ^ T. E. de Campos, B. R. Babu and M. Varma. Character recognition in natural images. In Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), Lisbon, Portugal, February 2009
  123. ^ Cohen, Gregory; Afshar, Saeed; Tapson, Jonathan; André van Schaik (2017). "EMNIST: An extension of MNIST to handwritten letters". arXiv:1702.05373v1 [cs.CV].
  124. ^ "The EMNIST Dataset". NIST. 4 April 2017.
  125. ^ Cohen, Gregory; Afshar, Saeed; Tapson, Jonathan; André van Schaik (2017). "EMNIST: An extension of MNIST to handwritten letters". arXiv:1702.05373 [cs.CV].
  126. ^ Llorens, David, et al. "The UJIpenchars Database: a Pen-Based Database of Isolated Handwritten Characters." LREC. 2008.
  127. ^ Calderara, Simone; Prati, Andrea; Cucchiara, Rita (2011). "Mixtures of von mises distributions for people trajectory shape analysis". IEEE Transactions on Circuits and Systems for Video Technology. 21 (4): 457–471. doi:10.1109/tcsvt.2011.2125550. S2CID 1427766.
  128. ^ Guyon, Isabelle, et al. "Result analysis of the nips 2003 feature selection challenge." Advances in neural information processing systems. 2004.
  129. ^ Lake, B. M.; Salakhutdinov, R.; Tenenbaum, J. B. (11 December 2015). "Human-level concept learning through probabilistic program induction". Science. 350 (6266): 1332–1338. Bibcode:2015Sci...350.1332L. doi:10.1126/science.aab3050. ISSN 0036-8075. PMID 26659050.
  130. ^ Lake, Brenden (9 November 2019), Omniglot data set for one-shot learning, retrieved 10 November 2019
  131. ^ LeCun, Yann; et al. (1998). "Gradient-based learning applied to document recognition". Proceedings of the IEEE. 86 (11): 2278–2324. CiteSeerX doi:10.1109/5.726791. S2CID 14542261.
  132. ^ Kussul, Ernst; Baidyk, Tatiana (2004). "Improved method of handwritten digit recognition tested on MNIST database". Image and Vision Computing. 22 (12): 971–981. doi:10.1016/j.imavis.2004.03.008.
  133. ^ Xu, Lei; Krzyżak, Adam; Suen, Ching Y. (1992). "Methods of combining multiple classifiers and their applications to handwriting recognition". IEEE Transactions on Systems, Man and Cybernetics. 22 (3): 418–435. doi:10.1109/21.155943. hdl:10338.dmlcz/135217.
  134. ^ Alimoglu, Fevzi, et al. "Combining multiple classifiers for pen-based handwritten digit recognition." (1996).
  135. ^ Tang, E. Ke; et al. (2005). "Linear dimensionality reduction using relevance weighted LDA". Pattern Recognition. 38 (4): 485–493. Bibcode:2005PatRe..38..485T. doi:10.1016/j.patcog.2004.09.005. S2CID 10580110.
  136. ^ Hong, Yi, et al. "Learning a mixture of sparse distance metrics for classification and dimensionality reduction." Computer Vision (ICCV), 2011 IEEE International Conference on. IEEE, 2011.
  137. ^ Thoma, Martin (2017). "The HASYv2 dataset". arXiv:1701.08380 [cs.CV].
  138. ^ Karki, Manohar; Liu, Qun; DiBiano, Robert; Basu, Saikat; Mukhopadhyay, Supratik (20 June 2018). "Pixel-level Reconstruction and Classification for Noisy Handwritten Bangla Characters". arXiv:1806.08037 [cs.CV].
  139. ^ Liu, Qun; Collier, Edward; Mukhopadhyay, Supratik (2019), "PCGAN-CHAR: Progressively Trained Classifier Generative Adversarial Networks for Classification of Noisy Handwritten Bangla Characters", Digital Libraries at the Crossroads of Digital Information for the Future, Springer International Publishing, pp. 3–15, arXiv:1908.08987, doi:10.1007/978-3-030-34058-2_1, ISBN 978-3-030-34057-5, S2CID 201665955
  140. ^ "iSAID". Retrieved 30 November 2021.
  141. ^ Zamir, Syed & Arora, Aditya & Gupta, Akshita & Khan, Salman & Sun, Guolei & Khan, Fahad & Zhu, Fan & Shao, Ling & Xia, Gui-Song & Bai, Xiang. (2019). iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Images. website
  142. ^ Yuan, Jiangye; Gleason, Shaun S.; Cheriyadat, Anil M. (2013). "Systematic benchmarking of aerial image segmentation". IEEE Geoscience and Remote Sensing Letters. 10 (6): 1527–1531. Bibcode:2013IGRSL..10.1527Y. doi:10.1109/lgrs.2013.2261453. S2CID 629629.
  143. ^ Vatsavai, Ranga Raju. "Object based image classification: state of the art and computational challenges." Proceedings of the 2nd ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data. ACM, 2013.
  144. ^ Butenuth, Matthias, et al. "Integrating pedestrian simulation, tracking and event detection for crowd analysis." Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on. IEEE, 2011.
  145. ^ Fradi, Hajer, and Jean-Luc Dugelay. "Low level crowd analysis using frame-wise normalized feature for people counting." Information Forensics and Security (WIFS), 2012 IEEE International Workshop on. IEEE, 2012.
  146. ^ Johnson, Brian Alan, Ryutaro Tateishi, and Nguyen Thanh Hoan. "A hybrid pansharpening approach and multiscale object-based image analysis for mapping diseased pine and oak trees." International journal of remote sensing34.20 (2013): 6969–6982.
  147. ^ Mohd Pozi, Muhammad Syafiq; Sulaiman, Md Nasir; Mustapha, Norwati; Perumal, Thinagaran (2015). "A new classification model for a class imbalanced data set using genetic programming and support vector machines: Case study for wilt disease classification". Remote Sensing Letters. 6 (7): 568–577. doi:10.1080/2150704X.2015.1062159. S2CID 58788630.
  148. ^ Gallego, A.-J.; Pertusa, A.; Gil, P. "Automatic Ship Classification from Optical Aerial Images with Convolutional Neural Networks." Remote Sensing. 2018; 10(4):511.
  149. ^ Gallego, A.-J.; Pertusa, A.; Gil, P. "MAritime SATellite Imagery dataset". Available:, 2018.
  150. ^ Johnson, Brian; Tateishi, Ryutaro; Xie, Zhixiao (2012). "Using geographically weighted variables for image classification". Remote Sensing Letters. 3 (6): 491–499. doi:10.1080/01431161.2011.629637. S2CID 122543681.
  151. ^ Chatterjee, Sankhadeep, et al. "Forest Type Classification: A Hybrid NN-GA Model Based Approach." Information Systems Design and Intelligent Applications. Springer India, 2016. 227–236.
  152. ^ Diegert, Carl. "A combinatorial method for tracing objects using semantics of their shape." Applied Imagery Pattern Recognition Workshop (AIPR), 2010 IEEE 39th. IEEE, 2010.
  153. ^ Razakarivony, Sebastien, and Frédéric Jurie. "Small target detection combining foreground and background manifolds." IAPR International Conference on Machine Vision Applications. 2013.
  154. ^ "SpaceNet". Retrieved 13 March 2018.
  155. ^ Etten, Adam Van (5 January 2017). "Getting Started With SpaceNet Data". The DownLinQ. Retrieved 13 March 2018.
  156. ^ Vakalopoulou, M.; Bus, N.; Karantzalosa, K.; Paragios, N. (July 2017). Integrating edge/boundary priors with classification scores for building detection in very high resolution data. 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). pp. 3309–3312. doi:10.1109/IGARSS.2017.8127705. ISBN 978-1-5090-4951-6. S2CID 8297433.
  157. ^ Yang, Yi; Newsam, Shawn (2010). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems – GIS '10. New York, New York, USA: ACM Press. doi:10.1145/1869790.1869829. ISBN 9781450304283. S2CID 993769.
  158. ^ a b Basu, Saikat; Ganguly, Sangram; Mukhopadhyay, Supratik; DiBiano, Robert; Karki, Manohar; Nemani, Ramakrishna (3 November 2015). DeepSat: a learning framework for satellite imagery. ACM. p. 37. doi:10.1145/2820783.2820816. ISBN 9781450339674. S2CID 4387134.
  159. ^ a b Liu, Qun; Basu, Saikat; Ganguly, Sangram; Mukhopadhyay, Supratik; DiBiano, Robert; Karki, Manohar; Nemani, Ramakrishna (21 November 2019). "DeepSat V2: feature augmented convolutional neural nets for satellite image classification". Remote Sensing Letters. 11 (2): 156–165. arXiv:1911.07747. doi:10.1080/2150704x.2019.1693071. ISSN 2150-704X. S2CID 208138097.
  160. ^ Md Jahidul Islam, et al. "Semantic Segmentation of Underwater Imagery: Dataset and Benchmark." 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2020.
  161. ^ Waszak et al. "Semantic Segmentation in Underwater Ship Inspections: Benchmark and Data Set." IEEE Journal of Oceanic Engineering. IEEE, 2022.
  162. ^ Ebadi, Ashkan; Paul, Patrick; Auer, Sofia; Tremblay, Stéphane (12 November 2021). "NRC-GAMMA: Introducing a Novel Large Gas Meter Image Dataset". arXiv:2111.06827 [cs.CV].
  163. ^ Canada, Government of Canada National Research Council (2021). "The gas meter image dataset (NRC-GAMMA) - NRC Digital Repository". doi:10.4224/3c8s-z290. Retrieved 2 December 2021.
  164. ^ Rabah, Chaima Ben; Coatrieux, Gouenou; Abdelfattah, Riadh (October 2020). "The Supatlantique Scanned Documents Database for Digital Image Forensics Purposes". 2020 IEEE International Conference on Image Processing (ICIP). IEEE: 2096–2100. doi:10.1109/icip40778.2020.9190665. ISBN 978-1-7281-6395-6. S2CID 224881147.
  165. ^ Mills, Kyle; Tamblyn, Isaac (16 May 2018), Big graphene dataset, National Research Council of Canada, doi:10.4224/
  166. ^ Mills, Kyle; Spanner, Michael; Tamblyn, Isaac (16 May 2018). "Quantum simulation". Quantum simulations of an electron in a two dimensional potential well. National Research Council of Canada. doi:10.4224/
  167. ^ Rohrbach, M.; Amin, S.; Andriluka, M.; Schiele, B. (2012). "A database for fine grained activity detection of cooking activities". 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE. pp. 1194–1201. doi:10.1109/cvpr.2012.6247801. ISBN 978-1-4673-1228-8.
  168. ^ Kuehne, Hilde, Ali Arslan, and Thomas Serre. "The language of actions: Recovering the syntax and semantics of goal-directed human activities."Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014.
  169. ^ Sviatoslav, Voloshynovskiy, et al. "Towards Reproducible results in authentication based on physical non-cloneable functions: The Forensic Authentication Microstructure Optical Set (FAMOS)."Proc. Proceedings of IEEE International Workshop on Information Forensics and Security. 2012.
  170. ^ Olga, Taran and Shideh, Rezaeifar, et al. "PharmaPack: mobile fine-grained recognition of pharma packages."Proc. European Signal Processing Conference (EUSIPCO). 2017.
  171. ^ Khosla, Aditya, et al. "Novel dataset for fine-grained image categorization: Stanford dogs."Proc. CVPR Workshop on Fine-Grained Visual Categorization (FGVC). 2011.
  172. ^ a b Parkhi, Omkar M., et al. "Cats and dogs."Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2012.
  173. ^ Biggs, Benjamin; Boyne, Oliver; Charles, James; Fitzgibbon, Andrew; Cipolla, Roberto (2020). Computer Vision – ECCV 2020. Lecture Notes in Computer Science. Vol. 12356. arXiv:2007.11110. doi:10.1007/978-3-030-58621-8. ISBN 978-3-030-58620-1. S2CID 227173931.
  174. ^ a b Razavian, Ali, et al. "CNN features off-the-shelf: an astounding baseline for recognition." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2014.
  175. ^ Ortega, Michael; et al. (1998). "Supporting ranked boolean similarity queries in MARS". IEEE Transactions on Knowledge and Data Engineering. 10 (6): 905–925. CiteSeerX doi:10.1109/69.738357.
  176. ^ He, Xuming, Richard S. Zemel, and Miguel Á. Carreira-Perpiñán. "Multiscale conditional random fields for image labeling." Computer vision and pattern recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE computer society conference on. Vol. 2. IEEE, 2004.
  177. ^ Deneke, Tewodros, et al. "Video transcoding time prediction for proactive load balancing." Multimedia and Expo (ICME), 2014 IEEE International Conference on. IEEE, 2014.
  178. ^ Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell (13 April 2016). "Visual Storytelling". arXiv:1604.03968 [cs.CL].{{cite arxiv}}: CS1 maint: multiple names: authors list (link)
  179. ^ Wah, Catherine, et al. "The caltech-ucsd birds-200-2011 dataset." (2011).
  180. ^ Duan, Kun, et al. "Discovering localized attributes for fine-grained recognition." Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2012.
  181. ^ "YouTube-8M Dataset". Retrieved 1 October 2016.
  182. ^ Abu-El-Haija, Sami; Kothari, Nisarg; Lee, Joonseok; Natsev, Paul; Toderici, George; Varadarajan, Balakrishnan; Vijayanarasimhan, Sudheendra (27 September 2016). "YouTube-8M: A Large-Scale Video Classification Benchmark". arXiv:1609.08675 [cs.CV].
  183. ^ "YFCC100M Dataset". Yahoo-ICSI-LLNL. Retrieved 1 June 2017.
  184. ^ Bart Thomee; David A Shamma; Gerald Friedland; Benjamin Elizalde; Karl Ni; Douglas Poland; Damian Borth; Li-Jia Li (25 April 2016). "Yfcc100m: The new data in multimedia research". Communications of the ACM. 59 (2): 64–73. arXiv:1503.01817. doi:10.1145/2812802. S2CID 207230134.
  185. ^ Y. Baveye, E. Dellandrea, C. Chamaret, and L. Chen, "LIRIS-ACCEDE: A Video Database for Affective Content Analysis," in IEEE Transactions on Affective Computing, 2015.
  186. ^ Y. Baveye, E. Dellandrea, C. Chamaret, and L. Chen, "Deep Learning vs. Kernel Methods: Performance for Emotion Prediction in Videos," in 2015 Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII), 2015.
  187. ^ M. Sjöberg, Y. Baveye, H. Wang, V. L. Quang, B. Ionescu, E. Dellandréa, M. Schedl, C.-H. Demarty, and L. Chen, "The mediaeval 2015 affective impact of movies task," in MediaEval 2015 Workshop, 2015.
  188. ^ S. Johnson and M. Everingham, "Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation", in Proceedings of the 21st British Machine Vision Conference (BMVC2010)
  189. ^ S. Johnson and M. Everingham, "Learning Effective Human Pose Estimation from Inaccurate Annotation", In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR2011)
  190. ^ Afifi, Mahmoud; Hussain, Khaled F. (2 November 2017). "The Achievement of Higher Flexibility in Multiple Choice-based Tests Using Image Classification Techniques". arXiv:1711.00972 [cs.CV].
  191. ^ "MCQ Dataset". Retrieved 18 November 2017.
  192. ^ Taj-Eddin, I. A. T. F.; Afifi, M.; Korashy, M.; Hamdy, D.; Nasser, M.; Derbaz, S. (July 2016). A new compression technique for surveillance videos: Evaluation using new dataset. 2016 Sixth International Conference on Digital Information and Communication Technology and Its Applications (DICTAP). pp. 159–164. doi:10.1109/DICTAP.2016.7544020. ISBN 978-1-4673-9609-7. S2CID 8698850.
  193. ^ Tabak, Michael A.; Norouzzadeh, Mohammad S.; Wolfson, David W.; Sweeney, Steven J.; Vercauteren, Kurt C.; Snow, Nathan P.; Halseth, Joseph M.; Di Salvo, Paul A.; Lewis, Jesse S.; White, Michael D.; Teton, Ben; Beasley, James C.; Schlichting, Peter E.; Boughton, Raoul K.; Wight, Bethany; Newkirk, Eric S.; Ivan, Jacob S.; Odell, Eric A.; Brook, Ryan K.; Lukacs, Paul M.; Moeller, Anna K.; Mandeville, Elizabeth G.; Clune, Jeff; Miller, Ryan S.; Photopoulou, Theoni (2018). "Machine learning to classify animal species in camera trap images: Applications in ecology". Methods in Ecology and Evolution. 10 (4): 585–590. doi:10.1111/2041-210X.13120. ISSN 2041-210X.
  194. ^ Taj-Eddin, Islam A. T. F.; Afifi, Mahmoud; Korashy, Mostafa; Ahmed, Ali H.; Ng, Yoke Cheng; Hernandez, Evelyng; Abdel-Latif, Salma M. (November 2017). "Can we see photosynthesis? Magnifying the tiny color changes of plant green leaves using Eulerian video magnification". Journal of Electronic Imaging. 26 (6): 060501. arXiv:1706.03867. Bibcode:2017JEI....26f0501T. doi:10.1117/1.jei.26.6.060501. ISSN 1017-9909. S2CID 12367169.
  195. ^ "Mathematical Mathematics Memes".
  196. ^ Karras, Tero; Laine, Samuli; Aila, Timo (June 2019). "A Style-Based Generator Architecture for Generative Adversarial Networks". 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE: 4396–4405. arXiv:1812.04948. doi:10.1109/cvpr.2019.00453. ISBN 978-1-7281-3293-8. S2CID 54482423.
  197. ^ McAuley, Julian; Targett, Christopher; Shi, Qinfeng; Anton van den Hengel (2015). "Image-based Recommendations on Styles and Substitutes". arXiv:1506.04757 [cs.CV].
  198. ^ "Amazon review data". Retrieved 8 October 2021.
  199. ^ Ganesan, Kavita; Zhai, Chengxiang (2012). "Opinion-based entity ranking". Information Retrieval. 15 (2): 116–150. doi:10.1007/s10791-011-9174-8. hdl:2142/15252. S2CID 16258727.
  200. ^ Lv, Yuanhua, Dimitrios Lymberopoulos, and Qiang Wu. "An exploration of ranking heuristics in mobile local search." Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval. ACM, 2012.
  201. ^ Harper, F. Maxwell; Konstan, Joseph A. (2015). "The MovieLens Datasets: History and Context". ACM Transactions on Interactive Intelligent Systems. 5 (4): 19. doi:10.1145/2827872. S2CID 16619709.
  202. ^ Koenigstein, Noam, Gideon Dror, and Yehuda Koren. "Yahoo! music recommendations: modeling music ratings with temporal dynamics and item taxonomy." Proceedings of the fifth ACM conference on Recommender systems. ACM, 2011.
  203. ^ McFee, Brian, et al. "The million song dataset challenge." Proceedings of the 21st international conference companion on World Wide Web. ACM, 2012.
  204. ^ Bohanec, Marko, and Vladislav Rajkovic. "Knowledge acquisition and explanation for multi-attribute decision making." 8th Intl Workshop on Expert Systems and their Applications. 1988.
  205. ^ Tan, Peter J., and David L. Dowe. "MML inference of decision graphs with multi-way joins." Australian Joint Conference on Artificial Intelligence. 2002.
  206. ^ "Quantifying comedy on YouTube: why the number of o's in your LOL matter". Metatext NLP Database. Retrieved 26 October 2020.
  207. ^ Kim, Byung Joo (2012). "A Classifier for Big Data". Convergence and Hybrid Information Technology. Communications in Computer and Information Science. Vol. 310. pp. 505–512. doi:10.1007/978-3-642-32692-9_63. ISBN 978-3-642-32691-2.
  208. ^ Pérezgonzález, Jose D.; Gilbey, Andrew (2011). "Predicting Skytrax airport rankings from customer reviews". Journal of Airport Management. 5 (4): 335–339.
  209. ^ Loh, Wei-Yin, and Yu-Shan Shih. "Split selection methods for classification trees." Statistica sinica(1997): 815–840.
  210. ^ Lim, Tjen-Sien; Loh, Wei-Yin; Shih, Yu-Shan (2000). "A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms". Machine Learning. 40 (3): 203–228. doi:10.1023/a:1007608224229. S2CID 17030953.
  211. ^ Kiet Van Nguyen, Vu Duc Nguyen, Phu X. V. Nguyen, Tham T. H. Truong, Ngan Luu-Thuy Nguyen. "UIT-VSFC: Vietnamese Students’ Feedback Corpus for Sentiment Analysis
  212. ^ Ho, Vong Anh; Nguyen, Duong Huynh-Cong; Nguyen, Danh Hoang; Pham, Linh Thi-Van; Nguyen, Duc-Vu; Nguyen, Kiet Van; Nguyen, Ngan Luu-Thuy (2020). "Emotion Recognition for Vietnamese Social Media Text". Computational Linguistics. Communications in Computer and Information Science. Vol. 1215. pp. 319–333. arXiv:1911.09339. doi:10.1007/978-981-15-6168-9_27. ISBN 978-981-15-6167-2. S2CID 208202333.
  213. ^ Nhung Thi-Hong Nguyen, Phuong Ha-Dieu Phan, Luan Thanh Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen (24 April 2021). "Vietnamese Open-domain Complaint Detection in E-Commerce Websites". arXiv:2104.11969 [cs.CL].{{cite arxiv}}: CS1 maint: multiple names: authors list (link)
  214. ^ Phu Gia Hoang, Canh Duc Luu, Khanh Quoc Tran, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen (26 January 2023). "ViHOS: Hate Speech Spans Detection for Vietnamese". arXiv:2301.10186 [cs.CL].{{cite arxiv}}: CS1 maint: multiple names: authors list (link)
  215. ^ Dermouche, Mohamed; Velcin, Julien; Khouas, Leila; Loudcher, Sabine (2014). "A Joint Model for Topic-Sentiment Evolution over Time". 2014 IEEE International Conference on Data Mining. IEEE. pp. 773–778. doi:10.1109/icdm.2014.82. ISBN 978-1-4799-4302-9.
  216. ^ Rose, Tony; Stevenson, Mark; Whitehead, Miles (2002). "The Reuters Corpus Volume 1-from Yesterday's News to Tomorrow's Language Resources" (PDF). LREC. 2. S2CID 9239414. Archived from the original (PDF) on 6 August 2019.
  217. ^ Amini, Massih R.; Usunier, Nicolas; Goutte, Cyril (2009). "Learning from Multiple Partially Observed Views – an Application to Multilingual Text Categorization". Advances in Neural Information Processing Systems. 22: 28–36.
  218. ^ Liu, Ming; et al. (2015). "VRCA: a clustering algorithm for massive amount of texts". Proceedings of the 24th International Conference on Artificial Intelligence. AAAI Press.
  219. ^ Al-Harbi, S; Almuhareb, A; Al-Thubaity, A; Khorsheed, M. S.; Al-Rajeh, A (2008). "Automatic Arabic Text Classification". Proceedings of the 9th International Conference on the Statistical Analysis of Textual Data, Lyon, France.
  220. ^ "Relationship and Entity Extraction Evaluation Dataset: Dstl/re3d". GitHub. 17 December 2018.
  221. ^ "The Examiner – SpamClickBait Catalogue".
  222. ^ "A Million News Headlines".
  223. ^ "One Week of Global News Feeds".
  224. ^ Kulkarni, Rohit (2018), Reuters News-Wire Archive, Harvard Dataverse, doi:10.7910/DVN/XDB74W
  225. ^ "IrishTimes – the Waxy-Wany News".
  226. ^ "News Headlines Dataset For Sarcasm Detection". Retrieved 27 April 2019.
  227. ^ Klimt, Bryan, and Yiming Yang. "Introducing the Enron Corpus." CEAS. 2004.
  228. ^ Kossinets, Gueorgi; Kleinberg, Jon; Watts, Duncan (2008). "The Structure of Information Pathways in a Social Communication Network". arXiv:0806.3201 [physics.soc-ph].
  229. ^ Androutsopoulos, Ion; Koutsias, John; Chandrinos, Konstantinos V.; Paliouras, George; Spyropoulos, Constantine D. (2000). "An evaluation of Naive Bayesian anti-spam filtering". In Potamias, G.; Moustakis, V.; van Someren, M. (eds.). Proceedings of the Workshop on Machine Learning in the New Information Age. 11th European Conference on Machine Learning, Barcelona, Spain. Vol. 11. pp. 9–17. arXiv:cs/0006013. Bibcode:2000cs........6013A.
  230. ^ Bratko, Andrej; et al. (2006). "Spam filtering using statistical data compression models" (PDF). The Journal of Machine Learning Research. 7: 2673–2698.
  231. ^ Almeida, Tiago A., José María G. Hidalgo, and Akebo Yamakami. "Contributions to the study of SMS spam filtering: new collection and results."Proceedings of the 11th ACM symposium on Document engineering. ACM, 2011.
  232. ^ Delany; Jane, Sarah; Buckley, Mark; Greene, Derek (2012). "SMS spam filtering: methods and data". Expert Systems with Applications. 39 (10): 9899–9908. doi:10.1016/j.eswa.2012.02.053. S2CID 15546924.
  233. ^ Joachims, Thorsten. A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization. No. CMU-CS-96-118. Carnegie-mellon univ pittsburgh pa dept of computer science, 1996.
  234. ^ Dimitrakakis, Christos, and Samy Bengio. Online Policy Adaptation for Ensemble Algorithms. No. EPFL-REPORT-82788. IDIAP, 2002.
  235. ^ Dooms, S. et al. "Movietweetings: a movie rating dataset collected from twitter, 2013. Available from"
  236. ^ RoyChowdhury, Aruni; Lin, Tsung-Yu; Maji, Subhransu; Learned-Miller, Erik (2017). "Twitter100k: A Real-world Dataset for Weakly Supervised Cross-Media Retrieval". arXiv:1703.06618 [cs.CV].
  237. ^ "huyt16/Twitter100k". GitHub. Retrieved 26 March 2018.
  238. ^ Go, Alec; Bhayani, Richa; Huang, Lei (2009). "Twitter sentiment classification using distant supervision". CS224N Project Report, Stanford. 1: 12.
  239. ^ Chikersal, Prerna, Soujanya Poria, and Erik Cambria. "SeNTU: sentiment analysis of tweets by combining a rule-based classifier with supervised learning." Proceedings of the International Workshop on Semantic Evaluation, SemEval. 2015.
  240. ^ Zafarani, Reza, and Huan Liu. "Social computing data repository at ASU." School of Computing, Informatics and Decision Systems Engineering, Arizona State University (2009).
  241. ^ Bisgin, Halil, Nitin Agarwal, and Xiaowei Xu. "Investigating homophily in online social networks[dead link]." Web Intelligence and Intelligent Agent Technology (WI-IAT), 2010 IEEE/WIC/ACM International Conference on. Vol. 1. IEEE, 2010.
  242. ^ McAuley, Julian J.; Leskovec, Jure. "Learning to Discover Social Circles in Ego Networks". NIPS. 2012: 2012.
  243. ^ Šubelj, Lovro; Fiala, Dalibor; Bajec, Marko (2014). "Network-based statistical comparison of citation topology of bibliographic databases". Scientific Reports. 4 (6496): 6496. arXiv:1502.05061. Bibcode:2014NatSR...4E6496S. doi:10.1038/srep06496. PMC 4178292. PMID 25263231.
  244. ^ Abdulla, N., et al. "Arabic sentiment analysis: Corpus-based and lexicon-based." Proceedings of the IEEE conference on Applied Electrical Engineering and Computing Technologies (AEECT). 2013.
  245. ^ Abooraig, Raddad, et al. "On the automatic categorization of Arabic articles based on their political orientation." Third International Conference on Informatics Engineering and Information Science (ICIEIS2014). 2014.
  246. ^ Kawala, François, et al. "Prédictions d'activité dans les réseaux sociaux en ligne." 4ième conférence sur les modèles et l'analyse des réseaux: Approches mathématiques et informatiques. 2013.
  247. ^ Sabharwal, Ashish; Samulowitz, Horst; Tesauro, Gerald (2015). "Selecting Near-Optimal Learners via Incremental Data Allocation". arXiv:1601.00024 [cs.LG].
  248. ^ Xu et al. "SemEval-2015 Task 1: Paraphrase and Semantic Similarity in Twitter (PIT)" Proceedings of the 9th International Workshop on Semantic Evaluation. 2015.
  249. ^ Xu et al. "Extracting Lexically Divergent Paraphrases from Twitter" Transactions of the Association for Computational (TACL). 2014.
  250. ^ Middleton, Stuart E; Middleton, Lee; Modafferi, Stefano (2014). "Real-Time Crisis Mapping of Natural Disasters Using Social Media" (PDF). IEEE Intelligent Systems. 29 (2): 9–17. doi:10.1109/MIS.2013.126. S2CID 15139204.
  251. ^ "geoparsepy". 2016. Python PyPI library
  252. ^ Gupta, Aakash (5 December 2020). "Dutch social media collection". doi:10.5072/FK2/MTPTL7. {{cite journal}}: Cite journal requires |journal= (help); Check |url= value (help)
  253. ^ "Streamlit". Retrieved 18 December 2020.
  254. ^ "Dutch Social media collection". Retrieved 18 December 2020.
  255. ^ Forsyth, E., Lin, J., & Martell, C. (2008, June 25). The NPS Chat Corpus. Retrieved from
  256. ^ Sordoni, Alessandro; Galley, Michel; Auli, Michael; Brockett, Chris; Ji, Yangfeng; Mitchell, Margaret; Nie, Jian-Yun; Gao, Jianfeng; Dolan, Bill (2015). "A Neural Network Approach to Context-Sensitive Generation of Conversational Responses". arXiv:1506.06714 [cs.CL].
  257. ^ Shaoul, C. & Westbury C. (2013) A reduced redundancy USENET corpus (2005–2011) Edmonton, AB: University of Alberta (downloaded from
  258. ^ KAN, M. (2011, January). NUS Short Message Service (SMS) Corpus. Retrieved from Archived 29 June 2018 at the Wayback Machine
  259. ^ Stuck_In_the_Matrix. (2015, July 3). I have every publicly available Reddit comment for research. ~ 1.7 billion comments @ 250 GB compressed. Any interest in this? [Original post]. Message posted to
  260. ^ Lowe, Ryan; Pow, Nissan; Serban, Iulian; Pineau, Joelle (2015). "The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems". arXiv:1506.08909 [cs.CL].
  261. ^ Jason Williams Antoine Raux Matthew Henderson, "[1]", Dialogue & Discourse | April 2016 .
  262. ^ Hoppe, Travis (16 December 2021), The-Pile-FreeLaw, retrieved 11 January 2023
  263. ^ Zheng, Lucia; Guha, Neel; Anderson, Brandon R.; Henderson, Peter; Ho, Daniel E. (21 June 2021). "When does pretraining help?". Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law. New York, NY, USA: ACM: 159–168. doi:10.1145/3462757.3466088. ISBN 9781450385268. S2CID 233296302.
  264. ^ "pile-of-law/pile-of-law · Datasets at Hugging Face". 4 July 2022. Retrieved 11 January 2023.
  265. ^ "About | Caselaw Access Project". Retrieved 11 January 2023.
  266. ^ K. Kowsari, D. E. Brown, M. Heidarysafa, K. Jafari Meimandi, M. S. Gerber and L. E. Barnes, "HDLTex: Hierarchical Deep Learning for Text Classification", 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 364–371. doi: 10.1109/ICMLA.2017.0-134
  267. ^ K. Kowsari, D. E. Brown, M. Heidarysafa, K. Jafari Meimandi, M. S. Gerber and L. E. Barnes, "Web of Science Dataset", doi:10.17632/9rw3vkcfy4.6
  268. ^ Galgani, Filippo, Paul Compton, and Achim Hoffmann. "Combining different summarization techniques for legal text." Proceedings of the Workshop on Innovative Hybrid Approaches to the Processing of Textual Data. Association for Computational Linguistics, 2012.
  269. ^ Nagwani, N. K. (2015). "Summarizing large text collection using topic modeling and clustering based on MapReduce framework". Journal of Big Data. 2 (1): 1–18. doi:10.1186/s40537-015-0020-5.
  270. ^ Schler, Jonathan; et al. (2006). "Effects of Age and Gender on Blogging" (PDF). AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs. 6.
  271. ^ Anand, Pranav, et al. "Believe Me-We Can Do This! Annotating Persuasive Acts in Blog Text."Computational Models of Natural Argument. 2011.
  272. ^ Traud, Amanda L., Peter J. Mucha, and Mason A. Porter. "Social structure of Facebook networks." Physica A: Statistical Mechanics and its Applications391.16 (2012): 4165–4180.
  273. ^ Richard, Emile; Savalle, Pierre-Andre; Vayatis, Nicolas (2012). "Estimation of Simultaneously Sparse and Low Rank Matrices". arXiv:1206.6474 [cs.DS].
  274. ^ Richardson, Matthew; Burges, Christopher JC; Renshaw, Erin (2013). "MCTest: A Challenge Dataset for the Open-Domain Machine Comprehension of Text". EMNLP. 1.
  275. ^ Weston, Jason; Bordes, Antoine; Chopra, Sumit; Rush, Alexander M.; Bart van Merriënboer; Joulin, Armand; Mikolov, Tomas (2015). "Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks". arXiv:1502.05698 [cs.AI].
  276. ^ Marcus, Mitchell P.; Ann Marcinkiewicz, Mary; Santorini, Beatrice (1993). "Building a large annotated corpus of English: The Penn Treebank". Computational Linguistics. 19 (2): 313–330.
  277. ^ Collins, Michael (2003). "Head-driven statistical models for natural language parsing". Computational Linguistics. 29 (4): 589–637. doi:10.1162/089120103322753356.
  278. ^ Guyon, Isabelle, et al., eds. Feature extraction: foundations and applications. Vol. 207. Springer, 2008.
  279. ^ Lin, Yuri, et al. "Syntactic annotations for the google books ngram corpus." Proceedings of the ACL 2012 system demonstrations. Association for Computational Linguistics, 2012.
  280. ^ Krishnamoorthy, Niveda; et al. (2013). "Generating Natural-Language Video Descriptions Using Text-Mined Knowledge". AAAI. 1.
  281. ^ Luyckx, Kim, and Walter Daelemans. "Personae: a Corpus for Author and Personality Prediction from Text[dead link]." LREC. 2008.
  282. ^ Solorio, Thamar, Ragib Hasan, and Mainul Mizan. "A case study of sockpuppet detection in wikipedia." Workshop on Language Analysis in Social Media (LASM) at NAACL HLT. 2013.
  283. ^ "Pushshift Files". Retrieved 12 January 2023.
  284. ^ Baumgartner, Jason; Zannettou, Savvas; Keegan, Brian; Squire, Megan; Blackburn, Jeremy (23 January 2020). "The Pushshift Reddit Dataset". arXiv:2001.08435 [cs.SI].
  285. ^ Ciarelli, Patrick Marques, and Elias Oliveira. "Agglomeration and elimination of terms for dimensionality reduction." Intelligent Systems Design and Applications, 2009. ISDA'09. Ninth International Conference on. IEEE, 2009.
  286. ^ Zhou, Mingyuan, Oscar Hernan Madrid Padilla, and James G. Scott. "Priors for random count matrices derived from a family of negative binomial processes." Journal of the American Statistical Association just-accepted (2015): 00–00.
  287. ^ Kotzias, Dimitrios, et al. "From group to individual labels using deep features." Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 2015.
  288. ^ Ning, Yue; Muthiah, Sathappan; Rangwala, Huzefa; Ramakrishnan, Naren (2016). "Modeling Precursors for Event Forecasting via Nested Multi-Instance Learning". arXiv:1602.08033 [cs.SI].
  289. ^ Buza, Krisztian. "Feedback prediction for blogs."Data analysis, machine learning and knowledge discovery. Springer International Publishing, 2014. 145–152.
  290. ^ Soysal, Ömer M (2015). "Association rule mining with mostly associated sequential patterns". Expert Systems with Applications. 42 (5): 2582–2592. doi:10.1016/j.eswa.2014.10.049.
  291. ^ Bowman, Samuel R.; Angeli, Gabor; Potts, Christopher; Manning, Christopher D. (2015). "A large annotated corpus for learning natural language inference". arXiv:1508.05326 [cs.CL].
  292. ^ "DSL Corpus Collection". Retrieved 22 September 2017.
  293. ^ "Urban Dictionary Words and Definitions".
  294. ^ H. Elsahar, P. Vougiouklis, A. Remaci, C. Gravier, J. Hare, F. Laforest, E. Simperl, "T-REx: A Large Scale Alignment of Natural Language with Knowledge Base Triples", Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018).
  295. ^ Wang, Alex; Singh, Amanpreet; Michael, Julian; Hill, Felix; Levy, Omer; Bowman, Samuel R. (2018). "GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding". arXiv:1804.07461 [cs.CL].
  296. ^ "Computers Are Learning to Read—But They're Still Not So Smart". Wired. Retrieved 29 December 2019.
  297. ^ "GLUE Benchmark". Retrieved 25 February 2019.
  298. ^ Quan, Hoang Lam; Quang, Duy Le; Van Kiet, Nguyen; Ngan, Luu-Thuy Nguyen. "UIT-ViIC: A Dataset for the First Evaluation on Vietnamese Image Captioning".
  299. ^ To, Quoc Huy; Nguyen, Van Kiet; Nguyen, Luu Thuy Ngan; Nguyen, Gia Tuan Anh (2020). "Gender Prediction Based on Vietnamese Names with Machine Learning Techniques". Proceedings of the 4th International Conference on Natural Language Processing and Information Retrieval. pp. 55–60. arXiv:2010.10852. doi:10.1145/3443279.3443309. ISBN 9781450377607. S2CID 224814110.
  300. ^ Nguyen, Luan Thanh; Van Nguyen, Kiet; Nguyen, Ngan Luu-Thuy (18 March 2021). "Constructive and Toxic Speech Detection for Open-Domain Social Media Comments in Vietnamese". Advances and Trends in Artificial Intelligence. Artificial Intelligence Practices. Lecture Notes in Computer Science. Vol. 12798. pp. 572–583. arXiv:2103.10069. doi:10.1007/978-3-030-79457-6_49. ISBN 978-3-030-79456-9. S2CID 232269671.
  301. ^ M. Versteegh, R. Thiollière, T. Schatz, X.-N. Cao, X. Anguera, A. Jansen, and E. Dupoux (2015). "The Zero Resource Speech Challenge 2015," in INTERSPEECH-2015.
  302. ^ M. Versteegh, X. Anguera, A. Jansen, and E. Dupoux, (2016). "The Zero Resource Speech Challenge 2015: Proposed Approaches and Results," in SLTU-2016.
  303. ^ Sakar, Betul Erdogdu; et al. (2013). "Collection and analysis of a Parkinson speech dataset with multiple types of sound recordings". IEEE Journal of Biomedical and Health Informatics. 17 (4): 828–834. doi:10.1109/jbhi.2013.2245674. PMID 25055311. S2CID 15491516.
  304. ^ Zhao, Shunan, et al. "Automatic detection of expressed emotion in Parkinson's disease." Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014.
  305. ^ Used in: Hammami, Nacereddine, and Mouldi Bedda. "Improved tree model for Arabic speech recognition." Computer Science and Information Technology (ICCSIT), 2010 3rd IEEE International Conference on. Vol. 5. IEEE, 2010.
  306. ^ Maaten, Laurens. "Learning discriminative fisher kernels." Proceedings of the 28th International Conference on Machine Learning (ICML-11). 2011.
  307. ^ Cole, Ronald, and Mark Fanty. "Spoken letter recognition." Proc. Third DARPA Speech and Natural Language Workshop. 1990.
  308. ^ Chapelle, Olivier; Sindhwani, Vikas; Keerthi, Sathiya S. (2008). "Optimization techniques for semi-supervised support vector machines" (PDF). The Journal of Machine Learning Research. 9: 203–233.
  309. ^ Kudo, Mineichi; Toyama, Jun; Shimbo, Masaru (1999). "Multidimensional curve classification using passing-through regions". Pattern Recognition Letters. 20 (11): 1103–1111. Bibcode:1999PaReL..20.1103K. CiteSeerX doi:10.1016/s0167-8655(99)00077-x.
  310. ^ Jaeger, Herbert; et al. (2007). "Optimization and applications of echo state networks with leaky-integrator neurons". Neural Networks. 20 (3): 335–352. doi:10.1016/j.neunet.2007.04.016. PMID 17517495.
  311. ^ Tsanas, Athanasios; et al. (2010). "Accurate telemonitoring of Parkinson's disease progression by noninvasive speech tests". IEEE Transactions on Biomedical Engineering (Submitted manuscript). 57 (4): 884–893. doi:10.1109/tbme.2009.2036000. PMID 19932995. S2CID 7382779.
  312. ^ Clifford, Gari D.; Clifton, David (2012). "Wireless technology in disease management and medicine". Annual Review of Medicine. 63: 479–492. doi:10.1146/annurev-med-051210-114650. PMID 22053737.
  313. ^ Zue, Victor; Seneff, Stephanie; Glass, James (1990). "Speech database development at MIT: TIMIT and beyond". Speech Communication. 9 (4): 351–356. doi:10.1016/0167-6393(90)90010-7.
  314. ^ Kapadia, Sadik, Valtcho Valtchev, and S. J. Young. "MMI training for continuous phoneme recognition on the TIMIT database." Acoustics, Speech, and Signal Processing, 1993. ICASSP-93., 1993 IEEE International Conference on. Vol. 2. IEEE, 1993.
  315. ^ Halabi, Nawar (2016). Modern Standard Arabic Phonetics for Speech Synthesis (PDF) (PhD Thesis). University of Southampton, School of Electronics and Computer Science.
  316. ^ Ardila, Rosana; Branson, Megan; Davis, Kelly; Henretty, Michael; Kohler, Michael; Meyer, Josh; Morais, Reuben; Saunders, Lindsay; Tyers, Francis M.; Weber, Gregor (13 December 2019). "Common Voice: A Massively-Multilingual Speech Corpus". arXiv:1912.06670v2 [cs.CL].
  317. ^ "The LJ Speech Dataset". Retrieved 13 April 2022.
  318. ^ Zhou, Fang, Q. Claire, and Ross D. King. "Predicting the geographical origin of music." Data Mining (ICDM), 2014 IEEE International Conference on. IEEE, 2014.
  319. ^ Saccenti, Edoardo; Camacho, José (2015). "On the use of the observation‐wise k‐fold operation in PCA cross‐validation". Journal of Chemometrics. 29 (8): 467–478. doi:10.1002/cem.2726. hdl:10481/55302. S2CID 62248957.
  320. ^ Bertin-Mahieux, Thierry, et al. "The million song dataset." ISMIR 2011: Proceedings of the 12th International Society for Music Information Retrieval Conference, 24–28 October 2011, Miami, Florida. University of Miami, 2011.
  321. ^ Henaff, Mikael; et al. (2011). "Unsupervised learning of sparse features for scalable audio classification" (PDF). ISMIR. 11.
  322. ^ Rafii, Zafar (2017). "Music". MUSDB18 – a corpus for music separation. doi:10.5281/zenodo.1117372.
  323. ^ Defferrard, Michaël; Benzi, Kirell; Vandergheynst, Pierre; Bresson, Xavier (6 December 2016). "FMA: A Dataset For Music Analysis". arXiv:1612.01840 [cs.SD].
  324. ^ Esposito, Roberto; Radicioni, Daniele P. (2009). "Carpediem: Optimizing the viterbi algorithm and applications to supervised sequential learning" (PDF). The Journal of Machine Learning Research. 10: 1851–1880.
  325. ^ Sourati, Jamshid; et al. (2016). "Classification Active Learning Based on Mutual Information". Entropy. 18 (2): 51. Bibcode:2016Entrp..18...51S. doi:10.3390/e18020051.
  326. ^ Salamon, Justin; Jacoby, Christopher; Bello, Juan Pablo. "A dataset and taxonomy for urban sound research." Proceedings of the ACM International Conference on Multimedia. ACM, 2014.
  327. ^ Lagrange, Mathieu; Lafay, Grégoire; Rossignol, Mathias; Benetos, Emmanouil; Roebel, Axel (2015). "An evaluation framework for event detection using a morphological model of acoustic scenes". arXiv:1502.00141 [stat.ML].
  328. ^ Gemmeke, Jort F., et al. "Audio Set: An ontology and human-labeled dataset for audio events." IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 2017.
  329. ^ "Watch out, birders: Artificial intelligence has learned to spot birds from their songs". Science | AAAS. 18 July 2018. Retrieved 22 July 2018.
  330. ^ "Bird Audio Detection challenge". Machine Listening Lab at Queen Mary University. 3 May 2016. Retrieved 22 July 2018.
  331. ^ Wichern, Gordon; Antognini, Joe; Flynn, Michael; Licheng Richard Zhu; McQuinn, Emmett; Crow, Dwight; Manilow, Ethan; Jonathan Le Roux (2019). "WHAM!: Extending Speech Separation to Noisy Environments". arXiv:1907.01160 [cs.SD].
  332. ^ Drossos, K., Lipping, S., and Virtanen, T. "Clotho: An Audio Captioning Dataset" IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 2020.
  333. ^ Drossos, K., Lipping, S., and Virtanen, T. (2019). Clotho dataset (Version 1.0) [Data set]. Zenodo.
  334. ^ The CAIDA UCSD Dataset on the Witty Worm – 19–24 March 2004,
  335. ^ Chen, Zesheng, and Chuanyi Ji. "Optimal worm-scanning method using vulnerable-host distributions." International Journal of Security and Networks 2.1–2 (2007): 71–80.
  336. ^ Kachuee, Mohamad, et al. "Cuff-less high-accuracy calibration-free blood pressure estimation using pulse transit time." Circuits and Systems (ISCAS), 2015 IEEE International Symposium on. IEEE, 2015.
  337. ^ PhysioBank, PhysioToolkit. "PhysioNet: components of a new research resource for complex physiologic signals." Circulation. v101 i23. e215-e220.
  338. ^ Vergara, Alexander; et al. (2012). "Chemical gas sensor drift compensation using classifier ensembles". Sensors and Actuators B: Chemical. 166: 320–329. doi:10.1016/j.snb.2012.01.074.
  339. ^ Korotcenkov, G.; Cho, B. K. (2014). "Engineering approaches to improvement of conductometric gas sensor parameters. Part 2: Decrease of dissipated (consumable) power and improvement stability and reliability". Sensors and Actuators B: Chemical. 198: 316–341. doi:10.1016/j.snb.2014.03.069.
  340. ^ Quinlan, John R (1992). "Learning with continuous classes" (PDF). 5th Australian Joint Conference on Artificial Intelligence. 92.
  341. ^ Merz, Christopher J.; Pazzani, Michael J. (1999). "A principal components approach to combining regression estimates". Machine Learning. 36 (1–2): 9–32. doi:10.1023/a:1007507221352.
  342. ^ Torres-Sospedra, Joaquin, et al. "UJIIndoorLoc-Mag: A new database for magnetic field-based localization problems." Indoor Positioning and Indoor Navigation (IPIN), 2015 International Conference on. IEEE, 2015.
  343. ^ Berkvens, Rafael, Maarten Weyn, and Herbert Peremans. "Mean Mutual Information of Probabilistic Wi-Fi Localization." Indoor Positioning and Indoor Navigation (IPIN), 2015 International Conference on. Banff, Canada: IPIN. 2015.
  344. ^ Paschke, Fabian, et al. "Sensorlose Zustandsüberwachung an Synchronmotoren."Proceedings. 23. Workshop Computational Intelligence, Dortmund, 5.-6. Dezember 2013. KIT Scientific Publishing, 2013.
  345. ^ Lessmeier, Christian, et al. "Data Acquisition and Signal Analysis from Measured Motor Currents for Defect Detection in Electromechanical Drive Systems."
  346. ^ Ugulino, Wallace, et al. "Wearable computing: Accelerometers’ data classification of body postures and movements Archived 25 September 2020 at the Wayback Machine." Advances in Artificial Intelligence-SBIA 2012. Springer Berlin Heidelberg, 2012. 52–61.
  347. ^ Schneider, Jan; et al. (2015). "Augmenting the senses: a review on sensor-based learning support". Sensors. 15 (2): 4097–4133. Bibcode:2015Senso..15.4097S. doi:10.3390/s150204097. PMC 4367401. PMID 25679313.
  348. ^ Madeo, Renata CB, Clodoaldo AM Lima, and Sarajane M. Peres. "Gesture unit segmentation using support vector machines: segmenting gestures from rest positions." Proceedings of the 28th Annual ACM Symposium on Applied Computing. ACM, 2013.
  349. ^ Lun, Roanna; Zhao, Wenbing (2015). "A survey of applications and human motion recognition with Microsoft Kinect". International Journal of Pattern Recognition and Artificial Intelligence. 29 (5): 1555008. doi:10.1142/s0218001415550083.
  350. ^ Theodoridis, Theodoros, and Huosheng Hu. "Action classification of 3d human models using dynamic ANNs for mobile robot surveillance Archived 6 August 2019 at the Wayback Machine."Robotics and Biomimetics, 2007. ROBIO 2007. IEEE International Conference on. IEEE, 2007.
  351. ^ Etemad, Seyed Ali, and Ali Arya. "3D human action recognition and style transformation using resilient backpropagation neural networks." Intelligent Computing and Intelligent Systems, 2009. ICIS 2009. IEEE International Conference on. Vol. 4. IEEE, 2009.
  352. ^ Altun, Kerem; Barshan, Billur; Tunçel, Orkun (2010). "Comparative study on classifying human activities with miniature inertial and magnetic sensors". Pattern Recognition. 43 (10): 3605–3620. Bibcode:2010PatRe..43.3605A. doi:10.1016/j.patcog.2010.04.019. hdl:11693/11947.
  353. ^ Nathan, Ran; et al. (2012). "Using tri-axial acceleration data to identify behavioral modes of free-ranging animals: general concepts and tools illustrated for griffon vultures". The Journal of Experimental Biology. 215 (6): 986–996. doi:10.1242/jeb.058602. PMC 3284320. PMID 22357592.
  354. ^ Anguita, Davide, et al. "Human activity recognition on smartphones using a multiclass hardware-friendly support vector machine." Ambient assisted living and home care. Springer Berlin Heidelberg, 2012. 216–223.
  355. ^ Su, Xing; Tong, Hanghang; Ji, Ping (2014). "Activity recognition with smartphone sensors". Tsinghua Science and Technology. 19 (3): 235–249. doi:10.1109/tst.2014.6838194. S2CID 62751498.
  356. ^ Kadous, Mohammed Waleed. Temporal classification: Extending the classification paradigm to multivariate time series. Diss. The University of New South Wales, 2002.
  357. ^ Graves, Alex, et al. "Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks." Proceedings of the 23rd international conference on Machine learning. ACM, 2006.
  358. ^ Velloso, Eduardo, et al. "Qualitative activity recognition of weight lifting exercises."Proceedings of the 4th Augmented Human International Conference. ACM, 2013.
  359. ^ Mortazavi, Bobak Jack, et al. "Determining the single best axis for exercise repetition recognition and counting on smartwatches Archived 4 November 2021 at the Wayback Machine." Wearable and Implantable Body Sensor Networks (BSN), 2014 11th International Conference on. IEEE, 2014.
  360. ^ Sapsanis, Christos, et al. "Improving EMG based Classification of basic hand movements using EMD." Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE. IEEE, 2013.
  361. ^ a b Andrianesis, Konstantinos; Tzes, Anthony (2015). "Development and control of a multifunctional prosthetic hand with shape memory alloy actuators". Journal of Intelligent & Robotic Systems. 78 (2): 257–289. doi:10.1007/s10846-014-0061-6. S2CID 207174078.
  362. ^ Banos, Oresti; et al. (2014). "Dealing with the effects of sensor displacement in wearable activity recognition". Sensors. 14 (6): 9995–10023. Bibcode:2014Senso..14.9995B. doi:10.3390/s140609995. PMC 4118358. PMID 24915181.
  363. ^ Stisen, Allan, et al. "Smart Devices are Different: Assessing and MitigatingMobile Sensing Heterogeneities for Activity Recognition."Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems. ACM, 2015.
  364. ^ Bhattacharya, Sourav, and Nicholas D. Lane. "From Smart to Deep: Robust Activity Recognition on Smartwatches using Deep Learning."
  365. ^ Bacciu, Davide; et al. (2014). "An experimental characterization of reservoir computing in ambient assisted living applications". Neural Computing and Applications. 24 (6): 1451–1464. doi:10.1007/s00521-013-1364-4. hdl:11568/237959. S2CID 14124013.
  366. ^ Palumbo, Filippo; Barsocchi, Paolo; Gallicchio, Claudio; Chessa, Stefano; Micheli, Alessio (2013). "Multisensor Data Fusion for Activity Recognition Based on Reservoir Computing". Evaluating AAL Systems Through Competitive Benchmarking. Communications in Computer and Information Science. Vol. 386. pp. 24–35. doi:10.1007/978-3-642-41043-7_3. ISBN 978-3-642-41042-0.
  367. ^ Reiss, Attila, and Didier Stricker. "Introducing a new benchmarked dataset for activity monitoring."Wearable Computers (ISWC), 2012 16th International Symposium on. IEEE, 2012.
  368. ^ Roggen, Daniel, et al. "OPPORTUNITY: Towards opportunistic activity and context recognition systems." World of Wireless, Mobile and Multimedia Networks & Workshops, 2009. WoWMoM 2009. IEEE International Symposium on a. IEEE, 2009.
  369. ^ Kurz, Marc, et al. "Dynamic quantification of activity recognition capabilities in opportunistic systems." Vehicular Technology Conference (VTC Spring), 2011 IEEE 73rd. IEEE, 2011.
  370. ^ Sztyler, Timo, and Heiner Stuckenschmidt. "On-body localization of wearable devices: an investigation of position-aware activity recognition." Pervasive Computing and Communications (PerCom), 2016 IEEE International Conference on. IEEE, 2016.
  371. ^ Zhi, Ying Xuan; Lukasik, Michelle; Li, Michael H.; Dolatabadi, Elham; Wang, Rosalie H.; Taati, Babak (2018). "Automatic Detection of Compensation During Robotic Stroke Rehabilitation Therapy". IEEE Journal of Translational Engineering in Health and Medicine. 6: 2100107. doi:10.1109/JTEHM.2017.2780836. ISSN 2168-2372. PMC 5788403. PMID 29404226.
  372. ^ Dolatabadi, Elham; Zhi, Ying Xuan; Ye, Bing; Coahran, Marge; Lupinacci, Giorgia; Mihailidis, Alex; Wang, Rosalie; Taati, Babak (23 May 2017). The toronto rehab stroke pose dataset to detect compensation during stroke rehabilitation therapy. ACM. pp. 375–381. doi:10.1145/3154862.3154925. ISBN 9781450363631. S2CID 24581930.
  373. ^ "Toronto Rehab Stroke Pose Dataset".
  374. ^ Jung, Merel M.; Poel, Mannes; Poppe, Ronald; Heylen, Dirk K. J. (1 March 2017). "Automatic recognition of touch gestures in the corpus of social touch". Journal on Multimodal User Interfaces. 11 (1): 81–96. doi:10.1007/s12193-016-0232-9. ISSN 1783-8738. S2CID 1802116.
  375. ^ Jung, M.M. (Merel) (1 June 2016). "Corpus of Social Touch (CoST)". University of Twente. doi:10.4121/uuid:5ef62345-3b3e-479c-8e1d-c922748c9b29. {{cite journal}}: Cite journal requires |journal= (help)
  376. ^ Aeberhard, S., D. Coomans, and O. De Vel. "Comparison of classifiers in high dimensional settings." Dept. Math. Statist., James Cook Univ., North Queensland, Australia, Tech. Rep 92-02 (1992).
  377. ^ Basu, Sugato. "Semi-supervised clustering with limited background knowledge." AAAI. 2004.
  378. ^ Tüfekci, Pınar (2014). "Prediction of full load electrical power output of a base load operated combined cycle power plant using machine learning methods". International Journal of Electrical Power & Energy Systems. 60: 126–140. doi:10.1016/j.ijepes.2014.02.027.
  379. ^ Kaya, Heysem, Pınar Tüfekci, and Fikret S. Gürgen. "Local and global learning methods for predicting power of a combined gas & steam turbine." International conference on emerging trends in computer and electronics engineering (ICETCEE'2012), Dubai. 2012.
  380. ^ Baldi, Pierre; Sadowski, Peter; Whiteson, Daniel (2014). "Searching for exotic particles in high-energy physics with deep learning". Nature Communications. 5: 2014. arXiv:1402.4735. Bibcode:2014NatCo...5.4308B. doi:10.1038/ncomms5308. PMID 24986233. S2CID 195953.
  381. ^ a b Baldi, Pierre; Sadowski, Peter; Whiteson, Daniel (2015). "Enhanced Higgs Boson to τ+ τ− Search with Deep Learning". Physical Review Letters. 114 (11): 111801. arXiv:1410.3469. Bibcode:2015PhRvL.114k1801B. doi:10.1103/physrevlett.114.111801. PMID 25839260. S2CID 2339142.
  382. ^ a b Adam-Bourdarios, C.; Cowan, G.; Germain-Renaud, C.; Guyon, I.; Kégl, B.; Rousseau, D. (2015). "The Higgs Machine Learning Challenge". Journal of Physics: Conference Series. 664 (7): 072015. Bibcode:2015JPhCS.664g2015A. doi:10.1088/1742-6596/664/7/072015.
  383. ^ Baldi, Pierre; Cranmer, Kyle; Faucett, Taylor; Sadowski, Peter; Whiteson, Daniel (2016). "Parameterized neural networks for high-energy physics". The European Physical Journal C. 76 (5): 235. arXiv:1601.07913. Bibcode:2016EPJC...76..235B. doi:10.1140/epjc/s10052-016-4099-4. S2CID 254108545.
  384. ^ Ortigosa, I.; Lopez, R.; Garcia, J. "A neural networks approach to residuary resistance of sailing yachts prediction". Proceedings of the International Conference on Marine Engineering MARINE. 2007.
  385. ^ Gerritsma, J., R. Onnink, and A. Versluis.Geometry, resistance and stability of the delft systematic yacht hull series. Delft University of Technology, 1981.
  386. ^ Liu, Huan, and Hiroshi Motoda. Feature extraction, construction and selection: A data mining perspective. Springer Science & Business Media, 1998.
  387. ^ Reich, Yoram. Converging to Ideal Design Knowledge by Learning. [Carnegie Mellon University], Engineering Design Research Center, 1989.
  388. ^ Todorovski, Ljupčo; Džeroski, Sašo (1999). "Experiments in Meta-level Learning with ILP". Principles of Data Mining and Knowledge Discovery. Lecture Notes in Computer Science. Vol. 1704. pp. 98–106. doi:10.1007/978-3-540-48247-5_11. ISBN 978-3-540-66490-1. S2CID 39382993.
  389. ^ Wang, Yong. A new approach to fitting linear models in high dimensional spaces. Diss. The University of Waikato, 2000.
  390. ^ Kibler, Dennis; Aha, David W.; Albert, Marc K. (1989). "Instance‐based prediction of real‐valued attributes". Computational Intelligence. 5 (2): 51–57. doi:10.1111/j.1467-8640.1989.tb00315.x. S2CID 40800413.
  391. ^ Palmer, Christopher R., and Christos Faloutsos. "Electricity based external similarity of categorical attributes." Advances in Knowledge Discovery and Data Mining. Springer Berlin Heidelberg, 2003. 486–500.
  392. ^ Tsanas, Athanasios; Xifara, Angeliki (2012). "Accurate quantitative estimation of energy performance of residential buildings using statistical machine learning tools". Energy and Buildings. 49: 560–567. doi:10.1016/j.enbuild.2012.03.003.
  393. ^ De Wilde, Pieter (2014). "The gap between predicted and measured energy performance of buildings: A framework for investigation". Automation in Construction. 41: 40–49. doi:10.1016/j.autcon.2014.02.009.
  394. ^ Brooks, Thomas F., D. Stuart Pope, and Michael A. Marcolini. Airfoil self-noise and prediction. Vol. 1218. National Aeronautics and Space Administration, Office of Management, Scientific and Technical Information Division, 1989.
  395. ^ Draper, David. "Assessment and propagation of model uncertainty." Journal of the Royal Statistical Society, Series B (Methodological) (1995): 45–97.
  396. ^ Lavine, Michael (1991). "Problems in extrapolation illustrated with space shuttle O-ring data". Journal of the American Statistical Association. 86 (416): 919–921. doi:10.1080/01621459.1991.10475132.
  397. ^ Wang, Jun, Bei Yu, and Les Gasser. "Concept tree based clustering visualization with shaded similarity matrices." Data Mining, 2002. ICDM 2003. Proceedings. 2002 IEEE International Conference on. IEEE, 2002.
  398. ^ Pettengill, Gordon H.; Ford, Peter G.; Johnson, William T. K.; Raney, R. Keith; Soderblom, Laurence A. (1991). "Magellan: Radar Performance and Data Products". Science. 252 (5003): 260–265. Bibcode:1991Sci...252..260P. doi:10.1126/science.252.5003.260. PMID 17769272. S2CID 43398343.
  399. ^ a b Aharonian, F.; et al. (2008). "Energy spectrum of cosmic-ray electrons at TeV energies". Physical Review Letters. 101 (26): 261104. arXiv:0811.3894. Bibcode:2008PhRvL.101z1104A. doi:10.1103/PhysRevLett.101.261104. hdl:2440/51450. PMID 19437632. S2CID 41850528.
  400. ^ Bock, R. K.; et al. (2004). "Methods for multidimensional event classification: a case study using images from a Cherenkov gamma-ray telescope". Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment. 516 (2): 511–528. Bibcode:2004NIMPA.516..511B. doi:10.1016/j.nima.2003.08.157.
  401. ^ Li, Jinyan; et al. (2004). "Deeps: A new instance-based lazy discovery and classification system". Machine Learning. 54 (2): 99–124. doi:10.1023/b:mach.0000011804.08528.7d.
  402. ^ Villaescusa-Navarro, Francisco; al., et (2022). "The CAMELS Multifield Data Set: Learning the Universe's Fundamental Parameters with Artificial Intelligence". The Astrophysical Journal Supplement Series. 259 (2): 61. arXiv:2109.10915. Bibcode:2022ApJS..259...61V. doi:10.3847/1538-4365/ac5ab0. S2CID 237604997.
  403. ^ Siebert, Lee, and Tom Simkin. "Volcanoes of the world: an illustrated catalog of Holocene volcanoes and their eruptions." (2014).
  404. ^ Sikora, Marek; Wróbel, Łukasz (2010). "Application of rule induction algorithms for analysis of data collected by seismic hazard monitoring systems in coal mines". Archives of Mining Sciences. 55 (1): 91–114.
  405. ^ Sikora, Marek, and Beata Sikora. "Rough natural hazards monitoring." Rough Sets: Selected Methods and Applications in Management and Engineering. Springer London, 2012. 163–179.
  406. ^ Addor, Nans; Newman, Andrew J.; Mizukami, Naoki; Clark, Martyn P. (20 October 2017). "The CAMELS data set: catchment attributes and meteorology for large-sample studies". Hydrology and Earth System Sciences. 21 (10): 5293–5313. Bibcode:2017HESS...21.5293A. doi:10.5194/hess-21-5293-2017. ISSN 1607-7938.
  407. ^ Newman, A. J.; Clark, M. P.; Sampson, K.; Wood, A.; Hay, L. E.; Bock, A.; Viger, R. J.; Blodgett, D.; Brekke, L.; Arnold, J. R.; Hopson, T. (14 January 2015). "Development of a large-sample watershed-scale hydrometeorological data set for the contiguous USA: data set characteristics and assessment of regional variability in hydrologic model performance". Hydrology and Earth System Sciences. 19 (1): 209–223. Bibcode:2015HESS...19..209N. doi:10.5194/hess-19-209-2015. ISSN 1607-7938.
  408. ^ Alvarez-Garreton, Camila; Mendoza, Pablo A.; Boisier, Juan Pablo; Addor, Nans; Galleguillos, Mauricio; Zambrano-Bigiarini, Mauricio; Lara, Antonio; Puelma, Cristóbal; Cortes, Gonzalo; Garreaud, Rene; McPhee, James (13 November 2018). "The CAMELS-CL dataset: catchment attributes and meteorology for large sample studies – Chile dataset". Hydrology and Earth System Sciences. 22 (11): 5817–5846. Bibcode:2018HESS...22.5817A. doi:10.5194/hess-22-5817-2018. ISSN 1607-7938. S2CID 133955609.
  409. ^ Chagas, Vinícius B. P.; Chaffe, Pedro L. B.; Addor, Nans; Fan, Fernando M.; Fleischmann, Ayan S.; Paiva, Rodrigo C. D.; Siqueira, Vinícius A. (8 September 2020). "CAMELS-BR: hydrometeorological time series and landscape attributes for 897 catchments in Brazil". Earth System Science Data. 12 (3): 2075–2096. Bibcode:2020ESSD...12.2075C. doi:10.5194/essd-12-2075-2020. ISSN 1866-3516. S2CID 234737197.
  410. ^ Coxon, Gemma; Addor, Nans; Bloomfield, John P.; Freer, Jim; Fry, Matt; Hannaford, Jamie; Howden, Nicholas J. K.; Lane, Rosanna; Lewis, Melinda; Robinson, Emma L.; Wagener, Thorsten (12 October 2020). "CAMELS-GB: hydrometeorological time series and landscape attributes for 671 catchments in Great Britain". Earth System Science Data. 12 (4): 2459–2483. Bibcode:2020ESSD...12.2459C. doi:10.5194/essd-12-2459-2020. ISSN 1866-3516. S2CID 226192657.
  411. ^ Fowler, Keirnan J. A.; Acharya, Suwash Chandra; Addor, Nans; Chou, Chihchung; Peel, Murray C. (6 August 2021). "CAMELS-AUS: hydrometeorological time series and landscape attributes for 222 catchments in Australia". Earth System Science Data. 13 (8): 3847–3867. Bibcode:2021ESSD...13.3847F. doi:10.5194/essd-13-3847-2021. ISSN 1866-3516. S2CID 238796784.
  412. ^ Klingler, Christoph; Schulz, Karsten; Herrnegger, Mathew (16 September 2021). "LamaH-CE: LArge-SaMple DAta for Hydrology and Environmental Sciences for Central Europe". Earth System Science Data. 13 (9): 4529–4565. Bibcode:2021ESSD...13.4529K. doi:10.5194/essd-13-4529-2021. ISSN 1866-3516. S2CID 240533508.
  413. ^ Yeh, I–C (1998). "Modeling of strength of high-performance concrete using artificial neural networks". Cement and Concrete Research. 28 (12): 1797–1808. doi:10.1016/s0008-8846(98)00165-3.
  414. ^ Zarandi, MH Fazel; et al. (2008). "Fuzzy polynomial neural networks for approximation of the compressive strength of concrete". Applied Soft Computing. 8 (1): 488–498. Bibcode:2008ApSoC...8...79S. doi:10.1016/j.asoc.2007.02.010.
  415. ^ Yeh, I. "Modeling slump of concrete with fly ash and superplasticizer." Computers and Concrete5.6 (2008): 559–572.
  416. ^ Gencel, Osman; et al. (2011). "Comparison of artificial neural networks and general linear model approaches for the analysis of abrasive wear of concrete". Construction and Building Materials. 25 (8): 3486–3494. doi:10.1016/j.conbuildmat.2011.03.040.
  417. ^ Dietterich, Thomas G., et al. "A comparison of dynamic reposing and tangent distance for drug activity prediction." Advances in Neural Information Processing Systems (1994): 216–216.
  418. ^ Buscema, Massimo, William J. Tastle, and Stefano Terzi. "Meta net: A new meta-classifier family."Data Mining Applications Using Artificial Adaptive Systems. Springer New York, 2013. 141–182.
  419. ^ Amoradnejad, Issa; Amoradnejad, Rahimberdi; et al. (2022). "Age dataset: A structured general-purpose dataset on life, work, and death of 1.22 million distinguished people". Workshop Proceedings of the 16th International AAAI Conference on Web and Social Media (ICWSM). 3: 1–4. doi:10.36190/2022.82. S2CID 249668669.
  420. ^ "Age Dataset". GitHub. 7 June 2022.
  421. ^ "Synthetic Fundus Dataset". Archived from the original on 29 November 2021. Retrieved 22 February 2023.
  422. ^ Lo Castro, Dario; et al. (2020). "A visual framework to create photorealistic retinal vessels for diagnosis purposes". Journal of Biomedical Informatics. 108: 103490. doi:10.1016/j.jbi.2020.103490. PMID 32640292. S2CID 220429697.
  423. ^ Ingber, Lester (1997). "Statistical mechanics of neocortical interactions: Canonical momenta indicatorsof electroencephalography". Physical Review E. 55 (4): 4578–4593. arXiv:physics/0001052. Bibcode:1997PhRvE..55.4578I. doi:10.1103/PhysRevE.55.4578. S2CID 6390999.
  424. ^ Hoffmann, Ulrich; Vesin, Jean-Marc; Ebrahimi, Touradj; Diserens, Karin (2008). "An efficient P300-based brain–computer interface for disabled subjects". Journal of Neuroscience Methods. 167 (1): 115–125. CiteSeerX doi:10.1016/j.jneumeth.2007.03.005. PMID 17445904. S2CID 9648828.
  425. ^ Donchin, Emanuel; Spencer, Kevin M.; Wijesinghe, Ranjith (2000). "The mental prosthesis: assessing the speed of a P300-based brain-computer interface". IEEE Transactions on Rehabilitation Engineering. 8 (2): 174–179. doi:10.1109/86.847808. PMID 10896179.
  426. ^ Detrano, Robert; et al. (1989). "International application of a new probability algorithm for the diagnosis of coronary artery disease". The American Journal of Cardiology. 64 (5): 304–310. doi:10.1016/0002-9149(89)90524-9. PMID 2756873.
  427. ^ Bradley, Andrew P (1997). "The use of the area under the ROC curve in the evaluation of machine learning algorithms" (PDF). Pattern Recognition. 30 (7): 1145–1159. Bibcode:1997PatRe..30.1145B. doi:10.1016/s0031-3203(96)00142-2. S2CID 13806304.
  428. ^ Street, W. N.; Wolberg, W. H.; Mangasarian, O. L. (1993). "Nuclear feature extraction for breast tumor diagnosis". In Acharya, Raj S; Goldgof, Dmitry B (eds.). Biomedical Image Processing and Biomedical Visualization. Vol. 1905. pp. 861–870. doi:10.1117/12.148698. S2CID 14922543.
  429. ^ Demir, Cigdem, and Bülent Yener. "Automated cancer diagnosis based on histopathological images: a systematic survey." Rensselaer Polytechnic Institute, Tech. Rep (2005).
  430. ^ Abuse, Substance. "Mental Health Services Administration, Results from the 2010 National Survey on Drug Use and Health: Summary of National Findings, NSDUH Series H-41, HHS Publication No.(SMA) 11-4658." Rockville, MD: Substance Abuse and Mental Health Services Administration 201 (2011).
  431. ^ Hong, Zi-Quan; Yang, Jing-Yu (1991). "Optimal discriminant plane for a small number of samples and design method of classifier on the plane". Pattern Recognition. 24 (4): 317–324. Bibcode:1991PatRe..24..317H. doi:10.1016/0031-3203(91)90074-f.
  432. ^ a b Li, Jinyan, and Limsoon Wong. "Using rules to analyse bio-medical data: a comparison between C4. 5 and PCL." Advances in Web-Age Information Management. Springer Berlin Heidelberg, 2003. 254–265.
  433. ^ Güvenir, H. Altay, et al. "A supervised machine learning algorithm for arrhythmia analysis."Computers in Cardiology 1997. IEEE, 1997.
  434. ^ Lagus, Krista, et al. "Independent variable group analysis in learning compact representations for data." Proceedings of the International and Interdisciplinary Conference on Adaptive Knowledge Representation and Reasoning (AKRR'05), T. Honkela, V. Könönen, M. Pöllä, and O. Simula, Eds., Espoo, Finland. 2005.
  435. ^ Strack, Beata, et al. "Impact of HbA1c measurement on hospital readmission rates: analysis of 70,000 clinical database patient records." BioMed Research International 2014; 2014
  436. ^ Rubin, Daniel J (2015). "Hospital readmission of patients with diabetes". Current Diabetes Reports. 15 (4): 1–9. doi:10.1007/s11892-015-0584-7. PMID 25712258. S2CID 3908599.
  437. ^ Antal, Bálint; Hajdu, András (2014). "An ensemble-based system for automatic screening of diabetic retinopathy". Knowledge-Based Systems. 60 (2014): 20–27. arXiv:1410.8576. Bibcode:2014arXiv1410.8576A. doi:10.1016/j.knosys.2013.12.023. S2CID 13984326.
  438. ^ Haloi, Mrinal (2015). "Improved Microaneurysm Detection using Deep Neural Networks". arXiv:1505.04424 [cs.CV].
  439. ^ ELIE, Guillaume PATRY, Gervais GAUTHIER, Bruno LAY, Julien ROGER, Damien. "ADCIS Download Third Party: Messidor Database". Retrieved 25 February 2018.
  440. ^ Decencière, Etienne; Zhang, Xiwei; Cazuguel, Guy; Lay, Bruno; Cochener, Béatrice; Trone, Caroline; Gain, Philippe; Ordonez, Richard; Massin, Pascale (26 August 2014). "Feedback on a Publicly Distributed Image Database: The Messidor Database". Image Analysis & Stereology. 33 (3): 231–234. doi:10.5566/ias.1155. ISSN 1854-5165.
  441. ^ Bagirov, A. M.; et al. (2003). "Unsupervised and supervised data classification via nonsmooth and global optimization". Top. 11 (1): 1–75. CiteSeerX doi:10.1007/bf02578945. S2CID 14165678.
  442. ^ Fung, Glenn, et al. "A fast iterative algorithm for fisher discriminant using heterogeneous kernels."Proceedings of the twenty-first international conference on Machine learning. ACM, 2004.
  443. ^ Quinlan, John Ross, et al. "Inductive knowledge acquisition: a case study." Proceedings of the Second Australian Conference on Applications of expert systems. Addison-Wesley Longman Publishing Co., Inc., 1987.
  444. ^ a b Zhou, Zhi-Hua; Jiang, Yuan (2004). "NeC4. 5: neural ensemble based C4. 5". IEEE Transactions on Knowledge and Data Engineering. 16 (6): 770–773. CiteSeerX doi:10.1109/tkde.2004.11. S2CID 1024861.
  445. ^ Er, Orhan; et al. (2012). "An approach based on probabilistic neural network for diagnosis of Mesothelioma's disease". Computers & Electrical Engineering. 38 (1): 75–81. doi:10.1016/j.compeleceng.2011.09.001.
  446. ^ Er, Orhan, A. Çetin Tanrikulu, and Abdurrahman Abakay. "Use of artificial intelligence techniques for diagnosis of malignant pleural mesothelioma."Dicle Tıp Dergisi 42.1 (2015).
  447. ^ Li, Michael H.; Mestre, Tiago A.; Fox, Susan H.; Taati, Babak (25 July 2017). "Vision-Based Assessment of Parkinsonism and Levodopa-Induced Dyskinesia with Deep Learning Pose Estimation". Journal of Neuroengineering and Rehabilitation. 15 (1): 97. arXiv:1707.09416. Bibcode:2017arXiv170709416L. doi:10.1186/s12984-018-0446-z. PMC 6219082. PMID 30400914.
  448. ^ Li, Michael H.; Mestre, Tiago A.; Fox, Susan H.; Taati, Babak (May 2018). "Automated assessment of levodopa-induced dyskinesia: Evaluating the responsiveness of video-based features". Parkinsonism & Related Disorders. 53: 42–45. doi:10.1016/j.parkreldis.2018.04.036. ISSN 1353-8020. PMID 29748112. S2CID 13666294.
  449. ^ "Parkinson's Vision-Based Pose Estimation Dataset | Kaggle". Retrieved 22 August 2018.
  450. ^ Shannon, Paul; et al. (2003). "Cytoscape: a software environment for integrated models of biomolecular interaction networks". Genome Research. 13 (11): 2498–2504. doi:10.1101/gr.1239303. PMC 403769. PMID 14597658.
  451. ^ Javadi, Soroush; Mirroshandel, Seyed Abolghasem (2019). "A novel deep learning method for automatic assessment of human sperm images". Computers in Biology and Medicine. 109: 182–194. doi:10.1016/j.compbiomed.2019.04.030. ISSN 0010-4825. PMID 31059902. S2CID 146809768.
  452. ^ "soroushj/mhsma-dataset: MHSMA: The Modified Human Sperm Morphology Analysis Dataset". Retrieved 3 May 2019.
  453. ^ Clark, David, Zoltan Schreter, and Anthony Adams. "A quantitative comparison of dystal and backpropagation." Proceedings of 1996 Australian Conference on Neural Networks. 1996.
  454. ^ Jiang, Yuan, and Zhi-Hua Zhou. "Editing training data for kNN classifiers with neural network ensemble." Advances in Neural Networks–ISNN 2004. Springer Berlin Heidelberg, 2004. 356–361.
  455. ^ Ontañón, Santiago, and Enric Plaza. "On similarity measures based on a refinement lattice." Case-Based Reasoning Research and Development. Springer Berlin Heidelberg, 2009. 240–255.
  456. ^ "PLF data inventory". GitHub. 5 November 2021.
  457. ^ Higuera, Clara; Gardiner, Katheleen J.; Cios, Krzysztof J. (2015). "Self-organizing feature maps identify proteins critical to learning in a mouse model of down syndrome". PLOS ONE. 10 (6): e0129126. Bibcode:2015PLoSO..1029126H. doi:10.1371/journal.pone.0129126. PMC 4482027. PMID 26111164.
  458. ^ Ahmed, Md Mahiuddin; et al. (2015). "Protein dynamics associated with failed and rescued learning in the Ts65Dn mouse model of Down syndrome". PLOS ONE. 10 (3): e0119491. Bibcode:2015PLoSO..1019491A. doi:10.1371/journal.pone.0119491. PMC 4368539. PMID 25793384.
  459. ^ Langley, PAT (2014). "Trading off simplicity and coverage in incremental concept learning" (PDF). Machine Learning Proceedings. 1988: 73. Archived from the original (PDF) on 6 August 2019. Retrieved 6 August 2019.
  460. ^ "Mushroom Data Set 2020". Retrieved 6 April 2021.
  461. ^ Wagner, Dennis; Heider, Dominik; Hattab, Georges (14 April 2021). "Mushroom data creation, curation, and simulation to support classification tasks". Scientific Reports. 11 (1): 8134. Bibcode:2021NatSR..11.8134W. doi:10.1038/s41598-021-87602-3. ISSN 2045-2322. PMC 8046754. PMID 33854157.
  462. ^ Cortez, Paulo, and Aníbal de Jesus Raimundo Morais. "A data mining approach to predict forest fires using meteorological data." (2007).
  463. ^ Farquad, M. A. H.; Ravi, V.; Raju, S. Bapi (2010). "Support vector regression based hybrid rule extraction methods for forecasting". Expert Systems with Applications. 37 (8): 5577–5589. doi:10.1016/j.eswa.2010.02.055.
  464. ^ Fisher, Ronald A (1936). "The use of multiple measurements in taxonomic problems". Annals of Eugenics. 7 (2): 179–188. doi:10.1111/j.1469-1809.1936.tb02137.x. hdl:2440/15227.
  465. ^ Ghahramani, Zoubin, and Michael I. Jordan. "Supervised learning from incomplete data via an EM approach." Advances in neural information processing systems 6. 1994.
  466. ^ Mallah, Charles; Cope, James; Orwell, James (2013). "Plant leaf classification using probabilistic integration of shape, texture and margin features". Signal Processing, Pattern Recognition and Applications. 5: 1.
  467. ^ Yahiaoui, Itheri, Olfa Mzoughi, and Nozha Boujemaa. "Leaf shape descriptor for tree species identification Archived 6 August 2019 at the Wayback Machine." Multimedia and Expo (ICME), 2012 IEEE International Conference on. IEEE, 2012.
  468. ^ Tan, Ming, and Larry Eshelman. "Using weighted networks to represent classification knowledge in noisy domains." Proceedings of the Fifth International Conference on Machine Learning. 2014.
  469. ^ Charytanowicz, Małgorzata, et al. "Complete gradient clustering algorithm for features analysis of x-ray images." Information technologies in biomedicine. Springer Berlin Heidelberg, 2010. 15–24.
  470. ^ Sanchez, Mauricio A.; et al. (2014). "Fuzzy granular gravitational clustering algorithm for multivariate data". Information Sciences. 279: 498–511. doi:10.1016/j.ins.2014.04.005.
  471. ^ Blackard, Jock A.; Dean, Denis J. (1999). "Comparative accuracies of artificial neural networks and discriminant analysis in predicting forest cover types from cartographic variables". Computers and Electronics in Agriculture. 24 (3): 131–151. CiteSeerX doi:10.1016/s0168-1699(99)00046-0. S2CID 13985407.
  472. ^ Fürnkranz, Johannes. "Round robin rule learning."Proceedings of the 18th International Conference on Machine Learning (ICML-01): 146—153. 2001.
  473. ^ Li, Song; Assmann, Sarah M.; Albert, Réka (2006). "Predicting essential components of signal transduction networks: a dynamic model of guard cell abscisic acid signaling". PLOS Biol. 4 (10): e312. arXiv:q-bio/0610012. doi:10.1371/journal.pbio.0040312. PMC 1564158. PMID 16968132.
  474. ^ Munisami, Trishen; et al. (2015). "Plant Leaf Recognition Using Shape Features and Colour Histogram with K-nearest Neighbour Classifiers". Procedia Computer Science. 58: 740–747. doi:10.1016/j.procs.2015.08.095.
  475. ^ Li, Bai (2016). "Atomic potential matching: An evolutionary target recognition approach based on edge features". Optik. 127 (5): 3162–3168. Bibcode:2016Optik.127.3162L. doi:10.1016/j.ijleo.2015.11.186.
  476. ^ Nilsback, Maria-Elena, and Andrew Zisserman. "A visual vocabulary for flower classification."Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on. Vol. 2. IEEE, 2006.
  477. ^ Giselsson, Thomas M.; et al. (2017). "A Public Image Database for Benchmark of Plant Seedling Classification Algorithms". arXiv:1711.05458 [cs.CV].
  478. ^ Muresan, Horea; Oltean, Mihai (2018). "Fruit recognition from images using deep learning". Acta Univ. Sapientiae, Informatica. 10 (1): 26–42. doi:10.2478/ausi-2018-0002.
  479. ^ Oltean, Mihai; Muresan, Horea (2017). "A dataset with fruit images on Kaggle".
  480. ^ Nakai, Kenta; Kanehisa, Minoru (1991). "Expert system for predicting protein localization sites in gram‐negative bacteria". Proteins: Structure, Function, and Bioinformatics. 11 (2): 95–110. doi:10.1002/prot.340110203. PMID 1946347. S2CID 27606447.
  481. ^ Ling, Charles X., et al. "Decision trees with minimal costs." Proceedings of the twenty-first international conference on Machine learning. ACM, 2004.
  482. ^ Mahé, Pierre, et al. "Automatic identification of mixed bacterial species fingerprints in a MALDI-TOF mass-spectrum." Bioinformatics (2014): btu022.
  483. ^ Barbano, Duane; et al. (2015). "Rapid characterization of microalgae and microalgae mixtures using matrix-assisted laser desorption ionization time-of-flight mass spectrometry (MALDI-TOF MS)". PLOS ONE. 10 (8): e0135337. Bibcode:2015PLoSO..1035337B. doi:10.1371/journal.pone.0135337. PMC 4536233. PMID 26271045.
  484. ^ Horton, Paul; Nakai, Kenta (1996). "A probabilistic classification system for predicting the cellular localization sites of proteins" (PDF). ISMB-96 Proceedings. 4: 109–15. PMID 8877510.
  485. ^ Allwein, Erin L.; Schapire, Robert E.; Singer, Yoram (2001). "Reducing multiclass to binary: A unifying approach for margin classifiers" (PDF). The Journal of Machine Learning Research. 1: 113–141.
  486. ^ Mayr, Andreas; Klambauer, Guenter; Unterthiner, Thomas; Hochreiter, Sepp (2016). "DeepTox: Toxicity Prediction Using Deep Learning". Frontiers in Environmental Science. 3: 80. doi:10.3389/fenvs.2015.00080.
  487. ^ Lavin, Alexander; Ahmad, Subutai (12 October 2015). Evaluating Real-time Anomaly Detection Algorithms – the Numenta Anomaly Benchmark. p. 38. arXiv:1510.03336. doi:10.1109/ICMLA.2015.141. ISBN 978-1-5090-0287-0. S2CID 6842305.
  488. ^ Iurii D. Katser; Vyacheslav O. Kozitsin. "SKAB GitHub repository". GitHub. Retrieved 12 January 2021.
  489. ^ Iurii D. Katser; Vyacheslav O. Kozitsin (2020). "Skoltech Anomaly Benchmark (SKAB)". Kaggle. doi:10.34740/KAGGLE/DSV/1693952. Retrieved 12 January 2021. {{cite journal}}: Cite journal requires |journal= (help)
  490. ^ Campos, Guilherme O.; Zimek, Arthur; Sander, Jörg; Campello, Ricardo J. G. B.; Micenková, Barbora; Schubert, Erich; Assent, Ira; Houle, Michael E. (2016). "On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study". Data Mining and Knowledge Discovery. 30 (4): 891. doi:10.1007/s10618-015-0444-8. ISSN 1384-5810. S2CID 1952214.
  491. ^ Ann-Kathrin Hartmann, Tommaso Soru, Edgard Marx. Generating a Large Dataset for Neural Question Answering over the DBpedia Knowledge Base. 2018.
  492. ^ Tommaso Soru, Edgard Marx. Diego Moussallem, Andre Valdestilhas, Diego Esteves, Ciro Baron. SPARQL as a Foreign Language. 2018.
  493. ^ Kiet Van Nguyen, Duc-Vu Nguyen, Anh Gia-Tuan Nguyen, Ngan Luu-Thuy Nguyen. A Vietnamese Dataset for Evaluating Machine Reading Comprehension. COLING 2020.
  494. ^ Kiet Van Nguyen, Khiem Vinh Tran, Son T. Luu, Anh Gia-Tuan Nguyen, Ngan Luu-Thuy Nguyen. Enhancing Lexical-Based Approach With External Knowledge for Vietnamese Multiple-Choice Machine Reading Comprehension. IEEE Access. 2020.
  495. ^ Anantha, Raviteja; Vakulenko, Svitlana; Tu, Zhucheng; Longpre, Shayne; Pulman, Stephen; Chappidi, Srinivas (2020). "Open-Domain Question Answering Goes Conversational via Question Rewriting". arXiv:2010.04898 [cs.IR].
  496. ^ Khashabi, Daniel; Min, Sewon; Khot, Tushar; Sabharwal, Ashish; Tafjord, Oyvind; Clark, Peter; Hajishirzi, Hannaneh (November 2020). "UNIFIEDQA: Crossing Format Boundaries with a Single QA System". Findings of the Association for Computational Linguistics: EMNLP 2020. Online: Association for Computational Linguistics: 1896–1907. arXiv:2005.00700. doi:10.18653/v1/2020.findings-emnlp.171. S2CID 218487109.
  497. ^ Taskmaster, Google Research Datasets, 17 December 2022, retrieved 7 January 2023
  498. ^ Byrne, Bill; Krishnamoorthi, Karthik; Sankar, Chinnadhurai; Neelakantan, Arvind; Duckworth, Daniel; Yavuz, Semih; Goodrich, Ben; Dubey, Amit; Cedilnik, Andy; Kim, Kyu-Young (1 September 2019). "Taskmaster-1: Toward a Realistic and Diverse Dialog Dataset". arXiv:1909.05358 [cs.CL].
  499. ^ Yasunaga, Michihiro; Liang, Percy (21 November 2020). "Graph-based, Self-Supervised Program Repair from Diagnostic Feedback". International Conference on Machine Learning. PMLR: 10799–10808. arXiv:2005.10636.
  500. ^ Wang, Yizhong; Mishra, Swaroop; Alipoormolabashi, Pegah; Kordi, Yeganeh; Mirzaei, Amirreza; Arunkumar, Anjana; Ashok, Arjun; Dhanasekaran, Arut Selvan; Naik, Atharva; Stap, David; Pathak, Eshaan; Karamanolakis, Giannis; Lai, Haizhi Gary; Purohit, Ishan; Mondal, Ishani (24 October 2022). "Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks". arXiv:2204.07705 [cs.CL].
  501. ^ Paperno, Denis; Kruszewski, Germán; Lazaridou, Angeliki; Pham, Quan Ngoc; Bernardi, Raffaella; Pezzelle, Sandro; Baroni, Marco; Boleda, Gemma; Fernández, Raquel (7 August 2016), The LAMBADA dataset, doi:10.5281/zenodo.2630551, retrieved 7 January 2023
  502. ^ Paperno, Denis; Kruszewski, Germán; Lazaridou, Angeliki; Pham, Ngoc Quan; Bernardi, Raffaella; Pezzelle, Sandro; Baroni, Marco; Boleda, Gemma; Fernández, Raquel (August 2016). "The LAMBADA dataset: Word prediction requiring a broad discourse context". Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Berlin, Germany: Association for Computational Linguistics: 1525–1534. doi:10.18653/v1/P16-1144. hdl:10230/32702. S2CID 2381275.
  503. ^ Wei, Jason; Bosma, Maarten; Zhao, Vincent; Guu, Kelvin; Yu, Adams Wei; Lester, Brian; Du, Nan; Dai, Andrew M.; Le, Quoc V. (10 February 2022). "Finetuned Language Models are Zero-Shot Learners". arXiv:2109.01652. {{cite journal}}: Cite journal requires |journal= (help)
  504. ^ "Working with ATT&CK | MITRE ATT&CK®". Retrieved 14 January 2023.
  505. ^ "CAPEC - Common Attack Pattern Enumeration and Classification (CAPEC™)". Retrieved 14 January 2023.
  506. ^ "CVE - Home". Retrieved 14 January 2023.
  507. ^ "CWE - Common Weakness Enumeration". Retrieved 14 January 2023.
  508. ^ Lim, Swee Kiat; Muis, Aldrian Obaja; Lu, Wei; Ong, Chen Hui (July 2017). "MalwareTextDB: A Database for Annotated Malware Articles". Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Vancouver, Canada: Association for Computational Linguistics: 1557–1567. doi:10.18653/v1/P17-1143. S2CID 7816596.
  509. ^ "USENIX". USENIX. Retrieved 19 January 2023.
  510. ^ "APTnotes | Read the Docs". Retrieved 19 January 2023.
  511. ^ " e-Print archive". Retrieved 19 January 2023.
  512. ^ "Cryptography and Security authors/titles recent submissions". Retrieved 19 January 2023.
  513. ^ "Holistic Info-Sec for Web Developers - Fascicle 0". Retrieved 20 January 2023.
  514. ^ "Holistic Info-Sec for Web Developers - Fascicle 1". Retrieved 20 January 2023.
  515. ^ Vincent, Adam. "Web Services Web Services Hacking and Hardening" (PDF).{{cite web}}: CS1 maint: url-status (link)
  516. ^ McCray, Joe. "Advanced SQL Injection" (PDF).{{cite web}}: CS1 maint: url-status (link)
  517. ^ Shah, Shreeraj. "Blind SQL injection discovery & exploitation technique" (PDF).
  518. ^ Palcer, C. C. "Ethical hacking" (PDF). textfiles.{{cite web}}: CS1 maint: url-status (link)
  519. ^ "Hacking Secrets Revealed - Information and Instructional Guide" (PDF).
  520. ^ Park, Alexis. "Hack any website" (PDF).
  521. ^ Cerrudo, Cesar; Martinez Fayo, Esteban. "Hacking Databases for Owning your Data" (PDF). blackhat.
  522. ^ O'Connor, Tj. "Violent Python-A Cookbook for Hackers, Forensic Analysts, Penetration Testers and Security Engineers" (PDF). Github.{{cite web}}: CS1 maint: url-status (link)
  523. ^ Grand, Joe. "Hardware Reverse Engineering: Access, Analyze, & Defeat" (PDF). blackhat.{{cite web}}: CS1 maint: url-status (link)
  524. ^ Chang, Jason V. "Computer Hacking: Making the Case for National Reporting Requirement" (PDF).{{cite web}}: CS1 maint: url-status (link)
  525. ^ "National Cybersecurity Strategies Repository". ITU. Retrieved 20 January 2023.
  526. ^ Chen, Yanlin (31 August 2022), Cyber Security Natural Language Processing, retrieved 20 January 2023
  527. ^ "". Twitter. Retrieved 20 January 2023. {{cite web}}: External link in |title= (help)
  528. ^ Zampieri, Marcos; Malmasi, Shervin; Nakov, Preslav; Rosenthal, Sara; Farra, Noura; Kumar, Ritesh (16 April 2019). "Predicting the Type and Target of Offensive Posts in Social Media". arXiv:1902.09666 [cs.CL].
  529. ^ "Threat reports". Retrieved 20 January 2023.
  530. ^ "Category: APT reports | Securelist". Retrieved 23 January 2023.
  531. ^ "Your Cybersecurity News Connection - Cyber News | CyberWire". The CyberWire. Retrieved 23 January 2023.
  532. ^ "News". Retrieved 23 January 2023.
  533. ^ "Cybernews". Cybernews.{{cite web}}: CS1 maint: url-status (link)
  534. ^ "HIPAA Journal". HIPAA Journal. Retrieved 23 January 2023.
  535. ^ "BleepingComputer". BleepingComputer. Retrieved 23 January 2023.
  536. ^ "Homepage". The Record from Recorded Future News. Retrieved 23 January 2023.
  537. ^ "HackRead | Latest Cyber Crime - InfoSec- Tech - Hacking News". 8 January 2022. Retrieved 23 January 2023.
  538. ^ "Securelist | Kaspersky's threat research and reports". Retrieved 31 January 2023.
  539. ^ Harshaw, Christopher R.; Bridges, Robert A.; Iannacone, Michael D.; Reed, Joel W.; Goodall, John R. (5 April 2016). "GraphPrints: Towards a Graph Analytic Method for Network Anomaly Detection". Proceedings of the 11th Annual Cyber and Information Security Research Conference. CISRC '16. New York, NY, USA: Association for Computing Machinery: 1–4. doi:10.1145/2897795.2897806. ISBN 978-1-4503-3752-6.
  540. ^ "Farsight Security, cyber security intelligence solutions". Farsight Security. Retrieved 13 February 2023.
  541. ^ "Schneier on Security". Retrieved 13 February 2023.
  542. ^ "#1 in Cloud Security & Endpoint Cybersecurity". Trend Micro. Retrieved 13 February 2023.
  543. ^ "The Hacker News | #1 Trusted Cybersecurity News Site". The Hacker News. Retrieved 13 February 2023.
  544. ^ "Krebs on Security – In-depth security news and investigation". Retrieved 25 February 2023.
  545. ^ "MITRE D3FEND Knowledge Graph". Retrieved 31 March 2023.
  546. ^ "MITRE | ATLAS™". Retrieved 31 March 2023.
  547. ^ "MITRE Engage™ | An Adversary Engagement Framework from MITRE". Retrieved 1 April 2023.
  548. ^ "Hacking Tutorials - The best Step-by-Step Hacking Tutorials". Hacking Tutorials. Retrieved 1 April 2023.
  549. ^ "TCFD Knowledge Hub". TCFD Knowledge Hub. Retrieved 3 February 2023.
  550. ^ "". Retrieved 3 February 2023.
  551. ^ "About — IPCC". Retrieved 20 February 2023.
  552. ^ "Alliance for Research on Corporate Sustainability | ARCS serves as a vehicle for advancing rigorous academic research on corporate sustainability issues". Retrieved 2 March 2023.
  553. ^ Mehra, Srishti; Louka, Robert; Zhang, Yixun (26 March 2022). "ESGBERT: Language Model to Help with Classification Tasks Related to Companies Environmental, Social, and Governance Practices". Embedded Systems and Applications: 183–190. arXiv:2203.16788. doi:10.5121/csit.2022.120616. ISBN 9781925953657. S2CID 247825524.
  554. ^  This article incorporates text available under the CC BY 4.0 license.
  555. ^ Diggelmann, Thomas; Boyd-Graber, Jordan; Bulian, Jannis; Ciaramita, Massimiliano; Leippold, Markus (2 January 2021). "CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims". arXiv:2012.00614 [cs.CL].
  556. ^ "climate-news-db". Retrieved 3 February 2023.
  557. ^ "Climatext". Retrieved 19 February 2023.
  558. ^ "Greenbiz". Retrieved 2 March 2023.
  559. ^ "Explore the @Reuters Hot List of 1,000 top climate scientists". Reuters. Retrieved 22 March 2023.
  560. ^ "Blogs | Alliance for Research on Corporate Sustainability". Retrieved 27 March 2023.
  561. ^ "Greenbiz". Retrieved 29 March 2023.
  562. ^ "CSR News". Retrieved 29 March 2023.
  563. ^ "CDP Homepage". Retrieved 29 March 2023.
  564. ^ "Hybrid cloud blog". Retrieved 9 April 2023.
  565. ^ "Production-Grade Container Orchestration". Kubernetes. Retrieved 9 April 2023.
  566. ^ "Home | Official Red Hat OpenShift Documentation". Retrieved 9 April 2023.
  567. ^ "Cloud Native Computing Foundation". Cloud Native Computing Foundation. Retrieved 9 April 2023.
  568. ^ CNCF Community Presentations, Cloud Native Computing Foundation (CNCF), 11 April 2023, retrieved 11 April 2023
  569. ^ "Red Hat - We make open source technologies for the enterprise". Retrieved 1 May 2023.
  570. ^ Brown, Michael Scott, Michael J. Pelosi, and Henry Dirska. "Dynamic-radius species-conserving genetic algorithm for the financial forecasting of Dow Jones index stocks[dead link]." Machine Learning and Data Mining in Pattern Recognition. Springer Berlin Heidelberg, 2013. 27–41.
  571. ^ Shen, Kao-Yi; Tzeng, Gwo-Hshiung (2015). "Fuzzy Inference-Enhanced VC-DRSA Model for Technical Analysis: Investment Decision Aid". International Journal of Fuzzy Systems. 17 (3): 375–389. doi:10.1007/s40815-015-0058-8. S2CID 68241024.
  572. ^ Quinlan, J. Ross (1987). "Simplifying decision trees". International Journal of Man-machine Studies. 27 (3): 221–234. CiteSeerX doi:10.1016/s0020-7373(87)80053-6.
  573. ^ Hamers, Bart; Suykens, Johan AK; De Moor, Bart (2003). "Coupled transductive ensemble learning of kernel models" (PDF). Journal of Machine Learning Research. 1: 1–48.
  574. ^ Shmueli, Galit, Ralph P. Russo, and Wolfgang Jank. "The BARISTA: a model for bid arrivals in online auctions." The Annals of Applied Statistics(2007): 412–441.
  575. ^ Peng, Jie, and Hans-Georg Müller. "Distance-based clustering of sparsely observed stochastic processes, with applications to online auctions." The Annals of Applied Statistics (2008): 1056–1077.
  576. ^ Eggermont, Jeroen, Joost N. Kok, and Walter A. Kosters. "Genetic programming for data classification: Partitioning the search space."Proceedings of the 2004 ACM symposium on Applied computing. ACM, 2004.
  577. ^ Moro, Sérgio; Cortez, Paulo; Rita, Paulo (2014). "A data-driven approach to predict the success of bank telemarketing". Decision Support Systems. 62: 22–31. doi:10.1016/j.dss.2014.03.001. hdl:10071/9499. S2CID 14181100.
  578. ^ Payne, Richard D.; Mallick, Bani K. (2014). "Bayesian Big Data Classification: A Review with Complements". arXiv:1411.5653 [stat.ME].
  579. ^ Akbilgic, Oguz; Bozdogan, Hamparsum; Balaban, M. Erdal (2014). "A novel Hybrid RBF Neural Networks model as a forecaster". Statistics and Computing. 24 (3): 365–375. doi:10.1007/s11222-013-9375-7. S2CID 17764829.
  580. ^ Jabin, Suraiya. "Stock market prediction using feed-forward artificial neural network." Int. J. Comput. Appl. (IJCA) 99.9 (2014).
  581. ^ Yeh, I-Cheng; Che-hui, Lien (2009). "The comparisons of data mining techniques for the predictive accuracy of probability of default of credit card clients". Expert Systems with Applications. 36 (2): 2473–2480. doi:10.1016/j.eswa.2007.12.020.
  582. ^ Lin, Shu Ling (2009). "A new two-stage hybrid approach of credit risk in banking industry". Expert Systems with Applications. 36 (4): 8333–8341. doi:10.1016/j.eswa.2008.10.015.
  583. ^ Pelckmans, Kristiaan; et al. (2005). "The differogram: Non-parametric noise variance estimation and its use for model selection". Neurocomputing. 69 (1): 100–122. doi:10.1016/j.neucom.2005.02.015.
  584. ^ Bay, Stephen D.; et al. (2000). "The UCI KDD archive of large data sets for data mining research and experimentation". ACM SIGKDD Explorations Newsletter. 2 (2): 81–85. CiteSeerX doi:10.1145/380995.381030. S2CID 534881.
  585. ^ Lucas, D. D.; et al. (2015). "Designing optimal gree