Data hub

A data hub is a collection of data from multiple sources organized for distribution, sharing, and often subsetting and sharing. Generally this data distribution is in the form of a hub and spoke architecture.

Features

A data hub differs from a data warehouse in that it is generally unintegrated and often at different grains. It differs from an operational data store because a data hub does not need to be limited to operational data.

A data hub differs from a data lake by homogenizing data and possibly serving data in multiple desired formats, rather than simply storing it in one place, and by adding other value to the data such as de-duplication, quality, security, and a standardized set of query services. A Data Lake tends to store data in one place for availability, and allow/require the consumer to process or add value to the data.

Data Hubs are ideally the "go-to" place for data within an enterprise, so that many point-to-point connections between callers and data suppliers do not need to be made, and so that the Data Hub organization can negotiate deliverables and schedules with various data enclave teams, rather than being an organizational free-for-all as different teams try to get new services and features from many other teams.

List of products that promote themselves as data hubs

• Apache Hadoop
• Google MapReduce
• Avoiding Mass Extinctions Engine
• CKAN
• DataMarket
• Dataverse
• DSpace
• MarkLogic
• OpenDataSoft
• Quandl
• QuickCode
• Semarchy
• Socrata
• ZAP

Includes integration of project management systems, account management systems..

See also

• Open data