Darwin Core Archive: Difference between revisions
m Replaced broken link with link to new resource |
No edit summary |
||
| Line 1: | Line 1: | ||
{{Orphan|date=January 2011}} |
{{Orphan|date=January 2011}} |
||
'''Darwin Core Archive''' (DwC-A) is a [[biodiversity informatics]] data standard that makes use of the [[Darwin Core]] terms to produce a single, self-contained dataset for species occurrence or |
'''Darwin Core Archive''' (DwC-A) is a [[biodiversity informatics]] data standard that makes use of the [[Darwin Core]] terms to produce a single, self-contained dataset for species occurrence, checklist, sampling event or material sample data. Essentially it is a set of text (CSV) files with a simple descriptor (meta.xml) to inform others how your files are organized. The format is defined in the Darwin Core Text Guidelines.<ref name="dwc-text">[http://rs.tdwg.org/dwc/terms/guides/text/index.htm Darwin Core Text Guidelines]</ref> It is the preferred format for publishing data to the [[GBIF]] network. |
||
__TOC__ |
__TOC__ |
||
==Darwin Core== |
==Darwin Core== |
||
The Darwin Core standard has been used to |
The Darwin Core standard<ref>{{Cite journal |last1=Wieczorek |first1=John |last2=Bloom |first1=David |last3=Guralnick |first3=Robert |last4=Blum |first4=Stan |last5=Döring |first5=Markus |last6=Giovanni |first6=Renato |last7=Robertson |first7=Tim |last8=Vieglais |first8=David |title=Darwin Core: An Evolving Community-Developed Biodiversity Data Standard |journal=PLoS ONE |volume=7(1): e29715 |year=2012 |website=https://doi.org/10.1371/journal.pone.0029715}} has been used to mobilize the vast majority of specimen occurrence and observational records within the GBIF network.<ref name="gbif-dwca">[https://github.com/gbif/ipt/wiki/DwCAHowToGuide Darwin Core Archives – How-to Guide]</ref> The [[Darwin Core]] standard was originally conceived to facilitate the discovery, retrieval, and integration of information about modern biological specimens, their spatio-temporal occurrence, and their supporting evidence housed in collections (physical or digital). |
||
The Darwin Core today is broader in scope. It aims to provide a stable, standard reference for sharing information on biological diversity. As a glossary of terms, the Darwin Core provides stable semantic definitions with the goal of being maximally reusable in a variety of contexts. This means that Darwin Core may still be used in the same way it has historically been used, but may also serve as the basis for building more complex exchange formats, while still ensuring interoperability through a common set of terms. |
The Darwin Core today is broader in scope. It aims to provide a stable, standard reference for sharing information on biological diversity. As a glossary of terms, the Darwin Core provides stable semantic definitions with the goal of being maximally reusable in a variety of contexts. This means that Darwin Core may still be used in the same way it has historically been used, but may also serve as the basis for building more complex exchange formats, while still ensuring interoperability through a common set of terms. |
||
| Line 33: | Line 33: | ||
==References== |
==References== |
||
{{reflist}} |
{{reflist}} |
||
==External links== |
==External links== |
||
* [http://rs.tdwg.org/dwc/terms/index.htm Darwin Core Quick Reference Guide] |
* [http://rs.tdwg.org/dwc/terms/index.htm Darwin Core Quick Reference Guide] |
||
Revision as of 13:12, 22 November 2017
Darwin Core Archive (DwC-A) is a biodiversity informatics data standard that makes use of the Darwin Core terms to produce a single, self-contained dataset for species occurrence, checklist, sampling event or material sample data. Essentially it is a set of text (CSV) files with a simple descriptor (meta.xml) to inform others how your files are organized. The format is defined in the Darwin Core Text Guidelines.[1] It is the preferred format for publishing data to the GBIF network.
Darwin Core
The Darwin Core standardCite error: A <ref> tag is missing the closing </ref> (see the help page). The Darwin Core standard was originally conceived to facilitate the discovery, retrieval, and integration of information about modern biological specimens, their spatio-temporal occurrence, and their supporting evidence housed in collections (physical or digital).
The Darwin Core today is broader in scope. It aims to provide a stable, standard reference for sharing information on biological diversity. As a glossary of terms, the Darwin Core provides stable semantic definitions with the goal of being maximally reusable in a variety of contexts. This means that Darwin Core may still be used in the same way it has historically been used, but may also serve as the basis for building more complex exchange formats, while still ensuring interoperability through a common set of terms.
Archive Format
 |
The central idea of an archive is that its data files are logically arranged in a star-like manner, with one core data file surrounded by any number of ’extensions’. Each extension record (or ‘extension file row’) points to a record in the core file; in this way, many extension records can exist for each single core record.
Details about recommended extensions can be found in their respective subsections and will be extensively documented in the GBIF registry, which will catalogue all available extensions.
Sharing entire datasets instead of using pageable web services like DiGIR and TAPIR allows much simpler and more efficient data transfer. For example, retrieving 260,000 records via TAPIR takes about nine hours, issuing 1,300 http requests to transfer 500 MB of XML-formatted data. The exact same dataset, encoded as DwC-A and zipped, becomes a 3 MB file. Therefore, GBIF highly recommends compressing an archive using ZIP or GZIP when generating a DwC-A.
An archive requires stable identifiers for core records, but not for extensions. For any kind of shared data it is therefore necessary to have some sort of local record identifiers. It’s good practice to maintain – with the original data – identifiers that are stable over time and are not being reused after the record is deleted. If you can, please provide globally unique identifiers instead of local ones.
Archive Descriptor
To be completed.
Dataset Metadata
A Darwin Core Archive should contain a file containing metadata describing the whole dataset. The Ecological Metadata Language (EML) is the most common format for this, but simple Dublin Core files are being used too.