Text Encoding Initiative
The Text Encoding Initiative (TEI) is a text-centric community of practice in the academic field of digital humanities, operating continuously since the 1980s. The community currently runs a mailing list, meetings and conference series, and maintains an eponymous technical standard, a wiki, SourceForge repository and a toolchain.
The TEI Guidelines
The TEI Guidelines, which collectively define an XML format, are the defining output of the community of practice. The format differs from other well-known open formats for text (such as HTML and OpenDocument) in that it's primarily semantic rather than presentational; the semantics and interpretation of every tag and attribute are specified. Some 500 different textual components and concepts (word,[1] sentence,[2] character,[3] glyph,[4] person,[5] etc.); each is grounded in one or more academic discipline and examples are given.
Technical Details
The standard is split into two parts, a discursive textual description with extended examples and discussion and set of tag-by-tag definitions. Schema in most of the modern formats (DTD, RELAX NG and W3C Schema) are generated automatically from the tag-by-tag definitions. A number of tools support the production of the guidelines and the application of the guidelines to specific projects.
A number of special tags are used to circumvent restrictions imposed by the underlying Unicode; glyph to allow representation of characters that don't qualify for Unicode inclusion[6] and choice to allow overcome the required strict linearity.[7]
Many users of the format don't use the complete range of tags but produce a customisation with a subset of the of the tags. The format supports this by grouping tags into sets, each corresponding to a chapter in the TEI guidelines and a group of related academic disciplines. Some users of the format go further and describe a schematron stylesheet embodying their local house style to make publishing the content easier.
Examples
The text of the TEI guidelines is rich in examples and all the examples here taken from there. There is also a Samples page on the TEI wiki[8] which gives examples of real-world projects which expose their underlying TEI for elucidation and reuse.
Prose tags
TEI allows texts to be marked up semantically at any level of granularity, or mixture of granularities. For example this paragraph (p) has been marked up into sentences (s) and clauses (cl).[9]
<s>
<cl>It was about the beginning of September, 1664,
<cl>that I, among the rest of my neighbours,
heard in ordinary discourse
<cl>that the plague was returned again to Holland; </cl>
</cl>
</cl>
<cl>for it had been very violent there, and particularly at
Amsterdam and Rotterdam, in the year 1663, </cl>
<cl>whither, <cl>they say,</cl> it was brought,
<cl>some said</cl> from Italy, others from the Levant, among some goods
<cl>which were brought home by their Turkey fleet;</cl>
</cl>
<cl>others said it was brought from Candia;
others from Cyprus. </cl>
</s>
<s>
<cl>It mattered not <cl>from whence it came;</cl>
</cl>
<cl>but all agreed <cl>it was come into Holland again.</cl>
</cl>
</s>
Verse
TEI has tags for marking up verse, this example (taken from the French translation of the TEI Guidelines) shows a sonnet[10]
<div type="sonnet">
<lg type="quatrain">
<l>Les amoureux fervents et les savants austères</l>
<l> Aiment également, dans leur mûre saison,</l>
<l> Les chats puissants et doux, orgueil de la maison,</l>
<l> Qui comme eux sont frileux et comme eux sédentaires.</l>
</lg>
<lg type="quatrain">
<l>Amis de la science et de la volupté</l>
<l> Ils cherchent le silence et l'horreur des ténèbres ;</l>
<l> L'Erèbe les eût pris pour ses coursiers funèbres,</l>
<l> S'ils pouvaient au servage incliner leur fierté.</l>
</lg>
<lg type="tercet">
<l>Ils prennent en songeant les nobles attitudes</l>
<l>Des grands sphinx allongés au fond des solitudes,</l>
<l>Qui semblent s'endormir dans un rêve sans fin ;</l>
</lg>
<lg type="tercet">
<l>Leurs reins féconds sont pleins d'étincelles magiques,</l>
<l> Et des parcelles d'or, ainsi qu'un sable fin,</l>
<l>Etoilent vaguement leurs prunelles mystiques.</l>
</lg>
</div>
Choice tag
The choice tag is used to represent sections of text for which there are more than one possible option. In the following example, based on one in the standard, choice is used twice, once to indicate and original and a corrected year and once to indicate an original and regularised spelling.[11]
<p xml:id="p23">Lastly, That, upon his solemn oath to observe all the above
articles, the said man-mountain shall have a daily allowance of
meat and drink sufficient for the support of <choice>
<sic>1724</sic>
<corr>1728</corr>
</choice> of our subjects,
with free access to our royal person, and other marks of our
<choice>
<orig>favour</orig>
<reg>favor</reg>
</choice>.
ODD
One Document Does it all ("ODD") is a literate programming language for XML schemas.[12][13][14]
In literate-programming style, ODD documents combine human-readable documentation and machine-readable models using the Documentation Elements module of the Text Encoding Initiative. Tools generate localised and internationalised HTML, ePub, or PDF human-readable output and DTDs, W3C XML Schema, Relax NG Compact Syntax, or Relax NG XML Syntax machine-readable output.
The Roma web application[15] is built around the ODD format and can use it to generate schemas in DTD, W3C XML Schema, Relax NG Compact Syntax, or Relax NG XML Syntax formats, as used by many XML validation tools and services.
ODD is that format used internally by the Text Encoding Initiative for their eponymous technical standard.[16] Although ODD files generally describe the difference between a customized XML format and the full TEI model, ODD also can be used to describe XML formats that are entirely separate from the TEI. One example of this is the W3C's Internationalization Tag Set which uses the ODD format to generate schemas and document its vocabulary.[17][18]
TEI customizations
TEI customizations are specializations of the TEI XML specification for use in particular fields or by specific communities.
- EpiDoc (Epigraphic Documents)
- Music Encoding Initiatives
- Charters Encoding Initiative
- Medieval Nordic Text Archive (Menota)
Customization in the TEI is done through the ODD mechanism mentioned above. In truth since its P5 version, all so-called 'TEI Conformant' uses of the TEI Guidelines are based on a TEI customization documented in a TEI ODD file. Even when users choose one of the off-the-shelf pre-generated schemas to validate against, these have been created from freely available customization files.
Projects
The format is used by many projects worldwide. Practically all projects are associated with one or more universities. Some well-known projects that encode texts using TEI include:
Project | URL | Strengths |
---|---|---|
British National Corpus | http://www.natcorp.ox.ac.uk | 100 million word snapshot of current English |
Oxford Text Archive | http://ota.ox.ac.uk/ | Linguistic data and electronic texts |
Perseus Project | http://www.perseus.tufts.edu/ | Greek and Latin texts |
Women Writers Project | http://www.wwp.brown.edu/ | Early modern women writers (Margaret Cavendish, Eliza Haywood, etc.) |
New Zealand Electronic Text Centre | http://www.nzetc.org/ | New Zealand and Pacific Islands texts |
The SWORD Project | http://www.crosswire.org/sword/ | Bible software, dictionaries, Christian literature |
FreeDict | http://freedict.org | Bilingual dictionaries |
Text Creation Partnership | http://www.lib.umich.edu/tcp/ | Early English and American books |
Duke Databank of Documentary Papyri | http://papyri.info/ | Ancient Greek papyrus texts from Egypt |
Henrik Ibsen's Writings | http://www.ibsen.uio.no/ | Complete works and writings by playwright Henrik Ibsen |
History
- 1987 Work on what would become the TEI started by the Association for Computers and the Humanities, the Association for Computational Linguistics, and the Association for Literary and Linguistic Computing.[19] This culminated in the Closing statement of the Vassar Planning Conference[20]
- 1994 TEI P3 released[21] co-edited by Lou Burnard (at Oxford University) and Michael Sperberg-McQueen (then at the University of Illinois at Chicago, later at the W3C).
- 1999 TEI P3 updated.
- 2002 TEI P4 released, moving from SGML to XML; adoption of Unicode, which XML parsers are required to support.[22]
- 2007 TEI P5 released, including integration with the
xml:lang
andxml:id
attributes from the W3C[23] (these had previously been attributes in the TEI namespace), regularization of local pointing attributes to use the hash (as used in HTML) and unification of the ptr and xptr tags. Together these changes with many more new additions make P5 more regular and bring it closer to current xml practice as promoted by the W3C and as used by other XML variants. Maintenance and feature update versions of TEI P5 have been released at least twice a year since 2007.
- 2011 TEI P5 v2.0.1 released with support for Genetic editing.[24] (among many other additions the Genetic editing features allow encoding of texts without interpretation as to their specific semantics.)
References
- ^ "Element w (word) - TEI P5".
- ^ "Element s (s-unit) - TEI P5".
- ^ "Element c (character) - TEI P5".
- ^ "Element w (character or glyph) - TEI P5".
- ^ "Element person (person) - TEI P5".
- ^ "Element w (word) - TEI P5".
- ^ "Element w (word) - TEI P5".
- ^ "Samples of TEI texts". wiki.tei-c.org. 2011 [last update]. Retrieved 17 April 2012.
{{cite web}}
: Check date values in:|year=
(help)CS1 maint: year (link) - ^ "17 Simple Analytic Mechanisms - TEI P5: — Guidelines for Electronic Text Encoding and Interchange". tei-c.org. 2012 [last update]. Retrieved 15 April 2012.
{{cite web}}
: Check date values in:|year=
(help)CS1 maint: year (link) - ^ "TEI element lg (groupe de vers)". tei-c.org. 2012 [last update]. Retrieved 15 April 2012.
{{cite web}}
: Check date values in:|year=
(help)CS1 maint: year (link) - ^ "TEI element choice". tei-c.org. 2012 [last update]. Retrieved 15 April 2012.
{{cite web}}
: Check date values in:|year=
(help)CS1 maint: year (link) - ^ Bauman, Syd; Flanders, Julia (2004), "ODD customizations", Extreme Markup Languages 2004.
- ^ Burnard, Lou; Rahtz, Sebastian (2004), "RelaxNG with Son of ODD", Extreme Markup Languages 2004.
- ^ Reiss, Kevin M. (2007), Literate Documentation for XML (PDF), Urbana-Champaign, Illinois: Digital Humanities 2007.
- ^ Roma web application.
- ^ Burnard, Lou; Bauman, Syd, eds. (2007), TEI P5: Guidelines for Electronic Text Encoding and Interchange, Charlottesville, Virginia, USA: TEI Consortium.
- ^ W3C ITS and TEI ODD file.
- ^ Savourel, Yves; Kosek, Jirka; Ishida, Richard, eds. (2008), "5.2 ITS and TEI", Best Practices for XML Internationalization, W3C Working Group.
- ^ "Historical background", section iv.2 of TEI P5: Guidelines for Electronic Text Encoding and Interchange.
- ^ "Closing statement of the Vassar Planning Conference". tei-c.org. 2009 [last update]. Retrieved 15 April 2012.
{{cite web}}
: Check date values in:|year=
(help)CS1 maint: year (link) - ^ "TEI Guidelines". Retrieved 2010-06-18.
- ^ "2", XML Basics, retrieved 2011-07-09
- ^ http://www.w3.org/TR/REC-xml/
- ^ "P5 version 2.0.1 release notes". tei-c.org. 2012 [last update]. Retrieved 15 April 2012.
{{cite web}}
: Check date values in:|year=
(help)CS1 maint: year (link)
External links
- TEI Consortium Web site (hosted at University of Virginia) with a list of TEI projects, a form for adding your project and wiki
- TEI @ Oxford (hosted at Oxford University) with development and backup versions of much of the core content.
- TEI development (hosted at SourceForge.net) with bugtracker, version control, etc.
- Larger list of TEI Projects