View source for MARC-8

{{Short description|Metadata standard}}
The '''MARC-8''' charset is a [[MARC standards|MARC standard]] used in [[MARC standards#MARC 21|MARC-21]] library records.<ref>{{Cite web|url=https://www.loc.gov/marc/specifications/speccharintro.html|title = Character Sets: Introduction: MARC 21 Specifications for Record Structure, Character Sets, and Exchange Media (Library of Congress)|website = [[Library of Congress]]}}</ref> The MARC formats are standards for the representation and communication of bibliographic and related information in machine-readable form, and they are frequently used in [[integrated library system|library database systems]]. The [[character encoding]] now known as MARC-8 was introduced in 1968 as part of the MARC format.  Originally based on the [[Latin alphabet]], from 1979 to 1983 the [[JACKPHY]] initiative expanded the repertoire to include Japanese, Arabic, Chinese, and Hebrew characters (among others), with the later addition of Cyrillic and Greek scripts.  If a character is not representable in MARC-8 of a MARC-21 record, then [[UTF-8]] must be used instead. UTF-8 has support for many more characters than MARC-8, which is rarely used outside library data.

==Technical details==
MARC-8 uses a variant of the [[ISO-2022]] encoding. It uses escape characters to represent characters beyond the 7-bit [[ASCII]] range of characters.

It generally uses the same logical [[BiDi]] ordering as [[Unicode]].

The combining characters and base characters are in a different order than used in Unicode. The following are some examples. The combining characters are not always stored in reverse order as [[Unicode normalization]]. The MARC-21 standard describes the MARC-8 Unicode conversion issues in more detail.

{| class="wikitable"
|-
! Displayed
Character
! Unicode
[[Unicode normalization|NFD]]
! MARC-8
|-
| á
| a&nbsp; ́
| &nbsp; ́  a
|-
| ậ
| a&nbsp;&nbsp; ̣ &nbsp; ̂
| &nbsp; ̂&nbsp;&nbsp; ̣  a
|}

===Code structure===
The [[ISO/IEC 2022]] coding specifies a two-layer mapping between character codes and displayed characters. In MARC-8, character codes from the 7-bit ASCII graphic range (0x20–0x7F) are referred to as "G0" codes, while codes from the "high ASCII" range (0xA0–0xFF) are referred to as the "G1" codes. Graphic character sets are designated and invoked by means of a multiple byte escape sequence consisting of the escape character, an Intermediate character sequence, and a Final character in the form ESC ''I'' ''F''.

The following table shows the intermediate byte after the ESC byte (hexadecimal 1B), and the corresponding ASCII characters.

{| class="wikitable"
|+ Intermediate Bytes<ref name="loc.gov">{{Cite web|url=https://www.loc.gov/marc/specifications/speccharmarc8.html|title = Character Sets: MARC-8 Encoding Environment: MARC 21 Specifications for Record Structure, Character Sets, and Exchange Media (Library of Congress)|website = [[Library of Congress]]}}</ref>
|-
! rowspan="2" | 
! colspan="4" | G0 set
! colspan="4" | G1 set
|-
! [[SBCS]]
!
! [[Multi-byte character set|MBCS]]
!
! [[SBCS]]
!
! [[Multi-byte character set|MBCS]]
!
|-
! Normal ISO-2022
| 28
| (
| 24
| $
| 29
| )
| 24 29
|$)
|-
! Alternate ISO-2022 (additional 63+16 sets)
| 2C
|, 
| 24 2C
| $,
| 2D
| -
| 24 2D
| $-
|}

The following table shows the final bytes in hexadecimal and the corresponding ASCII characters after the intermediate bytes.

{| class="wikitable"
|+ Final Bytes<ref name="loc.gov"/>
|-
! Bytes
! Characters
! Name
! Type
! Comment
|-
| 31
| 1
| Chinese, Japanese, Korean ([[Chinese Character Code for Information Interchange|EACC]])
| [[Multi-byte character set|MBCS]]
| 
|-
| 32
| 2
| Basic Hebrew
| [[SBCS]]
| 
|-
| 33
| 3
| Basic Arabic
| [[SBCS]]
| 
|-
| 34
| 4
| Extended Arabic
| [[SBCS]]
| 
|-
| 42
| B
| Basic Latin ([[ASCII]])
| [[SBCS]]
| 
|-
| 21 45
| !E
| Extended Latin ([[ANSEL]])
| [[SBCS]]
| The 21(hex) technically is a second byte of the Intermediate segment of this escape sequence.
|-
| 4E
| N
| Basic Cyrillic
| [[SBCS]]
| 
|-
| 51
| Q
| Extended Cyrillic
| [[SBCS]]
| 
|-
| 53
| S
| Basic Greek ([[ISO 5428]])
| [[SBCS]]
| 
|}

The EACC is the only multibyte encoding of MARC-8, it encodes each [[CJK characters|CJK character]] in three ASCII bytes.

For example, to encode the U+4EBA CJK character (人) you will need the following bytes

  \x1B\x24\x31\x21\x30\x64

The \x1B\x24\x31 switches to EACC/CJK, and the \x21\x30\x64 corresponds to the U+4EBA.

===Custom set extension===
In addition to the ISO-2022 character sets, the following custom sets are available too. The byte designation follows the escape byte (hexadecimal 1B). There is no intermediate byte.

{| class="wikitable"
|+ Final Bytes<ref name="loc.gov"/>
|-
! Bytes
! Characters
! Name
! Type
! Comment
|-
| 62
| b
| Subscript set
| [[SBCS]]
| 
|-
| 67
| g
| Greek Symbol set
| [[SBCS]]
| The alpha, beta, gamma characters normally do not round trip map to Unicode.
|-
| 70
| p
| Superscript set
| [[SBCS]]
| 
|-
| 73
| s
| Basic Latin ([[ASCII]])
| [[SBCS]]
| 
|}

=== C0 control codes ===
[[MARC 21]] uses {{control code link|GS}} (0x1D) as a record terminator, {{control code link|RS}} (0x1E) as a field terminator and {{control code link|US}} (0x1F) as a subfield delimiter.<ref name="marc-c0c1">{{cite web |url=https://www.loc.gov/marc/specifications/specchargeneral.html#controlfunction |title=Control function codes |work=MARC 21 Specifications for Record Structure, Character Sets, and Exchange Media |publisher=[[Library of Congress]] |date=2007-12-04}}</ref>

=== C1 control codes ===
The following alternative [[C1 control code]] set is defined for bibliographic applications such as [[integrated library system|library systems]]. It is mostly concerned with string collation, and with markup of bibliographic fields. Slightly different variants are defined in the German standard '''[[DIN]] 31626'''<ref name="din31626">{{cite iso-ir |number=40 |title=Additional Control Codes for Bibliographic Use according to German Standard DIN 31626 |date=1979-07-15 |sponsor=DIN |sponsor-link=DIN}}</ref> (published in 1978 and since withdrawn)<ref>{{cite web |url=https://www.beuth.de/en/standard/din-31626/1766185 |title=Information processing; bibliographic control characters |id=DIN 31626:1978-12 |publisher=Beuth: publishing DIN}}</ref> and the [[ISO]] standard '''ISO 6630''',<ref name="iso6630-old">{{cite iso-ir |number=67 |title=Additional Control Codes for Bibliographic Use according to International Standard ISO 6630 |date=1983-06-01 |sponsor=ISO/TC 46}}</ref><ref name="iso6630-1985">{{cite iso-ir |number=124 |title=Additional Control Codes for Bibliographic Use according to International Standard ISO 6630 |date=1986-02-01 |sponsor=ISO/TC 46}}</ref> the latter of which has also been adopted in Germany as '''DIN ISO 6630'''.<ref>{{cite web |url=https://www.boutique.afnor.org/standard/din-iso-6630/information-and-documentation-bibliographic-control-characters-iso-66301986/article/650507/eu027670 |title=DIN ISO 6630 December 1997 |work=[[AFNOR]] Editions Online Store}}</ref> Where these differ is noted in the table below where applicable. MARC-8 uses the coding of {{ctrl|NSB|internal=1}} and {{ctrl|NSE|internal=1}} from this set, and adds some additional format effectors in locations not used by the ISO version; however, MARC 21 uses this control set only in MARC-8 records, not in Unicode-format records.<ref name="marc-c0c1"/>

If using the [[ISO/IEC 2022]] extension mechanism, the DIN 31626 set is designated as the active C1 control character set with the sequence <code>0x1B 0x22 0x45</code> (<code>ESC " E</code>),<ref name="din31626" /> and the ISO 6630 / DIN ISO 6630 set is designated with the sequence <code>0x1B 0x22 0x42</code> (<code>ESC " B</code>).<ref name="iso6630-old" /> The 1985 expansion of the ISO 6630 set can also be explicitly specified by using the sequence <code>0x1B 0x26 0x40 0x1B 0x22 0x42</code> (<code>ESC & @ ESC " B</code>).<ref name="iso6630-1985" />

{| class="wikitable"
|-Valign=bottom
!title="Escape sequence"| Esc+ !!title="decimal"| Dec !!title="hexadecimal"| Hex !!title="acronym"| Acro !!title="Character name"| Name || Description<ref name="din31626" /><ref name="iso6630-old" /><ref name="iso6630-1985" />
|- id="CUS"
|G||135||87||CUS||Close-Up for Sorting||(DIN 31626, ISO 6630) Declares that two successive character sequences separated by a space or separator should be treated as one word for collation purposes.
|- id="NSB"
|H||136||88||NSB||Non-Sorting Characters Begin||(DIN 31626, ISO 6630, MARC 21) Marks the start of a sequence of characters to be ignored for collation purposes. [[MARC 21]] uses this character in MARC-8 records, but uses 0x98 ({{ctrl|ANSI:SOS}}) in Unicode records for the same purpose.<ref name="marc-c0c1"/><ref name="marc-ansel">{{cite web |url=https://memory.loc.gov/diglib/codetables/45.html |title=Code Table Extended Latin (ANSEL) |work=MARC 21 Specifications for Record Structure, Character Sets, and Exchange Media |publisher=[[Library of Congress]] |date=2007-12-05}}</ref>
|- id="NSE"
|I||137||89||NSE||Non-Sorting Characters End||(DIN 31626, ISO 6630, MARC 21) Marks the end of a sequence of characters to be ignored for collation purposes. MARC 21 uses this character in MARC-8 records, but uses 0x9C ({{ctrl|ST}}) in Unicode records for the same purpose.<ref name="marc-c0c1"/><ref name="marc-ansel" />
|- id="FIL"
|J||138||8A||FIL||Filler Character||(DIN 31626) Substitutes for a mandatory alphanumeric character in a field.
|- id="TCI"
|rowspan=2|K||rowspan=2|139||rowspan=2|8B||TCI||Tag in Context Indicator||(DIN 31626) Within a bibliographic field, used to refer to data in another bibliographic field by its tag number.
|- id="PLD"
|PLD||Partial Line Down||(ISO 6630) Not in the original edition of ISO 6630.<ref name="iso6630-old" /> In the 1985 edition of ISO 6630,<ref name="iso6630-1985" /> used for Partial Line Down (see {{Control code link|PLD}}).
|- id="ICI"
|rowspan=2|L||rowspan=2|140||rowspan=2|8C||ICI||Identification Number in Context Indicator||(DIN 31626) Within a bibliographic field, used to refer to data in another bibliographic record by its ID number.
|- id="PLU"
|PLU||Partial Line Up||(ISO 6630) Not in original edition of ISO 6630.<ref name="iso6630-old" /> In the 1985 edition of ISO 6630,<ref name="iso6630-1985" /> used for Partial Line Up (see {{Control code link|PLU}}).
|- id="DINOSC"
|rowspan=2|M||rowspan=2|141||rowspan=2|8D||OSC{{efn|Not the same as the {{Control code link|ANSI:OSC|Operating System Command (OSC)}} in the ISO/IEC 6429 C1 code set.}}||Optional Syllabification{{efn|Spelled "{{sic|Syllabication}}" in the ISO-IR-040 document, along with "syllable" being spelled "{{sic|syllabe}}" in the description. These are presumably typographical errors.}} Control||(DIN 31626) Marks a syllable boundary in a long word. See also {{Control code link|SHY|soft hyphen}}.
|- id="ZWJ"
|ZWJ||Joiner||(MARC 21) In MARC-8, used for the [[Zero-Width Joiner]], while U+200D is used in Unicode-format MARC records.<ref name="marc-c0c1"/><ref name="marc-ansel" />
|- id="SS2"
|rowspan=2|N||rowspan=2|142||rowspan=2|8E||SS2||Single-Shift 2||(DIN 31626) Non-locking shift code, see {{control code link|SS2}}.
|- id="ZWNJ"
|ZWNJ||Non-Joiner||(MARC 21) In MARC-8, used for the [[Zero-Width Non-Joiner]], while U+200C is used in Unicode-format MARC records.<ref name="marc-c0c1"/><ref name="marc-ansel" />
|- id="SS3"
|O||143||8F||SS3||Single-Shift 3||(DIN 31626) Non-locking shift code, see {{control code link|SS3}}.
|-
|P||144||90||-||''(reserved)''||
|- id="EAB"
|Q||145||91||EAB||Embedded Annotation Beginning||(DIN 31626, ISO 6630) Marks the start of a variable-length annotation which is embedded within a bibliographic field, as opposed to separated using content designation.
|- id="EAE"
|R||146||92||EAE||Embedded Annotation End||(DIN 31626, ISO 6630) Marks the end of a variable-length embedded annotation.
|- id="ISB"
|S||147||93||ISB||Item Specification Beginning||(DIN 31626) Marks the start of a string of specific information of some description, other than a keyword or a permutation string.
|- id="ISE"
|T||148||94||ISE||Item Specification End||(DIN 31626) Marks the end of a string of specific information.
|- id="SIB"
|U||149||95||SIB||Sorting Interpolation Beginning||(ISO 6630) Marks the beginning of a sequence of characters used for collation purposes only.
|- id="SIE"
|V||150||96||SIE||Sorting Interpolation End||(ISO 6630) Marks the end of a sequence of characters used for collation purposes only.
|- id="SSB"
|W||151||97||SSB||Secondary Sorting Value Beginning||(ISO 6630) Marks the start of a string with subordinate collation value.
|- id="SSE"
|X||152||98||SSE||Secondary Sorting Value End||(ISO 6630) Marks the end of a string with subordinate collation value.
|- id="INC"
|Y||153||99||INC||Indicator for Non-Standard Character||(DIN 31626) Identifies a following non-standard character.
|-
|Z||154||9A||-||''(reserved)''||
|-
|<nowiki>[</nowiki>||155||9B||-||''(reserved)''
|- id="KWB"
|\||156||9C||KWB||Keyword Beginning||(DIN 31626, ISO 6630) Marks the start of a keyword within a bibliographic field.
|- id="KWE"
|]||157||9D||KWE||Keyword End||(DIN 31626, ISO 6630) Marks the end of a keyword within a bibliographic field.
|- id="PSB"
|^||158||9E||PSB||Permutation String Beginning||(DIN 31626, ISO 6630) Marks the start of a string which is to be permuted to the front of the element when references or [[index (publishing)|indices]] are generated. Terminated by PSE or by the end of the element.
|- id="PSE"
|_||159||9F||PSE||Permutation String End||(DIN 31626, ISO 6630) Marks the end of a string which is to be permuted to the front of the element.
|}

==Notes==
{{notelist}}

==References==
<references/>

==External links==
* [https://www.loc.gov/marc/specifications/speccharintro.html MARC 21 Specifications for Record Structure, Character Sets, and Exchange Media] - The official MARC-8 standard as maintained by the [[US Library of Congress]]

{{character encoding}}

{{DEFAULTSORT:Marc-8}}
[[Category:Character sets]]