Document structuring
Document Structuring is a subtask of Natural language generation, which involves deciding the order and grouping (for example into paragraphs) of sentences in a generated text.
Example
Assume we have four sentences which we want to include in a generated text
- It will rain on Saturday
- It will be sunny on Sunday
- Max temperature will be 10C on Saturday
- Max temperature will be 15C on Sunday
There are 24 (4!) orderings of these messages, including
- (1234) It will rain on Saturday. It will be sunny on Sunday. Max temperature will be 10C on Saturday. Max temperature will be 15C on Sunday.
- (2341) It will be sunny on Sunday. Max temperature will be 10C on Saturday. Max temperature will be 15C on Sunday. It will rain on Saturday.
- (4321) Max temperature will be 15C on Sunday. Max temperature will be 10C on Saturday. It will be sunny on Sunday. It will rain on Saturday.
Some of these orderings are better than others. For example, of the texts shown above, human readers prefer (1234) over (2314) and (4321).
For any ordering, there are also many ways in which sentences can be grouped into paragraphs and higher-level structures such as sections. For example, there are 8 (2**3) ways in which the sentences in (1234) can be grouped into paragraphs, including
- (12)(34)
- It will rain on Saturday. It will be sunny on Sunday.
- Max temperature will be 10C on Saturday. Max temperature will be 15C on Sunday.
- (1)(23)(4)
- It will rain on Saturday.
- It will be sunny on Sunday. Max temperature will be 10C on Saturday.
- Max temperature will be 15C on Sunday.
As with ordering, some groupings are preferred by others; for example (12)(34) is preferred over (1)(23)(4).
The document structuring task is to choose an ordering and grouping of sentences which results in a coherent and well-organised text from the reader's perspective.
Algorithms and Models
There are three basic approaches to document structuring: schemas, corpus-based, and heuristic.
Schemas [1] are templates which explicitly specify sentence ordering and grouping for a document. Typically they are constructed by manually analysing a corpus of human-written texts in the target genre, and extracting a document template from these texts. Schemas work well in practice for texts which are short (5 sentences ot less) and/or have a standardised structure, but have problems in generating texts which are longer and do not have a fixed structure.
Corpus-based structuring techniques use statistical corpus analysis techniques to automatically build ordering and/or grouping models. Such techniques are common in Automatic summarisation, where a computer program automatically generates a summary of a textual document [2]. In principle they could be applied to text generated from non-linguistic data, but this work is in its infancy; part of the challenge is that texts generated by Natural Language Generation systems are generally expected to be of fairly high quality, which is not always the case for texts generated by automatic summarisation systems.
The final approach is heuristic-based structuring. Such algorithms perform the structuring task based on heuristic rules, which can come from theories of rhetoric [3], psycholinguistic models [4], and/or a combination of intuition and feedback from pilot experiments with potential users [5]. Heuristic-based structuring is appealling intellectually, but it can be difficult to get it to work well in practice, in part because heuristics often depend on semantic information (how sentences relate to each other) which is not always available. On the other hand it has the advantage of being focused on what is best for text readers, whereas the other approaches focus on what text writers do (and many human-authored texts are not well structured).
References
- ^ K McKeown (1985). Text Generation. Cambridge University Press
- ^ M Lapata (2003). Probabilistic Text Structuring: Experiments with Sentence Ordering. Proceedings of ACL-2003 [1]
- ^ D Scott and C de Souza (1990). Getting the message across in RST-based text generation . In Dale, Mellish, Zock (eds) Current research in natural language generation, pages 47-73
- ^ N Karamanis, M Poesio, C Mellish, J Oberlander (2004). Evaluating Centering-based metrics of coherence for text structuring using a reliably annotated corpus. Proceedings of ACL-2004 [2]
- ^ S Williams and E Reiter. Generating basic skills reports for low-skilled readers. Natural Language Engineering 14:495-535