Context (archaeology)

Linguistics

Argument (complex analysis)

Philosophy

Statistics

Realization (probability)

Coherence (philosophical gambling strategy)

Archaeology

Narrative

Economics

Biochemistry

Computer science

Predicate (mathematical logic)

Business

Natural language processing

Mathematics

Structuring

Artificial intelligence

Chemistry

Programming language

Finance

Word (group theory)

History

Writers often rely on plans or sketches to write long stories, but most current language models generate word by word from left to right. We explore coarse-to-fine models for creating narrative texts of several hundred words, and introduce new models which decompose stories by abstracting over actions and entities. The model first generates the predicate-argument structure of the text, where different mentions of the same entity are marked with placeholder tokens. It then generates a surface realization of the predicate-argument structure, and finally replaces the entity placeholders with context-sensitive names and references. Human judges prefer the stories from our models to a wide range of previous approaches to hierarchical text generation. Extensive analysis shows that our methods can help improve the diversity and coherence of events and entities in generated stories.

Strategies for Structuring Story Generation