Open-Ended Text Generation - Andrew Reed  ## Metadata - Author: **Andrew Reed** - Full Title: Open-Ended Text Generation - Category: #articles - URL: https://blog.fastforwardlabs.com/2019/05/29/open-ended-text-generation.html ## Highlights - In greedy search, the decoder picks the word that has the highest likelihood of being the next word in the sequence. It only looks at the next word, and in doing so, is only exploring one path to building a sequence of words. - A better approach is beam search. Rather than exploring a single path, beam search keeps track of multiple paths. While beam search is effective for non-open-ended generation tasks such as machine translation, data-to-text generation, and summarization, it does not work well for open-ended text generation. - Tags: #ai