Post #216

Graph of words GPT-3 is a new SOTA for text generation and we thought it would be cool to produce a graph of words from it (if someone). I think no one has yet done it and it can bring some insights in how the language is structured. For example, if we can do graph clustering and obtain same clusters as in pure text; or, if we can find rare combination of words; or, discovering the difference between such graph and graph coming from n-grams. Potentially, this can be a hypergraph with multiple nodes connected at once, corresponding to entire phrases.