Gwern — Generative AI: Fiction↗

To expand the ABC GPT-2 model to cover a wider variety of musical genres, I turn to the next-most compact widespread music encoding format: MIDI .

[ { "query" : [ 0 , 0 ] , "sample0" : [ 27 , 91 , 437 , 1659 , 5239 , 91 , 29 , 55 , 25 , 23349 , 198 , 51 , 25 , 14874 , 1252 , 25308 , 22495 , 198 , 44 , 25 , 17 , 14 , 19 , 198 , 43 , 25 , 16 , 14 ...

A useful variation on AI Dungeon -style (AID) text games would be to turn them into shared public game trees of pre-generated options which the player selects...

GPT-3, announced in May 2020 by OpenAI , was a breakthrough in neural net modeling of natural language and natural-language-related tasks; the June 2020 API opened up GPT-3 use to outsiders,...

# On the Impossibility of Superintelligent Rubik’s Cube Solvers Abstract: This paper argues that superintelligent machines will never be able to solve a Rubik’s Cube as well as a human being can.

One of the weakest parts of 2024-era LLMs , and where user opinions differ the most from the benchmarks, is anything to do with ‘diversity’ and ‘creativity’.

Can 2024-era LLMs reason successfully about how to write using only words that could not have appeared in any Bible ever? Mostly.

Trying out having Gemini-3-pro-preview write system prompts compatible with creative fiction writing (sci-fi short story examples), and trying it out on GPT-5 Pro and Claude-4.

We were in bat country now, Silicon Valley bats with baby faces, all gibbering madly with the voices of our dead consciences.