[Originally posted on LinkedIn]
Alright, since I’ve spent most of my career in games and find the intersection between games and generative AI fascinating—this week I’ll share some of the recent transformative things going on in this area. Holler if I missed anything interesting!
First up is Super MarioGPT, a neat level generator method for Super Mario, created by researchers at ITU in Copenhagen. It uses a finetuned GPT2 model to generate text representations of levels. Try it out!
Next is Scenario, a service to generate 2D game assets variations. What makes this quite powerful is that it allows fine-tuning training, which means you can supply a bunch of reference images to better control output and style.
https://www.scenario.gg/
Moving on to bleeding edge land with Masterpiece studio, a service with which you can generate 3D character models and animations from text.
I’ll wrap up with a couple of examples that bridge the past with the future, the analog with the digital, the manual with the automated.
I really liked this example of using stable diffusion to generate maps for tabletop role playing
Lastly, I’ve been enjoying playing games with ChatGPT in the style text adventures of yore, like Zork. It’s amazing how well ChatGPT does this, however I think I need to prompt it with stronger story arc as the stories now feel too meandering and fleeting.