How generative AI works is likely not how you think it works.

What led me to state this was two discussions I’ve had this week about the “design” of gen AI. I think the “design” conclusion that people come up with is based on emergent behaviours of the system. You can shape this behaviour in a number of ways, based on the data you feed the system or some ways you configure the software being trained. However at best you are influencing the behaviour of the system, vs designing the behaviour of the system.

In some ways it’s like taking a bucket of seeds and tossing them around a large area of a field. If you took only seeds of one or two flowers and distributed the seeds so that only these one or two flowers and grew there, you could say you designed the garden to grow these flowers. Likewise, if you divided up the land into rows and planted one type of seed in each row, you can say you designed the garden. However if you have a wide range of seeds included in your bucket and you don’t target the planting of the seeds but just toss them into the ground, it will no longer be considered designed.

That’s why I think gen AI is not really designed. It’s a alot like a big bucket of random seeds not planted in any order. What design you see there is likely how you look at it.

P.S. If you want to explore more on how gen AI works, see this. For a great example of how a gen AI system is built from the ground up, see this.