Something like this could get interesting

But you need equipment to actually play?

I’m not a guitar collector/fetishist at all, but still need at minimum an electric (preferably at least two for humbuckers & singlecoils), a steel string, a nylon string and a bass to be able to play what I want to play. Not to mention amps, pedals etc. And this is strictly for playing gigs and home practice, when you get into home recording it piles up even more. Even if you restrict yourself to things you actually use, the possibilities for hoarding are pretty much endless.

Well, if you experience consciousness, that’s what consciousness is. As in, the word and concept “consciousness” means being conscious, the way you experience being conscious right now (unless of course you’re unconscious as I write this…). Free will does not enter into it at the basic level, nothing says you’re not conscious if you do not have free will. So what would it really mean to say consciousness is an illusion? Who and what is having the illusion? Ironically, your statement assumes the existence of a higher form of consciousness that is not illusory (which may very well exist but how would we ever know?). Simply because a fake something presupposes a real something that the fake thing is not.

So let’s say we could be certain that consciousness purely is the product of material processes in the brain. You still experience consciousness, that does not make it illusory. Perhaps this seems like I’m arguing semantics, but the important takeaway is rather that these kinds of arguments invariably fall apart under scrutiny. Consciousness is actually the only thing we can be absolutely certain exists; in this, Descartes was right.

So, it’s meaningful to say that a language model could “fake” consciousness - trick us into believing it is an “experiencing entity” (or whatever your definition would be) by giving convincing answers in a conversation - but not really meaningful to say that actual conscious beings somehow fake consciousness. Or, that “their brains” (somehow suddenly acting apart from the entity) trick them.