The reason AI's results look so convincing is because it's a plagiarism machine (and sometimes not a very good one). It cannot operate without our work which has been stolen and used without compensation because the courts have decided this is a "fair use". Fair to whom?
I saw a great video on Youtube illustrating this by attempting to convince it to make a wine glass full to the brim (which it simply can't), and going into the deeper philosophy of ideas to explain why it normally appears to be able to create "completely new" concepts when really it's just mashing two existing concepts together, but cannot actually correctly combine the separate ideas of "completely full" or "almost empty" with a "wine glass" properly. Because nobody ever does this and we use a different definition of "full" for a wine glass, there is no useful source material for it, and the AI has no idea how to do it either, while of course always being convinced it has correctly understood what a completely full wine glass looks like. It doesn't have novel ideas, it doesn't have an imagination, it is not intelligence. It is just plagiarism. It is using its nearly limitless database of the work of thousands of years of human creativity to appear as if it too is creative. It's not.