Imagine if we had Ai pre Copernicus
Everyone would just be told that the sun revolves around the earth and no one would question it.
Now extrapolate that to modern life. Don’t assume anything it is giving you is correct.
It can only pattern match existing knowledge, it can’t generate paradigm-shifting discoveries from first principles.
Keep thinking and verifying