In its attempt to respond to a prompt, it has been known to manufacture information.
Chatbots don’t have life experiences
One reason I don't think excellent writers shouldn't fear being replaced by chatbots is that chatbots alone can't make an emotional connection with a reader by sharing life experiences.