It cannot verify your facts
A fluent read can make an incorrect date, name, or claim sound authoritative. Speech quality is not evidence that the underlying copy is accurate.
Workaround
Fact-check the final spoken script separately, then listen again after any factual edit.