Can't speak to that means can't give info on this topic doesn't
Can't speak to that
"I can't discuss it."
It may also mean that the person simply doesn't know the information or the situation, so s/he won't comment.
It may also mean that the person simply doesn't know the information or the situation, so s/he won't comment.