Communication Failure when Checking email

I just set up my email and I am getting a “Communication Failure” error when I try to check email. the system will go thru and load 4400 of 4454 emails and then fail. The logs (set to debug) do not show any sort of error. I do have the 4400 emails loaded but the latest ones are missing. Does anyone know of a fix?