It sounds like your ISP may be Throttling or Shaping your Bandwidth.
If you get Fully Connected at different times of the day, then this may be whats happening.
Who is your ISP ??
See Link below for more on this subject.
Bandwidth throttling - Wikipedia, the free encyclopedia