UPDATE! I was using the 3.13.0-68 version of the kernel on Ubuntu. (Which is the version that exhibited this problem). I just updated to 3.19.0-33 version, and the problem went AWAY. Not sure if this is because of an updated wireless driver, or what. But figured I'd pass that along. It might help someone in the future.