If either of you are downloading lots of files (music, video, etc) it will affect the other. Keep your connection for yourself.