It's possible that other WiFi near by can have interference impact on the same frequncy. InSSIDer will tell you what modes and channels others are using. Are they using the same Mode and Channels as yours? How many other wifi routers are near by?
Cordless phone can also interfere with the router being on or near the same frequency.
I wold do this, turn off all wireless and cordless devices. Unplug cordless if you need to. Set the N mode only on the router and test with one device on N mode only. Then graduate adding devices and see if how the router handles.
Turn off Short GI as it's not needed and makes the connection on N mode a bit slower.
Maybe someone can review your router settings with you using
teamviewer..