You seem to assume facts not in evidence. I've worked on a ton of networks, and been involved in several support forums for years doing network support. What you describe is NOT normal for any home network, even with a smart switch. The only scenario where you might get a measurable delay is a very sick machine or switch, or very heavy traffic.
You're making as many, or more assumptions than I am. Playing the odds, I would expect the DNS-321 or DNS-323 to respond to a ping within 100's of microseconds, and one of each model does indeed for me.
Just to see if it makes a difference, I started a large file transfer from both the DNS-321 and DNS-323 and then tried pinging them while the transfer was taking place.
Bottom line, the transfers made no difference in the ping times. I tried it both reading and writing to the units, same results.
Maybe you should just fix your network if you get different results.
Pinging dlink [192.168.0.142] with 32 bytes of data:
Reply from 192.168.0.142: bytes=32 time<1ms TTL=64
Reply from 192.168.0.142: bytes=32 time<1ms TTL=64
Reply from 192.168.0.142: bytes=32 time<1ms TTL=64
Reply from 192.168.0.142: bytes=32 time<1ms TTL=64
Ping statistics for 192.168.0.142:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 0ms, Maximum = 0ms, Average = 0ms
C:\Users\John Will>ping dns-321
Pinging dns-321 [192.168.0.143] with 32 bytes of data:
Reply from 192.168.0.143: bytes=32 time<1ms TTL=64
Reply from 192.168.0.143: bytes=32 time<1ms TTL=64
Reply from 192.168.0.143: bytes=32 time<1ms TTL=64
Reply from 192.168.0.143: bytes=32 time<1ms TTL=64
Ping statistics for 192.168.0.143:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 0ms, Maximum = 0ms, Average = 0ms