You can safely turn the router off for a few minute since the settings are stored inside the router in "non-volatile" memory. Most of the setting are permanently stored in the router. You might only have to renew the IP address on the PCs after (either renew for Ethernet, reconnect for wireless.)