The whole router was rebooting, not just wifi dropping. No, the Modem is fine. I would have to go look in the network cabinet to see the modem, but it is fine with the new TPLink router that I replaced this pile with.
The new TPLink never randomly reboots, it has 400+ MBps to speedtest consistently from the same laptop with no other changes. So this is for sure a DLink hardware issue.