I'm pretty sure you can change it to Static PPPoE, enter the DNS servers, and then change back to Dynamic PPPoE and the DNS entries will remain. Can't guarantee that they pass those on to each pc via DHCP however.
It's always best to enter your proper DNS servers in your router to prevent lots of weird issues rather than relying on the ISP to assign them properly.