Hmm, it might just be easier to move the DVD player back and forth if you're watching in one room more than the other.
If you want to connect both TVs, it'll depend on the DVD player since DVD players have different input types. Purchase a 1-to-2 AV splitter, which can essentially split the signal two ways, and then connect both TVs through the splitter.
Make certain that you get the correct type of splitter based upon your signal type. For example, your DVD player may need either a composite or HDMI splitter type.