Just put the

<?php comments_popup_script() // Included javascript to open pop up windows ?>

between your head tags and ensure that you have _popup.php in /skins and /skins/yourskinname folders.