There isn't currently a way to disable access to certain IPs from within ListMail. You might have some success adding a line such as follows to the top of your admin.php anywhere after the opening PHP tag "<?php"
if($_SERVER['REMOTE_ADRR']=='12.34.56.78') exit;