When building public-facing websites with SharePoint 2013 you should disallow anonymous users from overriding the Master Page on your website.