I've read around that installing an Ubuntu desktop on top of an Ubuntu Server provides security holes and performance issues. But I can't find anywhere as to describe what security holes would develop from doing this? I am thinking of installing a light weight desktop such as Xubuntu. Can anyone explain further? What type of security holes? Do I need to be concerned?
All help is much appreciated!