I think that what you are looking for is for a light desktop that you can start whenever you want (based in your comments) and that you can stop when you are done. For that before it was recommended gnome, but now the way to go is lxde or xfce. Is up to you what to install:
sudo apt-get --no-install-recommends install lxde-core xorg-core // If you want lxde
sudo apt-get --no-install-recommends install xfce4 xorg-core // If you want xfce
From there on, you should be able to use the startx
command to fire up a Xserver session.
For a headless server
For a headless server the procedure is almost the same, just that you might have to use SSH+VNC tunneling if the server is a remote location. There was already a question that was answered (several times) about how to do so, so I won't repeat the same again: https://askubuntu.com/a/7167/169736