Perhaps there is a way to do achieve what you want with AppArmor
Since i cant find an easy way to do it, id say that you can 'play' with files permissions.
- Create a group or simply use the built-in vboxusers
- Change ownership of virtualbox files and launcher(s)
- Change perms of virtualbox files
- Add you permitted user(s) to the group created in (1)
``
# 1 # Create a group
sudo addgroup vboxpermitted
# add current user to the new group
useradd -g vboxpermitted $USER
# 2 # Change ownership
sudo chown -R root:vboxpermitted /usr/lib/virtualbox/*
sudo chown root:voxpermitted /usr/share/applications/virtualbox.desktop
# 3 # Customize execute rights (not for all, but for group)
find /usr/lib/virtualbox/ -type f -exec sudo chmod a-x {} \;
chmod 640 /usr/share/applications/virtualbox.desktop
# 4 # Add permitted user(s) to new group
adduser -g vboxpermitted <username>