If you want to install a new VirtueMart theme, then you should upload its folder including all the files in the components/com_virtuemart/themes directory.
Next navigate to your Joomla administrator area-> Components-> VirtueMart-> Admin->Configuration->Site and choose the new theme from the Select the theme for your Shop drop down menu.
Save the changes.