What is the difference between a VPS and Web Hosting (shared)?

VPS is an isolated environment with your own resources whereas in a shared hosting environment the server resources are shared among all accounts on the server. In a shared environment, you are restricted to use the features enabled by your provider whereas in a virtual isolated private environment you are free to disable/enable features suitable for your website.