You can dedicate you graphics card to the guest, but you need two GPUs for that (one for the host and one for the guest).
CPU passthrough seems to have no performance penalty and allows me to pass all of my cores through to the guest.
Will we see something like that for GPUs? What is the blocker for this sort of technology?