It is possible, but with some dirty hacks. I've been working on a plugin which does this for some time now. It works, but is restricted
Posted this elsewhere some time ago, not the latest version but it still is proof of concept:
https://www.youtube.com/watch?v=KoLW6-iQqdk
The view model becomes server-sided but seems to be alright, may look worse than it is because of the sounds being messed up (is now fixed)