Controller user here (XboxOne) What I have done is add VS to my steam library and then used Steams controller input options for that game.
It's totally configurable in the steam app to assign the controller buttons to keyboard and mouse inputs. There was a bit of trail and error in getting it were I was happy with whilst also learning the game itself. The only time I need to use the keyboard now is "c" for the character status and I still have the up and down d-pad buttons unassigned.
I do use the mouse for inventory management and crafting because I find it a bit easier but both are entirely possible with the controller.