As standard, you will be mapping controls to the buttons and axes on your controller exactly like you do with keyboard and mouse. If you do this, you might need to use a program called Joy2Key.
We’ve had wiimote and kinect control before (there’s youtube vids of it); anything’s really possible if somebody is willing to do the scripting. I know for a fact there is a wire addon specifically for joystick inputs, and I wouldn’t be suprised if there’s something already made specially for normal play using gamepads.
tl;dr it won’t work as you describe there, but with some addons and fiddling you could do it and it might have been done already if you search a bit.