How to fix a loose controller port

Hmm, wired and wireless?

There's actually a separate chip that handles wireless signals.

This might be indicative of a larger problem, what exactly that is I can't tell you. Had a quick google and found nothing. Very unusual problem.

Try a power cycle

EDIT: If xbox one wireless controllers are anything like 360 controllers, when you plug them in via the usb they still actually connect wirelessly the usbs only transmit power. One second thought your wireless receiver may be defective.