Xenni,
Thanks for all of your suggestions, I'm just glad to know what specific part was giving me an issue.
See attached pictures of the wiring. I'm still pretty new to soldering on all of the vias, so it could be that the USB is not wired that well. I especially hated soldering to the vias...