Not sure if it's my USB Connector or the VM or what but the DS just cannot connect. If I do it through a WFC DS game rather than DSi settings then it sometimes works but often not. Real weird.
EDIT: My VM doesn't actually show up in my router but I'm not getting any of the errors listed here...