Stupid, stupid, stupid...

Note to self: when building Xen VMs, choose the manual IP configuration and add that IP to the exceptions list on the firewall (the part that I forgot). Took two hours to figure that out.