Eh, weird, cause it works just fine for me over IPv6, the only difference is that I have my IPv6 IP address marked as shared and is assigned to my main domain, but able to access the panel just fine over it. Maybe try marking the IPv6 address as shared?