Even if you have a clean list, that number of emails, especially if they are going to just a few ISPs, will get your server rate limited or blacklisted. In general, I recommend that email be split along these lines:
Transactional Emails
These are shipping notifications, password resets...