mopani, I have encountered the exact same problem. Still haven't figured out how to resolve it other than switching back to Apache, which in my case isn't an option because my VPS can't handle so much traffic as nginx does.
Do you have figured out a solution or what might cause the problem?