The read access time on a hash table grows sublinear with size, but still grows.
Write access - to insert new values - is significantly worse. Especially when you have many workers, which you do when every site connects to the same redis.
And you usually want persistence for the session cache...