I think "atheism" has nothing to do with castes. Caste is determined at birth itself, and the caste system is independent of whether one believes in a particular god like krishna, and by the same argument, atheists cannot disown caste.
In the final reckoning caste is more powerful than even god!