32-Bit 1.6.0_21 (Java Update 6 V21) Download: After a lot of experimenting, this version pretty much doesn't crash ever, especially after you follow the java allocation trick. Allocate more Memory to Java: 64-Bit 1.6.0_21 (Java Update 6 V21) x64 Download:
I've stickied this as it's pretty clear information. I can also suggest Java 7, however this is more CPU intensive compared to 6 (and is still in beta).