The Note 4 is better. The Spen is a great plus. I use it on the Note3. It is one of those things that is so natural to use you don't even notice you use it so much.
The features that make me want to upgrade are the cpu, the camera and the higher resolution screen.
The Nexus 9 looks more tempting from the Nexus family than the 6.