I remember finding a fix for this a while back and it worked on another machine but I can't seem to find it now.
Here's the bug report.
I was able to temporarily resolve the problem by adding symlinks to each Control Center area connecting Switchboard to Gnome Control Center .so objects, I think the parent folder was /usr/share/gnome-control-center or something like that - you can find out by running "$switchboard" in gnome terminal or guake and forcing it to crash to give you error feedback.
The other option I could see would be to edit the /usr/share/applications/GNOME_CONTROL_CENTER.desktop or whatever its named and add Pantheon to OnlyShowIn=Gnome;
This should allow you to simply use the Gnome Control Center instead of Switchboard.
Neither options that I listed are "Fixes", but you may decide to see if they are "good enough" to correct the issue for you.
I seriously hope ElementaryOS switches to Ubuntu Snappy as it might alleviate some of these software version issues especially now that Ubuntu 14.04 is considered "depreciated" as of today.