This is not a first, really. IBM's Watson affected similar head scratching among engineers.
Alex Trebek: "A tiresome lecture, delivered by a frothy pie topping"
Watson: "What is a Meringue Harangue?"
How did Watson know that? Don't ask IBM, they have no idea.
What I didn't expect is for Google to so openly talk about how this will lead to expert systems, reducing their demand for domain experts made out of meat. Google pays a lot of money for the best and brightest, but if that turns out to be their own systems, then so be it. The #RaceAgainstTheMachine is heating up for PhDs as much as it is for more traditional knowledge workers like travel agents.
I'm not scared by the sensational title, and neither should anyone else be; If we insisted on understanding how our AI's arrived at their conclusions, we would have no hope of ever making anything very useful, much less something smarter than ourselves.