, in a perfect voice controlled world, i would agree with what you're saying.
however, if we really think about what voice search is (even on android), it's nothing more than a faster way to get to the results page. once you're on the results page, we still have to do manual interaction with the computer/phone/tablet.
so in your example of holding the cat, yes, not having to do anything to search for something would be ideal. but then what? to continue on in your example, we'd then have to be able to say something like "scroll down the page, open the 5th link" in order to not move the cat.
of course, i'm sure google wants to be able to pop up a card with a definitive answer to the query, and it does in some instances, though we're a long way off from having a results page with no links and just answers.