Funny, my first thought was that this would be much easier to answer by accident! Since it only requires a tap and not a swipe, it seems to me like a pocket answer or rejection would be a lot more likely to happen without the phone owner even knowing.
No.