Very interesting, thanks. It seems to me that the problem is not the number of flops per second anymore, it is the architecture of the processors. They should adapt themselves to the new concepts, like Neural Networks.