I'm also not a graphic designer but I think can know where a lot of designers stand.

A design is not the result of some logical process. Design (as is the whole UX) is a way for an application to talk to humans: designing interfaces. Therefor I think this human touch (for example measured in how laggish/responsive an app feels vs the response time in ms) is key in creating applications for humans.