It's a possibly useful behavior while viewing PDFs, but for me it's absolutely undesired for any kind of photo, including those for contacts.
You know what would be better? If it reduced the brightness for any image it considers too bright. That's still recognizeable and better-looking than reversing their colors.