@davidgerard @Edent I agree it should check robots.txt -- any site auto-pulling any data without a human at the controls should do that.