Works on a per-email basis.

If you want one image and multiple email addresses you can do this. You can also choose which Gravatar per email address if you want. Here is a screenshot of my own account - https://d.pr/i/6X0gWx