Make sure to refresh both the extensions page (chrome://extensions/) and the gmail tab after updating the settings.