They're not "boycotting the US", they are afraid to visit an authoritarian regime that is arbitrarily detaining people at the border and persecuting minorities they may be a part of because a whole bunch of their governments have issued travel advisories about it.
Admittedly, the whole "legitimately fearing for your life and bodily autonomy" part is a real good motivator for a "boycott", but the word may be a bit of a stretch at that point. You don't see the US press going "foreign tourists boycotting Russia", do you?