Why is it not uncommon to get noise out of a perfecty working amplifier or
signal processor, even when plugging in another type gets rid of the
noise?

Some pieces are more susceptible to ground loops and other types of noise
sources than other pieces.