Bulls, along with all other cattle, are color-blind to red. Thus, the bull is likely irritated not by the muleta’s color, but by the cape’s movement as the matador whips it around.