Given that it includes a rainbow individual colour manipulation is very difficult without making the rainbow look strange.
Could you make the rainbow region transparent, play with the rest of the image, and then recombine with the rainbow original? (Divide and conquer.)