Why is difficulty goes up and down so much

I know it has to do with the amount of miners that are trying to get the reward but does that mean that miners keep switching between rvn and whatever coin they want ? It seems impossible that my projected earnings moves from 98 to 130 a day on the same day.