What's move to SD got to do with it? If anything his being on the Raw roster would only mean that he'd be seen by MORE viewers, no?
I do get what you're saying but I'd surmise that the casual fans you refer to represents the fluctuation in ratings, rather than the bulk of the average...