Forking after the filter is already in place isn't a vote. It's damage control. The data deemed 'illegitimate' never made it to a block in the first place. Hash can't follow value it never saw.