What is your CAN baud rate?
What is your CAN clock source?
CAN is (ideally) a 'guaranteed delivery' message system, with ACK and NAK at a hardware level to insure that ALL bus receivers get a valid message (within the limits of CRC checking, of course). And thus, as you say, any 'unhappy receiver' should send a NAK error that will cause ALL receivers to discard, and TX to re-send. This all relies on EXACT clock timing, though.