The the low level access to the SD card (SPI) is heavily depending on the SPI clock speed, and the SD card itself.
See http://elm-chan.org/fsw/ff/00index_e.html
I have seen slow SD cards which need up to 200 ms for a write operation, and even if you buy some consumer cards from the same brand, you might see variations.
See as well
http://elm-chan.org/fsw/ff/en/appnote.html
So not sure if you are using an expensive industrial SD card or a consumer SD card. And my experience is that some old (512 MByte) cards are sometimes better than the new big cards.
Additionally, writing performance might depend on the sector/area you are writing. So ultimately you do not have a guranteed and always the same writing time.
Additionally, writing the small chunks of data with 50 Hz sounds not economical to me. In my applications I'm not writing from an interrupt (that would be bad anyway). Instead, I buffer the data to be written and then write it say once a second. That greatly reduces the overhead of the system, as I can write data in blocks of 500 bytes or more.
I hope this helps,
Erich