Indeed, the Tektronix MSO5X Series.lvlib::Read (Single Waveform).vi is not supporting the Spectum View acquisitions, therefore providing the wrong decoding of the binary data.
Instead than inquiring ENCDG or BN_FMT parameter for the decoding, the vi choose the decoding based on the DATa:SOUrce argument provided.
However, the CH<x>_SV or CH<x>_SV_AVE cases are not treated at all, therefore the channel is interpreted as a CH<x> with integer encoding.
It is a bit of a shame that the Tektronix MSO5X Series LabView library is so poorly scalable.
Ultimately, I was able to correctly decode the data by writing my own LabView code following the programmer manual.
To Tektroniks people: if you claim that with your oscilloscope "measuring a spectrum has never been so easy", you should consider to add examples to read Spectrum View acquisitions in binary format in the next revision of the programming manual.