Token produced by scanner.
32 bytes on 64-bit.
Get string representation of the token ID.
Type of directive for directiveToken.
Encoding, if this is a stream start token.
End position of the token in file/stream.
Start position of the token in file/stream.
Style of scalar token, if this is a scalar token.
Value of the token, if any.
Used to split value into 2 substrings for tokens that need 2 values (tagToken)