Function static_analyser::lex::tokenize_single_token

pub fn tokenize_single_token(data: &str) -> Result<(TokenKind, usize)>

Try to lex a single token from the input stream.