lex builtin

lex(text)

Low-level lexer: like tokens but keeps spelling details for source transforms.

Example

@tt
  log(str(str(lex("a + 1"))))

Logs: [a, +, 1]

All builtins