Commit Graph

3 Commits

Author SHA1 Message Date
amery 36427e059f lexer: add initial generic Lexer
Signed-off-by: Alejandro Mery <amery@jpi.io>
2021-07-03 20:36:55 +01:00
amery 90e9fc47cf lexer: add Step()/NewLine()/Reset() methods to TokenPosition
Signed-off-by: Alejandro Mery <amery@jpi.io>
2021-07-03 19:59:25 +01:00
amery 6e05cdbb28 lexer: add generic Token
Signed-off-by: Alejandro Mery <amery@jpi.io>
2021-07-03 18:02:49 +01:00