 amery
|
be53431904
|
lexer: to simplify states, Lexer.EmitError() assumes EOF if nil is passed
Signed-off-by: Alejandro Mery <amery@jpi.io>
|
2021-07-04 03:02:43 +01:00 |
|
|
amery
|
3edf777c68
|
lexer: add Lexer.AtLeast() to gather input data from the Feeder
Signed-off-by: Alejandro Mery <amery@jpi.io>
|
2021-07-04 00:40:22 +01:00 |
|
|
amery
|
36427e059f
|
lexer: add initial generic Lexer
Signed-off-by: Alejandro Mery <amery@jpi.io>
|
2021-07-03 20:36:55 +01:00 |
|
|
amery
|
90e9fc47cf
|
lexer: add Step()/NewLine()/Reset() methods to TokenPosition
Signed-off-by: Alejandro Mery <amery@jpi.io>
|
2021-07-03 19:59:25 +01:00 |
|
|
amery
|
6e05cdbb28
|
lexer: add generic Token
Signed-off-by: Alejandro Mery <amery@jpi.io>
|
2021-07-03 18:02:49 +01:00 |
|