Since the tokenizer is decoupled from the parser, there's no good way to do this. Also without attempting to parse the last line, it's impossible to say if it is junk data or simply a missing trailing new line.
Since the tokenizer is decoupled from the parser, there's no good way to do this. Also without attempting to parse the last line, it's impossible to say if it is junk data or simply a missing trailing new line.