tree 9cdf70353a06bfa5a19e700f86e06dfe3f213f9b
parent 42334a7f67e4b6a229c7d34da12cdf8e7661152d
author danrubel <danrubel@google.com> 1558126791 +0000
committer commit-bot@chromium.org <commit-bot@chromium.org> 1558126791 +0000

revise scanner api so that error tokens are always prepended

This CL revises the scanner API so that tokens are always prepended
to the beginning of the token stream. This allows the parser handling
of error tokens to be simplified. Any clients using the scanner directly
rather than through the scanner API should call scannerRecovery
if the scanner has detected errors in the content.

Change-Id: I32510da10205bd964f80898a238489d1508733e6
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/102680
Reviewed-by: Brian Wilkerson <brianwilkerson@google.com>
Commit-Queue: Dan Rubel <danrubel@google.com>