AST. Preserve token types of names in serialized ASTs.

Names in serialized ASTs were read back as `TokenType.STRING` tokens.
The V1 projection decides between `PrefixedIdentifier` and
`PropertyAccess` by the token type of the name, so `A.zero` in a
constant initializer projected as `PrefixedIdentifier` when the library
was linked, but as `PropertyAccess` when it was read from a bundle.

Now the type of each name token is written together with its lexeme,
and the reader restores a token of the same type, a `KeywordToken` for
keywords. So keyword names, such as `A.when`, and reserved words kept
by recovery, such as `A.class`, also round-trip.

The token type mapping was missing `augment`, `base`, `extension`,
`sealed`, `when`, the literal types with digit separators, `BAD_INPUT`,
and `RECOVERY`, so these are added, with a test that every token type
can be serialized. Synthetic name tokens built by `ElementBuilder` are
now `TokenType.IDENTIFIER`, so that a round trip doesn't restore them as
string literal tokens.

The SDK summary grows by 0.24%; stable_analysis instructions: local +0.009%, Golem presubmit +0.17%.

Change-Id: Ida01b1aa5d43041042efc4151914126f5fb3c0e2
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/568801
Commit-Queue: Konstantin Shcheglov <scheglov@google.com>
Reviewed-by: Paul Berry <paulberry@google.com>
11 files changed
tree: eda8112b913104f64944aa86ff4af75848924106
  1. .agents/
  2. .dart_tool/
  3. .github/
  4. benchmarks/
  5. build/
  6. docs/
  7. pkg/
  8. runtime/
  9. samples/
  10. sdk/
  11. tests/
  12. third_party/
  13. tools/
  14. utils/
  15. .clang-format
  16. .gitattributes
  17. .gitconfig
  18. .gitignore
  19. .gn
  20. .mailmap
  21. .style.yapf
  22. AUTHORS
  23. BUILD.gn
  24. CHANGELOG.md
  25. codereview.settings
  26. CONTRIBUTING.md
  27. DEPS
  28. LICENSE
  29. OWNERS
  30. PATENT_GRANT
  31. PRESUBMIT.py
  32. pubspec.yaml
  33. README.dart-sdk
  34. README.md
  35. sdk.code-workspace
  36. sdk_args.gni
  37. sdk_packages.yaml
  38. SECURITY.md
  39. WATCHLISTS
README.md

Dart

An approachable, portable, and productive language for high-quality apps on any platform

Dart is:

  • Approachable: Develop with a strongly typed programming language that is consistent, concise, and offers modern language features like null safety and patterns.

  • Portable: Compile to ARM, x64, or RISC-V machine code for mobile, desktop, and backend. Compile to JavaScript or WebAssembly for the web.

  • Productive: Make changes iteratively: use hot reload to see the result instantly in your running app. Diagnose app issues using DevTools.

Dart's flexible compiler technology lets you run Dart code in different ways, depending on your target platform and goals:

  • Dart Native: For programs targeting devices (mobile, desktop, server, and more), Dart Native includes both a Dart VM with JIT (just-in-time) compilation and an AOT (ahead-of-time) compiler for producing machine code.

  • Dart Web: For programs targeting the web, Dart Web includes both a development time compiler (dartdevc) and a production time compiler (dart2js).

Dart platforms illustration

License & patents

Dart is free and open source.

See LICENSE and PATENT_GRANT.

Using Dart

Visit dart.dev to learn more about the language, tools, and to find codelabs.

Browse pub.dev for more packages and libraries contributed by the community and the Dart team.

Our API reference documentation is published at api.dart.dev, based on the stable release. (We also publish docs from our beta and dev channels, as well as from the primary development branch).

Contributing to Dart

See the contribution guide for details.

Building Dart

If you want to build Dart yourself, here is a guide to getting the source, preparing your machine to build the SDK, and building.

There are more documents in our repo at docs.

Roadmap

Future plans for Dart are included in the combined Dart and Flutter roadmap on the Flutter wiki.