tree 26d22fe0672d754636b44b522130612192a09363
parent c87144f3caf9a1580e8734d4d1604e723a5bd6e6
parent 728572440171d8d9c0557c89c3d71cc8d7cf6c2e
author Mazdak Farrokhzad <twingoow@gmail.com> 1547904077 +0100
committer GitHub <noreply@github.com> 1547904077 +0100
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsBcBAABCAAQBQJcQyRNCRBK7hj4Ov3rIwAAdHIIAGoJzk9Cp1M0KjkDyGowH/8A
 aL4habJFR0qfSYa/CpsoG1wmdsPBdrZ5V/6SA0LPUMeGfSEWexv1nHayGZhLVEKO
 FCJhiYasbipI5DK3VYK9JkpVkd6qWb84X/wm0waHPhCdG5vduKkJoeS0Y5t7YkS2
 GnN1upMQftTuZwjU3qeI+Q1t2UgdOn16WzwTHr9U53ZnEWFXZ5JZ0TINjLaMzoEd
 qqCPy0X9S6+RhKoUzagll7x/lchuIwoLrZGED99KPsXI/dQGoWEiLvDq8SyPBtMy
 xSbm24dPqADkmLAp3CnvxA6fWhvj2V72xSVTaB2n6+P9pR+jNqxkKYFv6OS2aAg=
 =7IJu
 -----END PGP SIGNATURE-----
 

Rollup merge of #57486 - nnethercote:simplify-TokenStream-more, r=petrochenkov

Simplify `TokenStream` some more

These commits simplify `TokenStream`, remove `ThinTokenStream`, and avoid some clones. The end result is simpler code and a slight perf win on some benchmarks.

r? @petrochenkov