[pypy-commit] [Git][pypy/pypy][branch/py3.8] 46 commits: start with the walrus operator: tokenizing works! (twitch streaming, yay)

Carl Friedrich Bolz-Tereick foss at heptapod.net
Mon Jan 4 15:31:50 EST 2021 


Carl Friedrich Bolz-Tereick pushed to branch branch/py3.8 at PyPy / pypy


Commits:
b29a8b6e by Carl Friedrich Bolz-Tereick at 2020-12-30T19:21:04+01:00
start with the walrus operator: tokenizing works! (twitch streaming, yay)

--HG--
branch : some-3.8-features

- - - - -
71e9deb4 by Carl Friedrich Bolz-Tereick at 2020-12-30T19:58:21+01:00
walrus operator: add grammar productions, define new astnode type, add support in the astbuilder

--HG--
branch : some-3.8-features

- - - - -
5caf77d3 by Carl Friedrich Bolz-Tereick at 2020-12-30T20:09:15+01:00
walrus operator: add bytecode generation

--HG--
branch : some-3.8-features

- - - - -
4099934c by Carl Friedrich Bolz-Tereick at 2020-12-30T21:06:06+01:00
(cfbolz, isidentical, twitch around): walrus operator: in-progress, start to
deal with the complexities of list comprehensions

--HG--
branch : some-3.8-features

- - - - -
423da448 by isidentical at 2020-12-31T19:24:50+03:00
Implement f-string debugging expressions

--HG--
branch : fstring-debugging

- - - - -
0fc4205c by Matti Picus at 2021-01-01T01:20:20+02:00
revert wrong part of 065592640a92

--HG--
branch : py3.7

- - - - -
99578319 by Matti Picus at 2021-01-01T12:02:50+02:00
debug issue 3374

--HG--
branch : py3.7

- - - - -
701caa83 by isidentical at 2021-01-01T14:05:37+03:00
pytokenize: Support lexing of TYPE_COMMENTS

--HG--
branch : some-other-38-features

- - - - -
231288e7 by isidentical at 2021-01-01T14:06:31+03:00
pytokenizer: Add a test for TYPE_IGNORE tokenization

--HG--
branch : some-other-38-features

- - - - -
67b1cebc by isidentical at 2021-01-01T17:01:22+03:00
pyparser: 3.8 grammar, parser changes, ast builder for type_ignore

--HG--
branch : some-other-38-features

- - - - -
d69adec8 by isidentical at 2021-01-01T18:50:54+03:00
pyparser: Proper handling of full type_comment lines

--HG--
branch : some-other-38-features

- - - - -
952075b2 by isidentical at 2021-01-01T19:23:40+03:00
pyparser: Better handling for variadic argument comments

--HG--
branch : some-other-38-features

- - - - -
eb4aefd5 by isidentical at 2021-01-01T19:34:53+03:00
pyparser: Support keyword only parameters

--HG--
branch : some-other-38-features

- - - - -
ba2cbcd9 by isidentical at 2021-01-01T20:24:16+03:00
pyparser: Implement initial support for TYPE_IGNORES

--HG--
branch : some-other-38-features

- - - - -
ee00f262 by isidentical at 2021-01-01T20:57:51+03:00
ast: Support checking of optional-string fields / some test fixes

--HG--
branch : some-other-38-features

- - - - -
25d8bc0d by Carl Friedrich Bolz-Tereick at 2021-01-01T20:25:20+01:00
an intermediate branch:

since the 3.8 stdlib uses a lot of the 3.8 language features (walrus,
positional only arguments, etc) we can't bring up the branch py3.8 without
these new features. Hence, let's implement enough of them in this branch here,
which will keep the 3.7 stdlib.

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
73a5be23 by Carl Friedrich Bolz-Tereick at 2021-01-01T20:34:11+01:00
merge fstring-debugging

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
c8a1ab4c by isidentical at 2021-01-02T00:42:21+03:00
ast: Proper serialization of string/None

--HG--
branch : some-other-38-features

- - - - -
addd951a by isidentical at 2021-01-02T00:48:09+03:00
ast: Use proper none

--HG--
branch : some-other-38-features

- - - - -
54061070 by isidentical at 2021-01-02T01:16:37+03:00
ast: make test_validate compatible

--HG--
branch : some-other-38-features

- - - - -
1ea221b9 by isidentical at 2021-01-02T16:23:38+03:00
ast: make all ast tests working (one syntax error left)

--HG--
branch : some-other-38-features

- - - - -
1a38a9fd by isidentical at 2021-01-02T16:35:43+03:00
rpython: some rpython hacks

--HG--
branch : some-other-38-features

- - - - -
6989894c by isidentical at 2021-01-02T17:26:22+03:00
pyparser: precise errors for func_body_suite

--HG--
branch : some-other-38-features

- - - - -
d80bb7bc by isidentical at 2021-01-02T17:42:52+03:00
ast: assert normal suite doesn't contain any type comments

--HG--
branch : some-other-38-features

- - - - -
6ecc4f1f by Carl Friedrich Bolz-Tereick at 2021-01-02T19:32:03+01:00
(cfbolz, twitch around): support passing named expressions as function arguments

--HG--
branch : some-3.8-features

- - - - -
d405f0c5 by Carl Friedrich Bolz-Tereick at 2021-01-02T19:43:55+01:00
(cfbolz, twitch): implement more cases for list comprehension and named expressions

--HG--
branch : some-3.8-features

- - - - -
394f0e15 by Carl Friedrich Bolz-Tereick at 2021-01-02T19:49:55+01:00
(cfbolz, twitch around): prevent the named expression target to be something other than a name

--HG--
branch : some-3.8-features

- - - - -
9ac8c819 by Carl Friedrich Bolz-Tereick at 2021-01-02T20:13:11+01:00
(cfbolz, twitch around): produce a syntax error when we try to assign the
iteration variable of a list comprehension using a named expression

--HG--
branch : some-3.8-features

- - - - -
8cef449d by Carl Friedrich Bolz-Tereick at 2021-01-02T20:18:16+01:00
(cfbolz, twitch around): get rid of the is_comprehension flag and use a subclass instead

--HG--
branch : some-3.8-features

- - - - -
91221e50 by Carl Friedrich Bolz-Tereick at 2021-01-02T20:35:11+01:00
(cfbolz, twitch around): catch another error case

--HG--
branch : some-3.8-features

- - - - -
033706e9 by Carl Friedrich Bolz-Tereick at 2021-01-02T21:07:36+01:00
(cfbolz, twitch around): produce an error in another corner case of named
expressions: forbid them in the iterator expression of comprehensions

--HG--
branch : some-3.8-features

- - - - -
ba2466fe by Carl Friedrich Bolz-Tereick at 2021-01-02T21:08:26+01:00
(cfbolz, twitch around): improve the error message for forbidden named
expression targets: show the type of thing we are trying to assign to

--HG--
branch : some-3.8-features

- - - - -
2ef2f928 by isidentical at 2021-01-03T15:26:19+03:00
pyparser: Orderless sorting

--HG--
branch : some-other-38-features

- - - - -
1c1c31bd by Carl Friedrich Bolz-Tereick at 2021-01-03T13:03:27+00:00
Merge branch 'branch/some-other-38-features' into 'branch/py3.8-with-3.7-stdlib'

Implement typed_ast (native support for type_comments)

See merge request pypy/pypy!791

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
7dc1268d by Carl Friedrich Bolz-Tereick at 2021-01-03T14:11:25+01:00
document merged branches

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
79c4fff6 by Carl Friedrich Bolz-Tereick at 2021-01-03T15:55:02+01:00
merge some-3.8-features: support the walrus operator/named expressions

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
d7050194 by Carl Friedrich Bolz-Tereick at 2021-01-03T15:58:55+01:00
document the walrus operator (this time in the correct file)

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
085b19d3 by Carl Friedrich Bolz-Tereick at 2021-01-04T06:56:33+01:00
fix a bug in the new fstring-debugging code

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
17d8ccca by Carl Friedrich Bolz-Tereick at 2021-01-03T22:33:57+01:00
implement positional-only arguments

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
8d6e98b8 by Carl Friedrich Bolz-Tereick at 2021-01-04T07:27:52+01:00
fix test

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
6064a08c by Carl Friedrich Bolz-Tereick at 2021-01-04T08:13:54+01:00
fix interaction of positional only arguments and **kwargs

--HG--
branch : py3.8-with-3.7-stdlib

- - - - -
e6615975 by Carl Friedrich Bolz-Tereick at 2021-01-04T20:48:43+01:00
add some minimal things that are needed to get 3.8 started: _io.open_code and sys.pycache_prefix (always None so far)

--HG--
branch : py3.8

- - - - -
c5beed18 by Carl Friedrich Bolz-Tereick at 2021-01-04T20:49:46+01:00
for now, revert opcode.py to be like under 3.7 to allow anything at all to run

--HG--
branch : py3.8

- - - - -
028228f4 by Carl Friedrich Bolz-Tereick at 2021-01-04T20:50:40+01:00
merge py3.8-with-3.7-stdlib: implement a number of 3.8 features

- walrus operator
- positional only arguments
- typed_ast

--HG--
branch : py3.8

- - - - -
9ee89a7d by Carl Friedrich Bolz-Tereick at 2021-01-04T21:29:09+01:00
a minimal dummy sys.audit function that does nothing

--HG--
branch : py3.8

- - - - -
94dd1a20 by Carl Friedrich Bolz-Tereick at 2021-01-04T21:29:32+01:00
add token.EXACT_TOKEN_TYPES

--HG--
branch : py3.8

- - - - -


30 changed files:

- lib-python/3/opcode.py
- lib-python/3/test/libregrtest/main.py
- pypy/doc/whatsnew-head.rst
- pypy/doc/whatsnew-pypy3-head.rst
- pypy/interpreter/argument.py
- pypy/interpreter/astcompiler/assemble.py
- pypy/interpreter/astcompiler/ast.py
- pypy/interpreter/astcompiler/astbuilder.py
- pypy/interpreter/astcompiler/codegen.py
- pypy/interpreter/astcompiler/consts.py
- pypy/interpreter/astcompiler/fstring.py
- pypy/interpreter/astcompiler/symtable.py
- pypy/interpreter/astcompiler/test/test_ast.py
- pypy/interpreter/astcompiler/test/test_astbuilder.py
- pypy/interpreter/astcompiler/test/test_compiler.py
- pypy/interpreter/astcompiler/test/test_symtable.py
- pypy/interpreter/astcompiler/test/test_validate.py
- pypy/interpreter/astcompiler/tools/Python.asdl
- pypy/interpreter/astcompiler/tools/asdl_py.py
- pypy/interpreter/astcompiler/validate.py
- pypy/interpreter/pycode.py
- + pypy/interpreter/pyparser/data/Grammar3.8
- pypy/interpreter/pyparser/dfa_generated.py
- pypy/interpreter/pyparser/gendfa.py
- pypy/interpreter/pyparser/parser.py
- pypy/interpreter/pyparser/pygram.py
- pypy/interpreter/pyparser/pyparse.py
- pypy/interpreter/pyparser/pytoken.py
- pypy/interpreter/pyparser/pytokenizer.py
- pypy/interpreter/pyparser/test/test_pyparse.py


View it on GitLab: https://foss.heptapod.net/pypy/pypy/-/compare/9dc523ea3292822bb01d94efab083c3a0d1fc000...94dd1a20ebdb02e0f042f7b6495a0e1dcbe16c55

-- 
View it on Heptapod: https://foss.heptapod.net/pypy/pypy/-/compare/9dc523ea3292822bb01d94efab083c3a0d1fc000...94dd1a20ebdb02e0f042f7b6495a0e1dcbe16c55
You're receiving this email because of your account on foss.heptapod.net.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.python.org/pipermail/pypy-commit/attachments/20210104/976a4a9f/attachment-0001.html>

More information about the pypy-commit mailing list