Repository navigation
Hundread of files that are properly parsed(or not) in opposite to Python 3.11.2 #66
Description
When parsing with this repo multiple files, I found that sometimes python cannot parse file but this library can and vice versa.
Command to check if python can parse file
python -m py_compile PY_FILE_TEST_427160.py
Code to check if parser can parse file
let rust_valid = parse(content.as_str(), Mode::Module,"").is_ok();
Only ~3% files from pack, can be parsed by python, but not rustpython parser
Pack 644 files - OUTPUT_FILES.zip
Example files and errors
return imprt
SyntaxError: 'return' outside function
\
import _pl
Sorry: IndentationError: unexpected indent (79285088PY_FILE_TEST_5137609254.py, line 2)
# encoding: ut
SyntaxError: unknown encoding: ut
__p|ersion__ = '2.9.0'
SyntaxError: cannot assign to expression here. Maybe you meant '==' instead of '='?
from __future__ import un
SyntaxError: future feature un is not defined
Activity
DimitrisJim commentedon May 23, 2023
Compilation involves further processing. Something might be valid syntactically but in later stages the compiler might reject it due to additional rules that come into play when bytecode is to be generated.
This comparison might make more sense using the rest of the implementation in RustPython whereby you can actually test compile vs compile instead of compile vs parse.
If you only care about parsing, you could re-do the test using CPython's parser.
I'll close for now, feel free to open again if I missed something or if you re-run the test with CPython's parser and you do actually find discrepancies. Thanks!
youknowone commentedon May 23, 2023
@DimitrisJim Because we actually have parser incompatibility, the test set looks very useful.
@qarmin Rather than py_compile, using ast will make more sense to exclude compile step
youknowone commentedon May 24, 2023
@qarmin Do you know about the license of the test set? It will be helpful if we can include it to our test suite.
qarmin commentedon May 24, 2023
This files(or minimized part of them) I took from most popular pypi libraries, so licenses are mixed.
How to parse file in python?
Chatgpt provide this solution, but don't know if this is proper
qarmin commentedon May 28, 2023
When using
ast.parse(from above example) insteadpy_compileI got different set of invalid filesOutputASTInvalid.zip
youknowone commentedon May 29, 2023
Thanks a lot! I am sorry for late response. I am also trying to make a tool to do it easier.
youknowone commentedon May 29, 2023
You can make a compatibility test like this:
http://github.com/RustPython/Parser/pull/75/files#diff-44ab11717bbf68e3aa212e22772a18520ff7c749632213defcaecacdd1f6ecaa