You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
typing: get_type_hints on stringified lone ClassVar raises TypeError #90711
class C:
a: "ClassVar"
get_type_hints(C, globals()) # TypeError: Plain typing.ClassVar is not valid as type argument
A stringified lone ClassVar raises at runtime, but this pattern is tested for in dataclasses unit tests and used in the wild. The PEP is not clear that it should or should not be used with arguments, and it works fine when not stringified.
The fix for this is trivial and I can submit a patch if there's agreement.
dataclasses is no doubt too lenient. But it's just trying to accept valid strings that look like ClassVar. Way back when this was initially implemented, we decided that calling get_type_hints would be too expensive for every dataclass, and would also neccesitate importing typing, which we didn't want to require.
I think someone needs to do an analysis of how expensive it would be for dataclasses to import typing and to call get_type_hints. Perhaps we'd make a different decision today.
GBeauregard commented on Jan 27, 2022
GBeauregardmannequin
MannequinAuthor
More actions
I'm drafting an implementation for the purpose of investigating performance right now; I will share when ready.
I'm not sure I like the agenda of "moving dataclasses to using typing.py introspection tools".
GBeauregard commented on Jan 28, 2022
GBeauregardmannequin
MannequinAuthor
More actions
It's acceptable to mypy, and pyright added support a few months ago when I made an issue and Eric Traut discovered this pattern in the wild too.
Some of the other type checkers (pyre) still error I believe. My feeling is that since this has apparently become used in practice we should fix the runtime error for when it's stringified, but we don't necessarily need to prescribe that it's a legal type annotation for type checkers (?). If I was prescribing how to use ClassVar in a vacuum, I don't see any good typing reason we should prohibit this.
re: moving dataclasses: I'm not sure either! I'm trying to look into the issues it brings up in practice to weigh against the difficulties of maintaining the existing bespoke introspection implementation and the problems it has (dealing with stringified annotations, supporting renaming the Annotated symbol).
I made an implementation that fully moves dataclasses over to using get_type_hints (and got all the tests to pass), but my feeling right now is that a few issues are too serious for it to be viable:
get_type_hints paints a wide brush on the entire class when it raises for errors, so it's not very viable to deal with non-typing non-Annotated[] annotations as a one-off
There's also nontechnical issues, like the potential politics of making dataclasses always import typing. I'll be updating bpo-46511 later with thoughts.
Please just don't go there. I beg you. It's not worth it.
GBeauregard commented on Jan 28, 2022
GBeauregardmannequin
MannequinAuthor
More actions
I think I miscommunicated my intent with sentence placement. I already posted the thoughts I referred to; they're just my concluding opinion on the technical merit of using get_type_hints in dataclasses to solve the Annotated problem: https://bugs.python.org/msg411945
In any case, I apologize for the faux pas and I'll be careful in the future.
I dug up the issue where pyright was changed (to allow bare ClassVar) that has an argument for not allowing it to be bare: microsoft/pyright#2377
Activity
GBeauregard commentedon Jan 27, 2022
A stringified lone ClassVar raises at runtime, but this pattern is tested for in dataclasses unit tests and used in the wild. The PEP is not clear that it should or should not be used with arguments, and it works fine when not stringified.
The fix for this is trivial and I can submit a patch if there's agreement.
GBeauregard commentedon Jan 27, 2022
I think this is needed for moving dataclasses to using typing.py introspection tools to be viable.
ericvsmith commentedon Jan 27, 2022
dataclasses is no doubt too lenient. But it's just trying to accept valid strings that look like ClassVar. Way back when this was initially implemented, we decided that calling get_type_hints would be too expensive for every dataclass, and would also neccesitate importing typing, which we didn't want to require.
I think someone needs to do an analysis of how expensive it would be for dataclasses to import typing and to call get_type_hints. Perhaps we'd make a different decision today.
GBeauregard commentedon Jan 27, 2022
I'm drafting an implementation for the purpose of investigating performance right now; I will share when ready.
gvanrossum commentedon Jan 27, 2022
It seems acceptable to mypy.
I'm not sure I like the agenda of "moving dataclasses to using typing.py introspection tools".
GBeauregard commentedon Jan 28, 2022
It's acceptable to mypy, and pyright added support a few months ago when I made an issue and Eric Traut discovered this pattern in the wild too.
Some of the other type checkers (pyre) still error I believe. My feeling is that since this has apparently become used in practice we should fix the runtime error for when it's stringified, but we don't necessarily need to prescribe that it's a legal type annotation for type checkers (?). If I was prescribing how to use ClassVar in a vacuum, I don't see any good typing reason we should prohibit this.
re: moving dataclasses: I'm not sure either! I'm trying to look into the issues it brings up in practice to weigh against the difficulties of maintaining the existing bespoke introspection implementation and the problems it has (dealing with stringified annotations, supporting renaming the Annotated symbol).
I made an implementation that fully moves dataclasses over to using
get_type_hints(and got all the tests to pass), but my feeling right now is that a few issues are too serious for it to be viable:There's also nontechnical issues, like the potential politics of making dataclasses always import typing. I'll be updating bpo-46511 later with thoughts.
gvanrossum commentedon Jan 28, 2022
Please just don't go there. I beg you. It's not worth it.
GBeauregard commentedon Jan 28, 2022
I think I miscommunicated my intent with sentence placement. I already posted the thoughts I referred to; they're just my concluding opinion on the technical merit of using get_type_hints in dataclasses to solve the Annotated problem: https://bugs.python.org/msg411945
In any case, I apologize for the faux pas and I'll be careful in the future.
I dug up the issue where pyright was changed (to allow bare ClassVar) that has an argument for not allowing it to be bare: microsoft/pyright#2377
gvanrossum commentedon Jan 28, 2022
I
To be clear: I am okay with this patch, just not with making dataclasses
import typing.
--Guido (mobile)
gvanrossum commentedon Jan 28, 2022
New changeset 5445e17 by Gregory Beauregard in branch 'main':
bpo-46553: allow bare typing.ClassVar annotations (bpo-30983)
5445e17
ericvsmith commentedon Mar 17, 2022
Is there any reason to keep this issue open? The PR was merged.