Skip to content

Python-inspector processes certain dependencies for way too long #106

Closed

Description

@bennati

Python inspector takes too much time to process certain requirements.txt

For example, the time to process these requirements is more than 1 hour, while the time to process each individually is less than 5 minutes:
``
boto3==1.10.16
s3fs
tabulate


and

boto3==1.10.16
s3fs
seaborn


Could it be caused by cyclical dependencies?

Activity

  1. pombredanne commented on Dec 13, 2022

    @pombredanne
    Member

    Thanks for the report. Can you tell which target OS-arch and Python version you have used?
    And which OS-arch and Python version you used to run python-inspector?

  2. bennati commented on Dec 13, 2022

    @bennati
    ContributorAuthor

    Hi, python inspector was run as follows:

    python-inspector --python-version 310 --operating-system linux --json-pdt /...json --analyze-setup-py-insecurely --requirement .../src/requirements.txt --verbose
    

    The host architecture is Linux and python 3.10

  3. pombredanne commented on Dec 13, 2022

    @pombredanne
    Member

    @bennati Thanks. The --analyze-setup-py-insecurely flags means things are live evaluated. We need to enable a verbose mode to trace what's going on.

  4. pombredanne commented on Dec 13, 2022

    @pombredanne
    Member

    there is some sorts of inifite loop IMHO

  5. pombredanne commented on Dec 13, 2022

    @pombredanne
    Member

    The culprit may be https://github.com/mwaskom/seaborn/blob/v0.8.1/setup.py but tabulate looks rather bland.

  6. bennati commented on Dec 21, 2022

    @bennati
    ContributorAuthor

    Any update on this? can I help somehow?

  7. pombredanne commented on Dec 21, 2022

    @pombredanne
    Member

    @bennati no update yet. Help would be mucho welcomed!

  8. bennati commented on Dec 23, 2022

    @bennati
    ContributorAuthor

    Opened PR upstream at resolvelib sarugaku/resolvelib#113

  9. pombredanne commented on Dec 23, 2022

    @pombredanne
    Member

    @bennati you rock! 🙇

  10. bennati commented on Jan 4, 2023

    @bennati
    ContributorAuthor

    Also related #110

  11. pombredanne commented on Feb 6, 2023

    @pombredanne
    Member

    sarugaku/resolvelib#113 by @bennati has been merged 🙇 ❤️ ... so we could likely start using it ASAP with "build from git"?... or wait a bit for a tag?

  12. bennati commented on Feb 6, 2023

    @bennati
    ContributorAuthor

    I would prefer asap… I was looking into submitting a PR which would use the latest resolvlib, but it seems to be an indirect dependency and I could not figure out which direct dependency to update

  13. bennati commented on Feb 7, 2023

    @bennati
    ContributorAuthor

    ok thanks, it looks like I had a typo in my search :)

  14. added a commit that references this issue on Feb 23, 2023
  15. sschuberth commented on Mar 22, 2023

    @sschuberth
    Contributor

    Hmm, apparently python-inspector 0.9.6 was published to PyPI yesterday which is supposed to fix this issue, but there is no such release yet at https://github.com/nexB/python-inspector/releases. @TG1999 can we please also get a GitHub release entry with release notes to be able to close this in good conscience?

  16. TG1999 commented on Mar 22, 2023

    @TG1999
    Contributor
  17. sschuberth commented on Mar 22, 2023

    @sschuberth
    Contributor

    Thanks @TG1999, so are we good to close this issue? If yes please do so.

  18. added a commit that references this issue on Dec 1, 2023
  19. mjherzog commented on Jul 25, 2025

    @mjherzog
    Member

    Closing as resolved with v0.9.6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions