Skip to content

Single threaded but uses pysam, so not single threaded #322

Open

Description

@schultzm

Hi,
Thanks for the package. I'm using PyVCF to parse out some VCFs from snpEff. It's a simple task, reading in some text (i.e., the vcf) and building a table and printing to stdout. As far as I can tell, at the initial parsing step (vcf.Reader(open(sys.argv[1], 'r'))), PySam is being used. Hence, this apparently single-threaded action is really multithreaded under the hood. I would like to run this package using gnu parallel, but this is causing problems on our 72 core 320GB server since I have no way to control the upper CPU limit. Each process (i.e., one read of a VCF file) is using upwards of 500% CPU (5 cores). I didn't ask it to do that and I can't prevent PyVCF from doing this. Is this a PySam problem?

Thanks.

Activity

  1. changed the title [-]Single threaded but uses pysam so not single threaded[/-] [+]Single threaded but uses pysam, so not single threaded[/+] on May 18, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions