From kevin.buckley.pawsey.org.au at gmail.com Wed Jan 15 22:41:31 2020 From: kevin.buckley.pawsey.org.au at gmail.com (Kevin Buckley) Date: Thu, 16 Jan 2020 11:41:31 +0800 Subject: [Matplotlib-users] Running matplotlib on massively parallel compute resources Message-ID: We've recently seen an issue where someone running multiple instances of jobs on our supercomputer, all of which have a matplotlib component that thus runs on the compute nodes, rather than as part of any post-processing on our anciliary services. Some of these jobs ended up hanging and, in a number of cases, we have observed that the hanging process is what we belive to be the matplotlib- spawned fc-list --format=%{file}\n Is there anything, in the way that matplotlib is written, that might see race conditions, around access to the per-user font cache, or other matplotlib data, being created? Furthermore, is there a way that our users could define a per-job font cache directory, by using the job-ID, and thereby explcitly avoiding any inter-job interference resulting from their "massively parallel" matplotlib invocations? Here's hoping that matplotlib is the cause, and, if so, that there's an easy solution, when you know how to use matplotlib. From antony.lee at institutoptique.fr Fri Jan 17 04:39:29 2020 From: antony.lee at institutoptique.fr (Antony Lee) Date: Fri, 17 Jan 2020 10:39:29 +0100 Subject: [Matplotlib-users] Running matplotlib on massively parallel compute resources In-Reply-To: References: Message-ID: I think setting the MPLCONFIGDIR environment variable to a user-writable directory should be good enough. There's an open PR ( https://github.com/matplotlib/matplotlib/pull/15933) which adds a warning in the case where that's needed. Antony On Thu, Jan 16, 2020 at 4:41 AM Kevin Buckley < kevin.buckley.pawsey.org.au at gmail.com> wrote: > We've recently seen an issue where someone running multiple instances > of jobs on our supercomputer, all of which have a matplotlib component > that thus runs on the compute nodes, rather than as part of any > post-processing on our anciliary services. > > Some of these jobs ended up hanging and, in a number of cases, we have > observed that the hanging process is what we belive to be the matplotlib- > spawned > > fc-list --format=%{file}\n > > Is there anything, in the way that matplotlib is written, that might > see race conditions, around access to the per-user font cache, or > other matplotlib data, being created? > > Furthermore, is there a way that our users could define a per-job font > cache directory, by using the job-ID, and thereby explcitly avoiding > any inter-job interference resulting from their "massively parallel" > matplotlib invocations? > > Here's hoping that matplotlib is the cause, and, if so, that there's an > easy solution, when you know how to use matplotlib. > _______________________________________________ > Matplotlib-users mailing list > Matplotlib-users at python.org > https://mail.python.org/mailman/listinfo/matplotlib-users > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kevin.buckley.pawsey.org.au at gmail.com Mon Jan 20 01:06:54 2020 From: kevin.buckley.pawsey.org.au at gmail.com (Kevin Buckley) Date: Mon, 20 Jan 2020 14:06:54 +0800 Subject: [Matplotlib-users] Running matplotlib on massively parallel compute resources In-Reply-To: References: Message-ID: <64db60bc-5b9e-cf18-6e6e-2d3ea37eff97@gmail.com> On 2020/01/17 17:39, Antony Lee wrote: > I think setting the MPLCONFIGDIR environment variable to a user-writable > directory should be good enough.? There's an open PR > (https://github.com/matplotlib/matplotlib/pull/15933) > which adds a warning in the case where that's needed. > Antony Cheers for that, Antony: seems to do what's needed. I had seen references to MPLCONFIGDIR in a number of threads relating to matplotlib but hadn't quite worked out it it was what we needed. Kevin From jslavin at cfa.harvard.edu Wed Jan 22 15:31:57 2020 From: jslavin at cfa.harvard.edu (Slavin, Jonathan) Date: Wed, 22 Jan 2020 15:31:57 -0500 Subject: [Matplotlib-users] package needed to use Qt5Agg backend Message-ID: Hi, I've been using matplotlib with the Qt5Agg backend on my desktop for some time now using conda. I'm also running on NASA HPC systems and wanting to do analysis on their system without copying my data over. They have matplotlib installed but apparently not the package needed to use Qt5Agg as a backend. Can anyone tell me what package they would need to install for Qt5Agg to work? They use a module system (not to be confused with python modules!) whereby a whole set of packages are loaded (which I guess means that environment variables and paths are set) that make software available to use. This is common on high performance clusters. Regards, Jon -- Jonathan D. Slavin Astrophysicist - High Energy Astrophysics Division Center for Astrophysics | Harvard & Smithsonian Office: (617) 496-7981 | Cell: (781) 363-0035 60 Garden Street | MS 83 | Cambridge, MA 02138 -------------- next part -------------- An HTML attachment was scrubbed... URL: From nathan.goldbaum at gmail.com Wed Jan 22 15:39:51 2020 From: nathan.goldbaum at gmail.com (Nathan) Date: Wed, 22 Jan 2020 13:39:51 -0700 Subject: [Matplotlib-users] package needed to use Qt5Agg backend In-Reply-To: References: Message-ID: They'll need pyqt5: https://pypi.org/project/PyQt5/ When I had an account on a NASA HPC resource I found that it was generally much easier to just have a conda environment in my home folder (or if that got too big on a scratch disk). They do have pretty responsive help staff but even with that it's still a lot of effort to get them to change or update modules. On Wed, Jan 22, 2020 at 1:32 PM Slavin, Jonathan wrote: > Hi, > > I've been using matplotlib with the Qt5Agg backend on my desktop for some > time now using conda. I'm also running on NASA HPC systems and wanting to > do analysis on their system without copying my data over. They have > matplotlib installed but apparently not the package needed to use Qt5Agg as > a backend. Can anyone tell me what package they would need to install for > Qt5Agg to work? > > They use a module system (not to be confused with python modules!) whereby > a whole set of packages are loaded (which I guess means that environment > variables and paths are set) that make software available to use. This is > common on high performance clusters. > > Regards, > Jon > > -- > Jonathan D. Slavin > Astrophysicist - High Energy Astrophysics Division > Center for Astrophysics | Harvard & Smithsonian > Office: (617) 496-7981 | Cell: (781) 363-0035 > 60 Garden Street | MS 83 | Cambridge, MA 02138 > > > _______________________________________________ > Matplotlib-users mailing list > Matplotlib-users at python.org > https://mail.python.org/mailman/listinfo/matplotlib-users > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jslavin at cfa.harvard.edu Wed Jan 22 16:16:40 2020 From: jslavin at cfa.harvard.edu (Slavin, Jonathan) Date: Wed, 22 Jan 2020 16:16:40 -0500 Subject: [Matplotlib-users] package needed to use Qt5Agg backend In-Reply-To: References: Message-ID: Hi Nathan, I wasn't sure I could do that, but they confirmed that I can. Seems like the easiest way. Thanks, Jon On Wed, Jan 22, 2020 at 3:40 PM Nathan wrote: > They'll need pyqt5: > > https://pypi.org/project/PyQt5/ > > When I had an account on a NASA HPC resource I found that it was generally > much easier to just have a conda environment in my home folder (or if that > got too big on a scratch disk). They do have pretty responsive help staff > but even with that it's still a lot of effort to get them to change or > update modules. > > On Wed, Jan 22, 2020 at 1:32 PM Slavin, Jonathan > wrote: > >> Hi, >> >> I've been using matplotlib with the Qt5Agg backend on my desktop for some >> time now using conda. I'm also running on NASA HPC systems and wanting to >> do analysis on their system without copying my data over. They have >> matplotlib installed but apparently not the package needed to use Qt5Agg as >> a backend. Can anyone tell me what package they would need to install for >> Qt5Agg to work? >> >> They use a module system (not to be confused with python modules!) >> whereby a whole set of packages are loaded (which I guess means that >> environment variables and paths are set) that make software available to >> use. This is common on high performance clusters. >> >> Regards, >> Jon >> >> -- >> Jonathan D. Slavin >> Astrophysicist - High Energy Astrophysics Division >> Center for Astrophysics | Harvard & Smithsonian >> Office: (617) 496-7981 | Cell: (781) 363-0035 >> 60 Garden Street | MS 83 | Cambridge, MA 02138 >> >> >> _______________________________________________ >> Matplotlib-users mailing list >> Matplotlib-users at python.org >> https://mail.python.org/mailman/listinfo/matplotlib-users >> > -- Jonathan D. Slavin Astrophysicist - High Energy Astrophysics Division Center for Astrophysics | Harvard & Smithsonian Office: (617) 496-7981 | Cell: (781) 363-0035 60 Garden Street | MS 83 | Cambridge, MA 02138 -------------- next part -------------- An HTML attachment was scrubbed... URL: From 2utkarsh at gmail.com Wed Jan 29 09:00:55 2020 From: 2utkarsh at gmail.com (Utkarsh Bisaria) Date: Wed, 29 Jan 2020 14:00:55 -0000 Subject: [Matplotlib-users] GSOC 2020 Message-ID: <5e318dba.1c69fb81.d2d62.7b50@mx.google.com> An HTML attachment was scrubbed... URL: From valentin.valls at esrf.fr Fri Jan 24 05:57:17 2020 From: valentin.valls at esrf.fr (Valentin Valls) Date: Fri, 24 Jan 2020 10:57:17 -0000 Subject: [Matplotlib-users] Display an Image in linear scale inside a log scale axis? Message-ID: <4b382f0a-67fd-4a14-31cb-2e1d4bf093a4@esrf.fr> Hi, I would like to know if somehow, there is a way to display an image without distortion (then in linear scale) inside a matplotlib axis in logscale. Basically the location of the left and the right of my image have to be at a specific location in the log axis, but in between pixels must have the same size. Is somebody have an idea? It is not for a static rendering, then i would prefer to not have data processing, and only deal with item descriptions. But in the end i will do what i can. And we can't create a new axis on the plot. Thanks in advance.