[code-quality] Pylint and multiprocessing

Johan Dahlin jdahlin at async.com.br
Thu Sep 19 13:04:05 CEST 2013


On Thu, Sep 19, 2013 at 6:14 AM, Sylvain Thénault <
sylvain.thenault at logilab.fr> wrote:

> On 18 septembre 23:17, Johan Dahlin wrote:
> > Hi,
>
> Hi Johan,
>
> > I'm Johan and I'm working on a python based ERP for the brazilian
> > market[1], it's written in Python. As part of our software development
> > process we run pyflakes/pep8/pylint/unittests/coverage validation
> _before_
> > each commit can be integrated into the mainline.
> >
> > The main bottleneck of this validation turns out to be pylint and I
> started
> > to investigate on how to use multiprocessing to speed that up.
>
> Indeed the pylint quality is definitly not speed :) Using multiprocessing
> sounds
> like a neat idea though.
>
> [snip]
>
> > Overall I think this is pretty positive for my use case, the total time
> of
> > running the validation steps went down from 7.5 minutes to 5.5 minutes or
> > so. The other parts of the validation can also be split out over
> different
> > processes, but that's for another time.
>
> Would you submit a pull-request on bitbucket [1] so we may discuss about
> your
> patch there? I'm definitly interested in having such feature, so I'll help
> you
> having it in a shape that may be integrated (no time guarantee though ;)
>

Sure, I had to create an account etc, hope I did everything
right, the pull request can be found here:

https://bitbucket.org/logilab/pylint/pull-request/55/add-multiprocessing-support/diff


-- 
Johan Dahlin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/code-quality/attachments/20130919/c8d5a2d7/attachment.html>


More information about the code-quality mailing list