[Pandas-dev] Faster .apply natively

Pietro Battiston me at pietrobattiston.it
Sat Nov 21 13:50:23 EST 2020


Dear Abdur,

I never tried pandarallel, so I don't know how it compares, but it's
definitely possible to do a parallel .apply with 5 lines of code and
the standard multiprocessing library:
https://stackoverflow.com/a/29281494

Does this answer your question?

Pietro

Il giorno sab, 21/11/2020 alle 09.31 +0400, Abdur-Rahmaan Janhangeer ha
scritto:
> Greetings list,
> 
> I would like to know if there are plans on working
> on a faster .apply . A normal NLP function of 
> reducing a sentence to it's essential lowercase version
> in 10 lines of list-comprehension processing takes an 
> eternity for the ten of thousands rows.
> 
> There are some 6 solutions like pandarallel etc which
> allows faster processing. But any hints if there is ongoing
> works in that direction?
> 
> 
> Kind Regards,
> 
> Abdur-Rahmaan Janhangeer
> about | blog 
> github
> Mauritius
> _______________________________________________
> Pandas-dev mailing list
> Pandas-dev at python.org
> https://mail.python.org/mailman/listinfo/pandas-dev



More information about the Pandas-dev mailing list