BeautifulSoup doesn't work with a threaded input queue?
Christopher Reimer
christopher_reimer at yahoo.com
Sun Aug 27 16:35:06 EDT 2017
On 8/27/2017 1:12 PM, MRAB wrote:
> What do you mean by "queue (random order)"? A queue is sequential
> order, first-in-first-out.
With 20 threads requesting 20 different pages, they're not going into
the queue in sequential order (i.e., 0, 1, 2, ..., 17, 18, 19) and
coming in at different times for the parser worker threads to get for
processing.
Similar situation with a list but I sort the list before giving it to
the parser, so all the items are in sequential order and fed to the
parser one at time.
Chris R.
More information about the Python-list
mailing list