Performance Problems when selecting HUGE amounts of data from MySQL dbs

Wed Jan 9 10:53:28 EST 2002

-----BEGIN PGP SIGNED MESSAGE-----

Hello Skip,

9 Jan 2002, 16:45:45, you wrote:
>     Gabriel> but this is way too slow.

> How about

>     db.execute("SELECT myfield FROM table")
>     data=db.fetchall()
>     giantstring=[]
>     for record in data:
>         giantstring.append(record)
>     giantstring = "".join(giantstring)

How's that different from
      [...]
      data=db.fetchall()
      data="".join(data)?
which I assume should be way faster as it doesn't need to copy the
data to another list first (which is nice from a memory requirement
point of view as well)?

I was thinking about using that particular solution, but then
mysql-python
wouldn't provide me with fetchall() and fetchallDict() in the same
instance but maybe this works in 0.9.1 to which I just upgraded...
[1]

Best regards,
 Gabriel
[1] Might also be my own fault, who knows...