Using Python for processing of large datasets (convincing man agment)

Delaney, Timothy tdelaney at avaya.com
Mon Jul 8 22:15:20 EDT 2002


> From: Thomas Jensen [mailto:spam at ob_scure.dk]
> 
> 25-50% but thats not a realistic measure, since the client 
> makes a huge 
> amount of small selects, which probably makes network latency 
> play some 
> role.

One method to reduce latency is to return multiple result sets with a single
call. This is one thing stored procs are very useful for:

create procedure ABC
as
begin

     select a from T_A;
     select b from T_B;
     select c from T_C;

end

or you can actually do it in your sql call - IIRC correctly as a "batch"
call, or just simply as:

"select a from T_A;select b from T_B;select c from T_C;"

Doing this should reduce your network latency massively.

Tim Delaney





More information about the Python-list mailing list