[IronPython] Some observations about parallel import and Silverlight

[Kamil Dworakowski]

Awesome news!  Resolver One is currently being ported to IronPython
2.0 and I can't wait to try parallel importing again.

Do you remember what tweak did you have to make to the dependency
graph? Dependency finder should ignore imports that are inside if
statements.

I remember that you can pass list of modules to ignore, was it not enough?

On Tue, Nov 25, 2008 at 11:55 PM, Dan Eloff <dan.eloff at gmail.com> wrote:
> Thanks to the excellent work of Kamil
> (http://github.com/luntain/ipy-parallel-import/tree/master), and the
> help of Jimmy I now have importing being done in parallel in 4 threads
> in Silverlight.
>
> I had to restructure my code a little to reduce circular imports (not
> a bad thing to do anyway) and I had to hand-tweak the dependency graph
> to deal with conditional imports and other difficult to track
> dependencies.
>
> The result was better than I could have hoped for. I'm seeing 43%
> faster loading on my dual-core development pc. I used to have blank
> screen at start that made you wonder if the browser has frozen. But
> now the browser is responsive and I have a nice working progress bar.
> But that's not the best news.
>
> The kicker is that the benefit is even larger on slow single core
> machines with dialup internet. I posted a while back on this list that
> IE does not immediately send an asynchronous request. It waits until
> it's UI thread is idle (which doesn't happen if your importing modules
> like crazy on it.) So the net effect was the application loads (about
> 28 seconds on a P4 2ghz) and then it sends the request, waits for the
> response (which is big in my case), and processes it - all in order.
> So if that takes another 30 seconds, you have nearly 1 minute of load
> time. With the UI thread mostly idle now, this happens in parallel to
> the importing, and the overall load time drops by a whopping 45%.
>
> In the words of my generation - w00t!
>
> -Dan
> _______________________________________________
> Users mailing list
> Users at lists.ironpython.com
> http://lists.ironpython.com/listinfo.cgi/users-ironpython.com
>