[py-svn] r31613 - py/branch/distributed

[hpk at codespeak.net]

Author: hpk
Date: Thu Aug 24 17:34:01 2006
New Revision: 31613

Modified:
   py/branch/distributed/TODO
Log:
(fijal, hpk) listed a number of pending items for distributed testing


Modified: py/branch/distributed/TODO
==============================================================================
--- py/branch/distributed/TODO	(original)
+++ py/branch/distributed/TODO	Thu Aug 24 17:34:01 2006
@@ -4,39 +4,31 @@
 1st. Milestone
 -----------------
 
+DONE 
 * use "/usr/bin/rsync" to sync to remote 
 * master does collection of items 
 * "leaf" items are asynchronously send to "Executors" (running on nodes)
 * super-simple reporting 
 
-# running at MASTER: 
-channels = []
-for gw in mygateways:
-    c = gw.remote_exec(executor_protocol) 
-    c.setcallback(lambda x: report_queue.put) 
-    channels.append(c) 
 
-try: 
-    # wait for completion 
-finally: 
-    for c in channels: 
-        c.send(None) 
-        c.close()
-
-# dispatching thread: 
-while 1:
-    for node in nodes: 
-        if len(node.pending) < MAXTASKS_PER_NODE: 
-            item = itemgenerator.next() 
-            if shouldstop:
-                break 
-            node.send(item) 
-
-
-# reporting thread
-while 1: 
-    if shouldstop: 
-        break 
-    report_event = report_queue.get()
-    print report_event 
+open issues: 
 
+* sending cmdline and other options to remote places 
+* capturing stdout/stderr remotely (and sending it back) 
+* noticing hanging tests/hosts 
+* reacting to hanging tests/hosts (probably first just remove
+  the masternode from the dispatching list and reschedule pending 
+  tests to a different host and report about all this) 
+* more events, at least: 
+  - start testing 
+  - finish testing 
+  - setup/teardown of hosts 
+  - segfaults 
+  - rsyncing (after 1-n rsync) 
+* nice hostmanagement  
+* 1-n rsync 
+* improved reporting, e.g. 
+  report which packages are used from where on the remote side 
+* lazy remote py lib import? 
+* --pdb -> remote screen sessions 
+* later: caring for specifying python versions / hosts