Ok well you should look at this module http://www.rutherfurd.net/python/sendkeys/#id1 I then you could take frequent snapshots and use and OCR to find your stuff. Then use the above library to type to the window.