How To Do It Faster?!?

andrea_gavana at tin.it andrea_gavana at tin.it
Fri Apr 1 19:02:31 EST 2005


Hello Jeremy & NG,

>Yes, clearer, though I still don't know what you're *doing* with that data
:-)

Every user of thsi big directory works on big studies regarding oil fields.
Knowing the amount of data (and number of files) we have to deal with (produced
by simulators, visualization tools, and so on) and knowing that users are
usually lazy in doing clean up of unused/old files, this is a way for one
of us to "fast" scan all the directories and identify which files belong
to him. Having them in an organized, size-sorted wxPython list, the user
can decide if he want to delete some files (that almost surely he forgot
even that they exist...) or not. It is easy as a button click (retrieve
the data-->delete the files).

>Here's an idea to sort of come at the problem from a different angle. Can
>you run something on the file server itself, and use RPC to access it?

I don't even know what is RPC... I have to look at it.


>The reason I mention this is a lot of UNIXes have an API to detect file
>changes live; for instance, google "python fam". It would be easy to hook
>something up to scan the files at startup and maintain your totals live,
>and then use one of the many extremely easy Python RPC mechanisms to
>request the data as the user wants it, which would most likely come back
>at network speeds (fast).

I am not sure if my new explanation fits with your last information... as
above, I didn't even know about fam... I've read a little, but probably
I am too newbie to see a link between it and my scope. Do you think it exists?
It would be nice to have something that tracks the file status on all the
file system, but probably is a LOT of work wrt what my app should be able
to do.
Anyway, thanks for the hints! If my new explanation changed something, can
anyone post some more comments?

Thanks to you all.

Andrea.




More information about the Python-list mailing list