[omaha] Dev Help

[Wes Turner]

These links may be of help to you in your endeavor:

http://www.reddit.com/r/Python/comments/1qnbq3/webscraping_selenium_vs_conventional_tools/cdeq2t7

https://developers.google.com/appengine/docs/python/urlfetch/

https://developers.google.com/appengine/docs/python/taskqueue/

http://docs.celeryproject.org/en/latest/index.html

Multiprocess is probably what you're after. Celery and appengine task queue
have rate-limiting support. The praw reddit api shows how to work with
multiprocess and respectable levels of concurrent requests:

https://praw.readthedocs.org/en/latest/pages/multiprocess.html

Wes Turner
Greeting
s All.

My name
is  Andy and I'm a new developer to Omaha
and the Python community.  I'm also new to this list-serve so apologies if
this is a completely inappropriate question for the thread.

I'm
reaching out to see if anyone would be interested in collaborating on a
startup
idea.   It's dealing with (in my opinion)
some pretty interesting stuff that I am (in everyone's opinion) very novice
with:

        * Multi-threaded web-scraping  (with Urllib)
        * Natural Language processing (using NLTK)
        * Pattern Recognition / Clustering Algorithms (using  numpy and
matplotlib)
        * Google App Engine back end using Web2Py framework (or maybe
Django if I continue to struggle)

At this point, I'm prototyping and looking for concept / development
help...it is very hard to find.  If
anyone has a good chunk of extra time and a desire to collaborate, I
would love to sit down and talk.

Thanks
Andy
ajkrell at yahoo.com
_______________________________________________
Omaha Python Users Group mailing list
Omaha at python.org
https://mail.python.org/mailman/listinfo/omaha
http://www.OmahaPython.org