Reading log and saving data to DB

Guy Tamir guytamir1 at gmail.com
Wed Aug 14 09:18:08 EDT 2013


Hi all,

I have a Ubuntu server running NGINX that logs data for me.
I want to write a python script that reads my customized logs and after 
a little rearrangement save the new data into my DB (postgresql).

The process should run about every 5 minutes and i'm expecting large chunks of data on several 5 minute windows..

My plan for achieving this is to install python on the server, write a script and add it to cron.

My question is what the simplest way to do this? 
should i use any python frameworks? 
For my python app i'm using Django, but on this server i just need to read a file, do some manipulation and save to DB.

if you think any of my plan seem troubling in any way i'd love to hear..

Regards,
Guy
 



More information about the Python-list mailing list