[Chicago] Python traffic analysis idea

[Daniel Peters]

you might could just push the logfiles into pandas, wouldn't even need to
write a script to compare them, just make each file a data frame or set of
data frames and then play with it from there.


On Tue, Jan 28, 2014 at 4:35 PM, Adrian Buford <
technicallydebatable at gmail.com> wrote:

> Seems like Scapy will give me the output I need using sniff along with
> some other vars.  Also Airoscapy-by looks to provide some help. Pretty much
> the next step is a script for log comparison which shouldn't be hard. Gonna
> draw up on whiteboard once home. Thanks again all. I will also check out
> Kibana Chris. Not too familiar.
> On Jan 28, 2014 3:52 PM, "Chris Sinchok" <chris at sinchok.com> wrote:
>
>> Something like Kibana might be really useful for this:
>> http://www.elasticsearch.org/overview/kibana/
>>
>> Kibana is a simple front end that's powered by elasticsearch, and it's
>> quite easy to get data into elasticsearch from Python--or from logstash,
>> etc. Here's a demo, to show a few possible uses:
>> http://demo.kibana.org/#/dashboard
>>
>>
>> On Tue, Jan 28, 2014 at 3:41 PM, Adrian Buford <
>> technicallydebatable at gmail.com> wrote:
>>
>>> Have no way of making the logs is main concern.
>>> On Jan 28, 2014 3:14 PM, "sheila miguez" <shekay at pobox.com> wrote:
>>>
>>>>
>>>> On Tue, Jan 28, 2014 at 3:09 PM, Nick Bennett <nick at goggl.es> wrote:
>>>>
>>>>> For the logging component, there's already the logging module in the
>>>>> Python standard library. For an idea of how to use it, try Victor
>>>>> Lin's guide on good logging practice in Python<http://victorlin.me/posts/2012/08/26/good-logging-practice-in-python>
>>>>> .
>>>>>
>>>>
>>>> I'm wondering what he wants to log and what it will be used for. If the
>>>> intent is to analyze data to get information about average times, then he
>>>> can use logs for that, then later scrape them to get the data, but he could
>>>> handle that in other ways as well, like sending events to graphite.
>>>>
>>>>
>>>> --
>>>> sheila
>>>>
>>>> _______________________________________________
>>>> Chicago mailing list
>>>> Chicago at python.org
>>>> https://mail.python.org/mailman/listinfo/chicago
>>>>
>>>>
>>> _______________________________________________
>>> Chicago mailing list
>>> Chicago at python.org
>>> https://mail.python.org/mailman/listinfo/chicago
>>>
>>>
>>
>> _______________________________________________
>> Chicago mailing list
>> Chicago at python.org
>> https://mail.python.org/mailman/listinfo/chicago
>>
>>
> _______________________________________________
> Chicago mailing list
> Chicago at python.org
> https://mail.python.org/mailman/listinfo/chicago
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/chicago/attachments/20140128/070da7e9/attachment.html>