[SciPy-user] Real-time plotting and data storage format questions

[Charles Doutriaux]

Hi there,

For the data format I strongly recommend NetCDF and especially NetCDF4 
(allows for compression)
In addition of NetCDF4 I strongly recommend you look at the CF 
conventions, which is a standard and allows software to learn about the 
data you're storing, see:
http://cf-pcmdi.llnl.gov/

As far as an all in 1 python based software to store/analyze/plot your 
data, you can look at CDAT (which happens to redistribute scipy )

Hope this helps,

C.

heytrent at gmail.com wrote:
> Greetings,
>
> A small team of us are developing a new simulation package from the 
> ground up. Our legacy approach relied on MATLAB and other proprietary 
> software. A hope pf ours is to be able to shed the use of MATLAB for 
> the analysis of our simulation results and instead use python with 
> scipy/numpy/matplotlib etc. I've successfully installed and compiled 
> optimized numpy/scipy and all the supporting packages (ATLAS, FFTW, etc).
>
> So far so good.
>
> To the point - I have two questions:
>
> 1) We would like to have a "scope" to monitor simulation outputs in 
> real time. We're using one tool that can take data over a tcp/ip port, 
> but is clunky and only works on a single platform. Does such a thing 
> exists within the python realm for plotting data in real time?
>
> 2) Our simulation creates large (1-4 GB) data sets. Since we're 
> writing this simulation ourselves (C++) we can save the data in any 
> format. Does anyone have a suggestion for a specific format or API 
> that's been found to be optimal in terms of memory usage and ability 
> to import into python for analysis and plotting?
>
> Thank you for any suggestions. We're still new with Python, so I 
> apologize if these questions seem mundane.
> ------------------------------------------------------------------------
>
> _______________________________________________
> SciPy-user mailing list
> SciPy-user at scipy.org
> http://projects.scipy.org/mailman/listinfo/scipy-user
>