[Chicago] Fwd: ANN: PyTables 1.4 released
michael bobak
mike.bobak at gmail.com
Thu Dec 21 19:08:58 CET 2006
Begin forwarded message:
> From: Francesc Altet <faltet at carabos.com>
> Date: December 21, 2006 11:47:41 AM CST
> To: news at hdfgroup.org
> Subject: ANN: PyTables 1.4 released
>
> ===========================
> Announcing PyTables 1.4
> ===========================
>
> PyTables is a Python library for managing hierarchical datasets and
> designed to efficiently cope with extremely large amounts of data with
> support for full 64-bit file addressing. It is based on the HDF5
> library and leverages the numarray/NumPy/Numeric packages for
> providing convenient data containers.
>
> This is a new major release of PyTables, and probably the last
> major one
> of the 1.x series (i.e. with numarray at the core). On it, we have
> implemented better code to deal with table buffers, enhanced the
> capability for reading native HDF5 files, enhanced support for 64-bit
> platforms (but not with Python 2.5: see ``Special Warning`` section
> below), better support for AIX, optional automatic parent creation and
> the traditional amount of bug fixes.
>
> Go to the PyTables web site for downloading the beast:
> http://www.pytables.org/
>
> or keep reading for more info about the new features and bugs fixed.
>
>
> Changes more in depth
> =====================
>
> Improvements:
>
> - Table buffers code refactored: now each Row read iterator has its
> own
> buffers, completely independent of their table (although write
> iterators still share a single buffer in the same table). This
> separation makes the logic of buffering much more clear and less
> prone
> to errors (in fact, some of them have been solved). Performance and
> memory consumption are more or less equal than before.
>
> - When flushing the complete file (i.e. when calling File.flush()),
> only
> the buffers of those nodes that are alive (i.e. referenced from user
> code) are actually flushed. This brings much better efficiency (and
> also stability) to situations where one has to flush (and hence,
> close) files with many nodes on it.
>
> - Better support for AIX by renaming the internal LONLONG_MAX C
> constant
> (it was used internally by the xlc compiler). Thanks to Brian
> Granger
> for the report.
>
> - Added optional automatic parent creation support during node
> creation,
> copying and moving operations. See the release notes for more
> information.
>
> - Improved support for Python2.4 and 64-bit platforms (but beware,
> there
> are still known issues when using Python2.5 in combination with
> 64-bit
> platforms). Thanks to Gerard Vermeulen for his patches for Win64
> platforms.
>
> - Implemented a workaround for a leak present in numarray --> Numeric
> conversions when using the array protocol, as can be seen in:
>
> http://comments.gmane.org/gmane.comp.python.numeric.general/12563
>
> The workaround can potentially be far slower than the array protocol
> (because a copy of the arrays is always made), but at least the new
> code doesn't leak anymore.
>
> Bug fixes:
>
> - Previously, when the size for memory compounds type was less than
> the
> size of the type on disk (for example, when one have padding or
> aligned fields), PyTables was unable to read info on them. This has
> been fixed. This allows reading general compound types in HDF5 files
> written with other tools than PyTables.
>
> - When many tables with indexed columns were created simultaneously, a
> bug make PyTables to crash. This has been fixed (for more info, see
> bug #26).
>
> - Fixed a typo in the code that prevented recognizing complex data in
> non-PyTables files.
>
> - Table.createIndex() now refuses to index complex columns.
>
> - Now, it is possible to index several nested columns that hangs from
> the same column parent. Fixes bug #24.
>
> - Fixed a typo in nctoh5 utility that prevented using filters
> properly. Thanks to Lou Wicker for reporting this.
>
> - When setting/appending an array in-memory to an Array (or
> descendant)
> object and they have mismatched byteorders, the array was set/
> appended
> without being byteswapped first. This has been fixed. Thanks to
> Elias
> Collas for the report.
>
> Deprecated features:
>
> - None
>
> Backward-incompatible changes:
>
> - Please, see ``RELEASE-NOTES.txt`` file.
>
>
> Special Warning for Python 2.5 and 64-bit platforms users
> =========================================================
>
> Unfortunately, and due to problems with the combination numarray
> 1.5.2,
> Python2.5 and 64-bit platforms, PyTables cannot be safely used yet in
> such scenario. This will be solved either when numarray can address
> this issue (hopefully with numarray 1.5.3), or when PyTables 2.x
> series
> (with NumPy at its core) will be out.
>
>
> Important note for Windows users
> ================================
>
> If you are willing to use PyTables with Python 2.4 or 2.5 in Windows
> platforms, you will need to get the HDF5 library compiled for MSVC
> 7.1,
> aka .NET 2003. It can be found at:
> ftp://ftp.ncsa.uiuc.edu/HDF/HDF5/current/bin/windows/5-165-win-net.ZIP
>
> Users of Python 2.3 on Windows will have to download the version of
> HDF5
> compiled with MSVC 6.0 available in:
> ftp://ftp.ncsa.uiuc.edu/HDF/HDF5/current/bin/windows/5-165-win.ZIP
>
>
> Platforms
> =========
>
> This version has been extensively checked on quite a few platforms,
> like
> Linux on Intel32 (Pentium), Win on Intel32 (Pentium), Linux on Intel64
> (Itanium2), FreeBSD on AMD64 (Opteron), Linux on PowerPC (and
> PowerPC64)
> and MacOSX on PowerPC. For other platforms, chances are that the code
> can be easily compiled and run without further issues. Please,
> contact
> us in case you are experiencing problems.
>
>
> Resources
> =========
>
> Go to the PyTables web site for more details:
>
> http://www.pytables.org
>
> About the HDF5 library:
>
> http://hdf.ncsa.uiuc.edu/HDF5/
>
> About numarray:
>
> http://www.stsci.edu/resources/software_hardware/numarray
>
> About NumPy:
>
> http://numpy.scipy.org/
>
> To know more about the company behind the PyTables development, see:
>
> http://www.carabos.com/
>
>
> Acknowledgments
> ===============
>
> Thanks to various the users who provided feature improvements,
> patches, bug reports, support and suggestions. See the ``THANKS``
> file in the distribution package for a (incomplete) list of
> contributors. Many thanks also to SourceForge who have helped to make
> and distribute this package! And last but not least, a big thank you
> to Acusim (http://www.acusim.com/) for sponsoring many of the job done
> for releasing this version of PyTables.
>
>
> Share your experience
> =====================
>
> Let us know of any bugs, suggestions, gripes, kudos, etc. you may
> have.
>
>
> ----
>
> **Enjoy data!**
>
> -- The PyTables Team
>
>
> ----------------------------------------------------------------------
> This mailing list is for news regarding HDF.
> To subscribe to this list, send a message to news-
> subscribe at hdfgroup.org.
> To unsubscribe, send a message to news-unsubscribe at hdfgroup.org.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.python.org/pipermail/chicago/attachments/20061221/01eb1d1d/attachment-0001.htm
More information about the Chicago
mailing list