[issue2981] confusing action of struct.pack and struct.unpack with fmt 'p'

[Mark Dickinson]

Mark Dickinson <dickinsm at gmail.com> added the comment:

I think you're misunderstanding how the 'p' format works.

> Otherwise, why people should use format 'p'?
> Either when you struct.pack or struct.unpack you have to know the size
> of string at first, why not turn to format 's'?

No;  you don't need to know the size of the string beforehand;  you just need to know the *maximum* size of the string;  the number of bytes allocated to store that string.  For example (Python 2.6):

>>> import struct
>>> s = struct.Struct('20p')  # variable-length string stored in 20 bytes
>>> s.pack('abc')
'\x03abc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
>>> s.unpack(_)
('abc',)
>>> s.pack('abcdef')
'\x06abcdef\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
>>> s.unpack(_)
('abcdef',)

Note that the packed sizes are the same (20 bytes each time), but you can pack and unpack any (byte)string of length up to 19 bytes, without needing to know its length beforehand.

Handling true variable-length fields is really outside the scope of the struct module.

----------
resolution:  -> rejected
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue2981>
_______________________________________