[Newbie] Is there any method to urlretrieve to a file the html source from a url with "Transfer-encoding": chunked

Thinker thinker at branda.to
Mon Feb 25 07:50:17 EST 2008


Aldo Ceccarelli wrote:
> Hello All,
> I apologize for posting a question on this but I could not find a
> complete answer after reading and searching so far:-)
>
> My problem is that I'd like to store the html source of a certain web
> url but when I try via urllib / urllib2 reads or urlretrieve I get
> only a part of the contents (ist type is text/html).
>
> Metainformation associated with the url show that it has a:
>
> Transfer-Encoding: chunked
>
> and this seems the reason why I can get only a part of it.
>   
Please show your code, here.  urllib doesn't always return full content
in one time.  I guess it is the problem.




More information about the Python-list mailing list