Video download problems (Windows Web PVR)

Wed Jan 16 14:32:23 EST 2013

On Wed Jan 16 14:00:25 EST 2013, dinkypumpkin wrote:

>On 16/01/2013 13:42, Neill Mitchell wrote:
>> When I left the values at 1024.0 the percentage complete didn't work at
>> all. When changed to 4096.0 it works fine and is accurate.

>We must not be looking at the same thing then.  Send me a diff of your
>changes to rtmpdump.c and I'll square things with the Windows build.

 Hi; I 'm not having any "super fast Fiber Optics connection" issues,
yet I decided to give your rtmpdump binary a spin just for
"academic" purposes...

First download completed nicely in one go, so nothing to report there...
But when proceeded with a second one (pid=b01pwtsj), rtmpdump's
resume function after a "connection timed out" error (these are not
attributed to rtmpdump - I observe them randomly also with other
pre-built rtmpdump binaries; must have to do with my location and/or
wifi connection specifics...) failed and, to add insult to injury, GIP
assumed that the download was complete! Here is the console output:

INFO: Trying flashvhigh2 mode to record tv: Africa - 2. Savannah
......
RTMPDump v2.4-66-gd3b73cf+get_iplayer.1
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Starting download at: 0.000 kB
INFO: Metadata:
INFO:   duration              3526.44
INFO:   moovPosition          32.00
INFO:   width                 832.00
INFO:   height                468.00
INFO:   videocodecid          avc1
INFO:   audiocodecid          mp4a
INFO:   avcprofile            77.00
INFO:   avclevel              30.00
INFO:   aacaot                2.00
INFO:   videoframerate        25.00
INFO:   audiosamplerate       24000.00
INFO:   audiochannels         2.00
INFO: trackinfo:
INFO:   length                88158000.00
INFO:   timescale             25000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            avc1
INFO:   length                84634624.00
INFO:   timescale             24000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            mp4a
262933.750 kB / 1431.96 sec (40.6%)
ERROR: RTMP_ReadPacket, failed to read RTMP packet body. len: 68430
262933.750 kB / 1431.96 sec (40.6%)
INFO: Connection timed out, trying to resume.

Resuming download at: 262933.750 kB
WARNING: HandleInvoke, Sanity failed. no string method in invoke packet
262933.750 kB / 0.00 sec
Download complete

Notice that when rtmpdump tried to resume, it assigned the already
downloaded 256.77 MB a timestamp of  0.00 sec (instead of the
correct timestamp 1431.96 sec (40.6%) at the point of connection outage...).

>From then on I proceeded by first renaming what had already been
downloaded, from FOO.flv to FOO.partial.flv - used the --raw option in
the initial command, and run a second time the same command in GIP;
the partially downloaded file was recognised, download resumed
correctly.
 But when the next connection time-out happened
(when 83% of the stream was dumped), rtmpdump exhibited the same
 faulty behaviour by saying that the by then downloaded chunk was only
40.5% of the full file, see this console excerpt:

537334.080 kB / 2927.00 sec (83.0%)
ERROR: RTMP_ReadPacket, failed to read RTMP packet header
537463.356 kB / 2927.64 sec (83.0%)
INFO: Connection timed out, trying to resume.

Resuming download at: 537463.356 kB / 1431.600 sec (40.5%)
537463.356 kB / 1431.60 sec (40.5%)
Download may be incomplete (downloaded about 40.50%), try resuming
INFO: Command exit code 2 (raw code = 512)

 So, as Neill suggests, there's something wrong with the "percentage 
complete" ...
My current win32 rtmpdump binary
(rtmpdump-2.4-pu-81-g2872601-x86-static.svnpenn.20130103),
now sadly taken off-line by its author, does not suffer from this.

This time around, GIP (not rtmpdump!) retried successfully to
resume downloading & the stream was eventually fully dumped.

For debug purposes, now comes the (almost) full console content
from my second attempt at getting the file with
RTMPDump v2.4-66-gd3b73cf+get_iplayer.1 :

INFO: Trying flashvhigh2 mode to record tv: Africa - 2. Savannah
INFO: File name prefix = Africa_2.Savannah_201301092100
RTMPDump v2.4-66-gd3b73cf+get_iplayer.1
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Resuming download at: 262868.667 kB / 1431.600 sec (40.5%)
INFO: Metadata:
INFO:   duration              3526.44
INFO:   moovPosition          32.00
INFO:   width                 832.00
INFO:   height                468.00
INFO:   videocodecid          avc1
INFO:   audiocodecid          mp4a
INFO:   avcprofile            77.00
INFO:   avclevel              30.00
INFO:   aacaot                2.00
INFO:   videoframerate        25.00
INFO:   audiosamplerate       24000.00
INFO:   audiochannels         2.00
INFO: trackinfo:
INFO:   length                88158000.00
INFO:   timescale             25000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            avc1
INFO:   length                84634624.00
INFO:   timescale             24000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            mp4a
WARNING: Stream does not start with requested frame, ignoring data...
WARNING: Stream does not start with requested frame, ignoring data...
537334.080 kB / 2927.00 sec (83.0%)
ERROR: RTMP_ReadPacket, failed to read RTMP packet header
537463.356 kB / 2927.64 sec (83.0%)
INFO: Connection timed out, trying to resume.

Resuming download at: 537463.356 kB / 1431.600 sec (40.5%)
537463.356 kB / 1431.60 sec (40.5%)
Download may be incomplete (downloaded about 40.50%), try resuming
INFO: Command exit code 2 (raw code = 512)
WARNING: Retry recording for 'Africa - 2. Savannah (b01pwtsj)'
INFO: File name prefix = Africa_2.Savannah_201301092100
RTMPDump v2.4-66-gd3b73cf+get_iplayer.1
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Resuming download at: 537090.423 kB / 2925.760 sec (82.9%)
INFO: Metadata:
INFO:   duration              3526.44
INFO:   moovPosition          32.00
INFO:   width                 832.00
INFO:   height                468.00
INFO:   videocodecid          avc1
INFO:   audiocodecid          mp4a
INFO:   avcprofile            77.00
INFO:   avclevel              30.00
INFO:   aacaot                2.00
INFO:   videoframerate        25.00
INFO:   audiosamplerate       24000.00
INFO:   audiochannels         2.00
INFO: trackinfo:
INFO:   length                88158000.00
INFO:   timescale             25000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            avc1
INFO:   length                84634624.00
INFO:   timescale             24000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            mp4a
WARNING: Stream does not start with requested frame, ignoring data...
WARNING: Stream does not start with requested frame, ignoring data...
647291.564 kB / 3526.40 sec (99.9%)
Download complete

INFO: Downloaded Thumbnail to 'D:\Vangelis\iPlayer 
Recordings\Africa_2.Savannah_
201301092100.jpg'

C:\Program Files\get_iplayer>