3 b`H<@sddlmZmZddlZddlZddlZddlmZddlm Z m Z m Z m Z m Z mZmZddlmZmZGdd d eZGd d d ejZd d ZddZddZddZddZddZddZd ddZddZGdddeZ dS)!)divisionunicode_literalsN) FragmentFD)compat_b64decodecompat_etree_fromstringcompat_urlparsecompat_urllib_errorcompat_urllib_parse_urlparsecompat_struct_packcompat_struct_unpack)fix_xml_ampersands xpath_textc@s eZdZdS)DataTruncatedErrorN)__name__ __module__ __qualname__rrEC:\Users\Broad\Desktop\All-Down\binaries\youtube_dl\downloader\f4m.pyrsrc@s`eZdZdZddZddZddZdd Zd d Zd d Z ddZ ddZ ddZ ddZ dS) FlvReaderzi Reader for Flv files The file format is documented in https://www.adobe.com/devnet/f4v.html cCs.|j|}t||kr*td|t|f|S)Nz6FlvReader error: need %d bytes while only %d bytes got)readlenr)selfndatarrr read_bytes!s   zFlvReader.read_bytescCstd|jddS)Nz!Qr)r r)rrrrread_unsigned_long_long*sz!FlvReader.read_unsigned_long_longcCstd|jddS)Nz!Ir)r r)rrrrread_unsigned_int-szFlvReader.read_unsigned_intcCstd|jddS)Nz!Brr)r r)rrrrread_unsigned_char0szFlvReader.read_unsigned_charcCs*d}x |jd}|dkrP||7}qW|S)Nr)r)rrescharrrr read_string3s  zFlvReader.read_stringcCsB|j}}|jd}d}|dkr.|j}d}|||j||fS)z[ Read a box and return the info as a tuple: (box_size, box_type, box_data) rrr)r rr)rZ real_sizesizebox_typeZ header_endrrr read_box_info<s  zFlvReader.read_box_infocCsx|j|jd|j}xt|D] }|jq$W|j}g}x.t|D]"}|j}|j}|j||fqJWd|iS)N segment_run)r!rranger&r append)rquality_entry_countiZsegment_run_countsegmentsZ first_segmentZfragments_per_segmentrrr read_asrtHs  zFlvReader.read_asrtc Cs|j|jd|j|j}xt|D] }|jq,W|j}g}xRt|D]F}|j}|j}|j}|dkr|j}nd}|j||||dqRWd|iS)Nr+r)firsttsdurationdiscontinuity_indicator fragments)r!rr r-r&rr.) rr/r0fragments_countr7r3Zfirst_tsr5r6rrr read_afrt]s*   zFlvReader.read_afrtcCsJ|j|jd|j|j}|d@dk}|j|j|j|j|j}xt|D] }|jq`W|j}xt|D] }|jqW|j|j|j}g}x@t|D]4}|j\}} } | dkstt| j } |j | qW|j} g} x@t| D]4}|j\}} } | dks&t| j t| j qW|| |dS)Nr+ rsasrtsafrt)r1r7live) r!rr rr&r-r*AssertionErrorrr2r.r9)rflagsr;Z server_countr0Z quality_countZsegments_countr1Zbox_sizer)box_datasegmentZfragments_run_countr7rrr read_abstsB      zFlvReader.read_abstcCs&|j\}}}|dkstt|jS)Nsabst)r*r<rr@)rZ total_sizer)r>rrrread_bootstrap_infos zFlvReader.read_bootstrap_infoN)rrr__doc__rrr r!r&r*r2r9r@rArrrrrs   "3rcCs t|jS)N)rrA)Zbootstrap_bytesrrrrAsrAc Csg}|dd}|ddd}|dd}tj|}xL|dD]@\}}|dkr\|dr\d}x"t|D]}|j|t|fqfWq@W|dr|d d }|S) zE Return a list of (segment, fragment) for each fragment in the video r1rr7r3r,lr;rN) itertoolscountr-r.next) boot_infor$Zsegment_run_tableZfragment_run_entry_tableZfirst_frag_numberZfragments_counterr?r8_rrrbuild_fragments_lists    rIcCs|jtd|dS)Nz!I)writer )streamvalrrrwrite_unsigned_intsrMcCs|jtd|dddS)Nz!Ir)rJr )rKrLrrrwrite_unsigned_int_24srNcCs,|jd|jd|jd|jddS)zWrites the FLV header to streamsFLVs sN)rJ)rKrrrwrite_flv_headers   rPcCsNd}d}|rJ|j|t|t||jd|j|t||t|dS)z&Writes optional metadata tag to stream sN)rJrNrrM)rKmetadataZ SCRIPT_TAGZFLV_TAG_HEADER_LENrrrwrite_metadata_tags   rTcCsttdd|S)NcSsd|jkod|jkS)NZdrmAdditionalHeaderIdZdrmAdditionalHeaderSetId)attrib)errrs z(remove_encrypted_media..)listfilter)mediarrrremove_encrypted_medias r[cCs d||fS)Nz {http://ns.adobe.com/f4m/%d.0}%sr)propverrrr_add_nssr^cCs.t|tdtddgddd}|r*|j}|S)NZbaseURLrzbase URL)default)rr^strip)manifestbase_urlrrr get_base_urls  rcc@s<eZdZdZdZddZddZddZd d Zd d Z d S)F4mFDz5 A downloader for f4m manifests or AdobeHDS. f4mcCsp|jtd}|s|jdx8|jtd|jtdD]}d|jkr:|jdq:Wt|}|sl|jd|S)NrZzNo media foundZdrmAdditionalHeaderZdrmAdditionalHeaderSetidzMissing ID in f4m DRMzUnsupported DRM)findallr^ report_errorrUr[)rdocrZrVrrr_get_unencrypted_media s   zF4mFD._get_unencrypted_mediacCs|jj|j}t|S)N)ydlurlopenrrA)r bootstrap_url bootstraprrr_get_bootstrap_from_urlszF4mFD._get_bootstrap_from_urlcshg}d}xL| rT|dkrT|j|}t|}fdd|D}|s tjd|d8}q W|sd|jd|S)Nrcsg|]}|dkr|qS)rr).0f)latest_fragmentrr #sz0F4mFD._update_live_fragments..g@rzFailed to update fragments)rorItimesleeprh)rrmrsfragments_listretriesrGr)rsr_update_live_fragmentss    zF4mFD._update_live_fragmentscCsD|jd}|r&tj||}|j|}nd}t|j}t|}||fS)Nurl)getr urljoinrortextrA)rnoderbrmrGrnrrr_parse_bootstrap_node.s   zF4mFD._parse_bootstrap_nodec's|d}|jd|jd|j|jj|j||}|j}t|jj ddj }t |}dd|j |D}dkst |dkrt|d d d }|d#\}} nttfd d |d \}} t|p|} tj| | jd} |jtd} |j| | \} }| d}| jtd}|dk r*t|j}nd}t| }|jjdd}|rV|dd}t |}t|td}|||d}|j||d}|dd krt||st||t | }|j!|d }x|r|j"d \}}|d7}||dkrqd||f}g}|j#r|j$|j#|r2|j$|j d|jdrL|j$|d|j%|j&|dj'|d}y|j(||j|\}} |sdSt)| }!x\y|!j*\}"}#}$Wn*t+k r|r|j,| PYnX|#dkr|j-||$PqWWn`t.j/fk rP}%z>|r>|%j0dks&|%j0dkr>d |}&|j1|&g}nWYdd}%~%XnX| r| r|r|r|j2||}|t |7}|r|d d|dkrd!|d d|d}&|j1|&qW|j3|d"S)$NrzZtbrz[%s] Downloading f4m manifestzutf-8ignorecSs"g|]}t|jjdd|fqS)Zbitrater)intrUr{)rqrrrrrrtLsz'F4mFD.real_download..rcSs|dS)Nrr)rrrrrrWPsz%F4mFD.real_download..)keycst|dkS)Nr)r)rr)requested_bitraterrrWTsrZ bootstrapInfor;rStestFzpv-2.0)filename total_fragsr; dest_streamZcomplete_frags_downloaded_bytesZfragment_indexz Seg%d-Frag%d;Zextra_param_to_segment_url&)pathquerysmdatiizFragment %d unavailablezMissed %d fragmentsTr)4r{ to_screenFD_NAMErkrlZ _prepare_urlgeturlrrdecoder`rrjrsortedrXrYrcr r|rUfindr^rrr}rIparamsrZ_prepare_frag_downloadrPrTr Z_start_frag_downloadpoprr._replacerjoinZ_download_fragmentrr*rrJZ_append_fragmentr HTTPErrorcodereport_warningryZ_finish_frag_download)'rr info_dictZman_urlZurlhrariformatsraterZZ man_base_urlrbZbootstrap_noderGrmr;Z metadata_noderSrwrrZ akamai_pvctxrZbase_url_parsedZ frag_indexZseg_iZfrag_inamer url_parsedZsuccessZ down_datareaderrHr)r>errmsgr)rr real_download?s                     zF4mFD.real_downloadN) rrrrBrrjroryrrrrrrrdsrd)r)! __future__rriorDrufragmentrcompatrrr r r r r utilsrr ExceptionrBytesIOrrArIrMrNrPrTr[r^rcrdrrrrs& $