+ :1jNo"Rt^RIHt^RIt^RIt^RIt^RIt^RIH t ^RI H t ^RI t ^RI t ^RIt^RIt^RIHt^RIHt^RIHt^RIHt^R IHtHt^R IHt^R IHt^R IH t H!t!H"t"H#t#H$t$]PJ!]&4t'] 'd!^R I(H)t)H*t*H+t+^RI,H-t-^RIH.t.^RI H/t/H0t0H1t1R't2!RR4t3R(]$^3RRllt4!RR]Pj4t6!RR]64t7RRlt8!RR]64t9RRlt:RR lt;R!R"ltR#))zZ Models for sharded repodata, and to make monolithic repodata look like sharded repodata. ) annotationsN) defaultdict) TYPE_CHECKING)REPODATA_SHARDS_FN)context) SubdirData) get_session)_add_http_value_to_dictconda_http_errors)Channel)cache)_is_http_error_most_400_codes_safe_urljoin_with_slash_shards_connectionsensure_hex_hashspec_to_package_name)IterableKeysViewSequence)Response) RepodataCache) RepodataDict ShardDictShardsIndexDictcj]tRt^?tRtRRRlltRRltRRltR R ltR t ] R R l4t Rt R#) ShardFetcha, Wrapper class that encapsulates fetching and caching of individual shards. Handles deferred fetching: shards can be requested via this class but will only be actually retrieved from the network when fetch() is called. This allows batching and coordinating shard retrieval across multiple channels. Nc$V^8dQhRRRRRR/#) shardbase ShardBasepackagestr shard_cachezcache.ShardCache | None)formats" RRR4VPP!V4V#uuppi +'giL3;i)z Fetch multiple shards for a Shards instance. Implements the core fetching logic for Shards, handling network requests, caching, and decompression. c\P\P3pVPWR7pVP 4VP p\ P!WVR7#))timeout)r+r compressed_shard)rremote_connect_timeout_secsremote_read_timeout_secsgetraise_for_statuscontentr AnnotatedRawShard)sr+package_to_fetchrEresponsedatas&&& r%r:,ShardFetch._fetch_shards_impl..fetch|s\3300GuuSu2H  % % '##D**D r( max_workersz. %sN)rsortedlistvisitedr* concurrentfuturesThreadPoolExecutorritemssubmitsession as_completedlogdebug_process_fetch_resultupdate) r.rAshardsresultsr: urls_packagesr executorr+rXfutures && r%r>ShardFetch._fetch_shards_implrsP $x.) G..(#)>>'#: ;Bf..w78     2 2+-3  %2$7$7$9$9LC)U~~sDsnT$9  %,,99'B &'/2& **6&QC  g&  s%E-/ E' >"E' A"E-'E-- E= c xVPf \R4h\W#4;_uu_4VP4pRRR4\P !\ P!XP\R74WFP&VPPV4R# +'giLs;i)z( Process a single fetched shard result. Nz0shard_cache is required for fetching from Shardsmax_output_size) r" ValueErrorr resultmsgpackloads zstandard decompressrFZSTD_MAX_SHARD_SIZEr insert)r.rfr+r rcrb fetch_results&&&&&& r%r` ShardFetch._process_fetch_results    #OP P s , ,!==?L-)0  --?R ) $$%  -- ,s B)) B9 c V^8dQhRRRR/#)r shard_fetcheszIterable[ShardFetch]r3Noner#)r$s"r%r&r's00#70D0r(c \\4p/pVFHpWP,PVP4VW#PVP3&KJ VP 4FowrE\ V\4'gKW$V^,3,pVPV4pVP 4FwrW$V3,pWn RVn K Kq R#)z Batch fetch multiple ShardFetch objects, grouping by ShardBase. This efficiently fetches shards from multiple sources by grouping requests by their ShardBase instance and making coordinated network calls. TN) rrUrappendr rZr5r6r>r,r-) rvshard_packagesshard_fetches_by_pkg shard_fetchrrA first_fetchfetchedr shards & r% fetch_batchShardFetch.fetch_batchs6A5FHJ(K 00 1 8 89L9L M !"7"79L9L!M N)$2#7#7#9 I)V,,2x{3KL %88B'.mmoNG"677K"LK).&+/K('6$:r()r-r,r r"rr+N) __name__ __module__ __qualname____firstlineno____doc__r/r:r7r>r` staticmethodr__static_attributes__r#r(r%rr?s6* E .`.&00r(rc(V^8dQhRRRRRRRR/#)rrrextrarBrepodata_versionintr3r#)r$s"r%r&r&s0     r(c#aa"\4oVV3RlpVR,P4FpV!V4RjxL K VR,P4FpV!V4RjxL K V^8dXVPR4;p'd?VP4F*pVP4FpV!V4RjxL K K, TRjxL R#LLtLL 5i)z_ Return all dependency names mentioned in a shard, not including the shard's own package name. c3<"\V4VPRR4F/pVS9gK SPV4S!V4pVfK+VxK1 R#5i)dependsNr#)rrIadd)recordspecnamer unique_specss& r% _yield_record/shard_mentioned_packages.._yield_recordsNJJy"-D<'  &+D1#J .s%AA ArANpackages.condav3)setvaluesrI) rrrrrrv3_datagrouprs &&f& @r%shard_mentioned_packagesrs!UL #**, (((-()002 (((31UYYt_"<'"<^^%E,,.(000)& )(1sK7C$C-C$)C*'C$1C$C C$C"C$C$ C$"C$c]tRt^t$RtR]R&R]R&R]R&R]R&]]PR R l44t ]R R l4t R Rlt ]PRRl4t ]PRRl4t RRltRRltRRltRRltRtR#)rz Abstract base class for shard-like objects. Defines the common interface for both sharded repodata (Shards) and monolithic repodata presented as shards (ShardLike). r!r+rrepodata_no_packageszdict[str, ShardDict | None]rV _base_urlcV^8dQhRR/#rr3z KeysView[str]r#)r$s"r%r&ShardBase.__annotate__s  } r(c R#)zDReturn the names of all packages available in this shard collection.Nr#r9s&r% package_namesShardBase.package_names r(cV^8dQhRR/#rr3r!r#)r$s"r%r&r sBB#Br(c B\VPVP4#)z Return self.url joined with base_url from repodata, or self.url if no base_url was present. Packages are found here. Note base_url can be a relative or an absolute url. Uses _safe_urljoin_with_slash to handle non-HTTP schemes (s3://, etc.). )rr+rr9s&r%base_urlShardBase.base_urls($..AAr(c V^8dQhRRRR/#rr r!r3boolr#)r$s"r%r&rs--C-D-r(c WP9#)z9Check if a package is available in this shard collection.)rr.r s&&r% __contains__ShardBase.__contains__s,,,,r(c V^8dQhRRRR/#rr r!r3r#)r$s"r%r&rs    r(c R#)z Return shard URL for a given package. For monolithic repodata, should not be fetched but is a unique identifier. Raise KeyError if package is not in the index. Nr#rs&&r%r*ShardBase.shard_urls r(c V^8dQhRRRR/#rr#)r$s"r%r&r"s  C D r(c R#)8 Return True if the given package's shard is in memory. Nr#rs&&r% shard_loadedShardBase.shard_loaded!s r(c V^8dQhRRRR/#rr r!r3rr#)r$s"r%r&r(s  S Y r(c R#)zF Return a shard that is already loaded in memory and mark as visited. Nr#rs&&r%r8ShardBase.visit_package(rr(c V^8dQhRRRR/#)rr r!rrr#)r$s"r%r&r.s&&3&y&r(c "W PV&R#)z+ Store new shard data in the visited dict. NrVr.r rs&&&r% visit_shardShardBase.visit_shard.s!& Wr(cV^8dQhRR/#)rr3rr#)r$s"r%r&r4s r(c /VPCR/R//CpVPP4F1wr#VfK RF pW,PW4,4K" K3 V#)zc Return monolithic repodata including all visited shards. Prefer iter_records() over this method. rArrAr)rrVrZra)r.repodata_r package_groups& r%build_repodataShardBase.build_repodata4so " ''"  b"   **,HA}!? '..u/CD"@- r(cV^8dQhRR/#)rr3zIterable[tuple[str, dict]]r#)r$s"r%r&rFs ) )8 )r(c# d"VP4pRF+pVPV/4P4RjxL K- VPP 4FHpVfK VPR/4P 4FpVP4RjxL K KJ R#LpL5i)zE Yield (filename, record) tuples for all packages in visited shards. Nrr)rrIrZrVr)r.rrrrs& r% iter_recordsShardBase.iter_recordsFs&&(;M||M26<<> > ><\\((*E}4,335 ;;=((6+ ? )s"9B0B,A!B0B.B0.B0r#N)rrrrr__annotations__propertyabcabstractmethodrrrr*rr8rrrrr#r(r%rrs H&& ((N   BB-       & $ ) )r(rcva]tRtRtRtRRRlltV3Rlt]RRl4tRR lt R R lt R R lt Rt V;t #) ShardLikeiTz: Present a "classic" repodata.json as per-package shards. c V^8dQhRRRR/#)rrrr+r!r#)r$s"r%r&ShardLike.__annotate__Ys' ' ' C' r(c N/VCR/R//CVnRVPR/4RVPR/4/pW n\R4pVP 4F9wrVVP 4F wrxVR,p WV ,V,V&K" K; \ V4Vn/VnVPR,R,p \V \4'g*\PR\V 44\4hWnR # \d RTnR #i;i) z6 url: must be unique for all ShardLike used together. rArcR/R//#rr#r#r(r%$ShardLike.__init__..hsj"6F%Kr(rinforz2repodata["info"]["base_url"] was not str(), got %sN)rrIr+rrZdictrbrVr5r!r^warningtype TypeErrorrKeyError) r.rr+ all_packagesrb group_namerr rrrs &&& r%r/ShardLike.__init__Ys3 3  b3 !  Z4 hll+;R@ KL!-!3!3!5 J#(;;=f~4:t Z(1$1"6 -1L 57  008DHh,, HN k!%N DN s-ADD$#D$c l<\SV`4P^R7wrV RVP RV 2#))maxsplit )super__repr__splitr+)r.leftright __class__s& r%rShardLike.__repr__s;g&(...: q !E7++r(cV^8dQhRR/#rr#)r$s"r%r&rs""}"r(c 6VPP4#r)rbkeysr9s&r%rShardLike.package_namess{{!!r(c V^8dQhRRRR/#rr#)r$s"r%r&rs''''r(c JVPV,VP RV 2#)W Return shard URL for a given package. Raise KeyError if package is not in the index. #)rbr+rs&&r%r*ShardLike.shard_urls% G((1WI&&r(c V^8dQhRRRR/#rr#)r$s"r%r&rs&&C&D&r(c WP9#rrbrs&&r%rShardLike.shard_loadeds++%%r(c V^8dQhRRRR/#rr#)r$s"r%r&rsSYr(c lVPV,pVPV,VPV&V#z? Return a shard that is already in memory and mark as visited. )rbrVrs&& r%r8ShardLike.visit_packages. G$ $ G 4 W r()rrrbr+rV)r)rrrrrr/rrrr*rr8r __classcell__)rs@r%rrTs;' R,""'& r(rcV^8dQhRR/#rr#)r$s"r%r&r&s::c:r(chV'd!VPR4'g VR, p\W4#)z Return shards_base_url joined with base_url and url. Note shards_base_url can be a relative or an absolute url. Uses _safe_urljoin_with_slash to handle non-HTTP schemes (s3://, etc.). /)endswithr)r+shards_base_urls&&r%_shards_base_urlr s, 77<<3 #C 99r(c]tRtRt$RtR]R&RRlt]R4t]R4t ]R R l4t R R lt R Rlt RRlt RtR#)r6izG Handle repodata_shards.msgpack.zst and individual per-package shards. r!r c V^8dQhRRRR/#)r shards_indexrr+r!r#)r$s"r%r&Shards.__annotate__s'3'3%'3'3r(c fWnW nVR,R,Vn\VPVPR,P RR44Vn\ VP 4Pp\V4Vn RVR,R/R/R^/Vn /Vn /Vn R#) z Args: shards_index: raw parsed msgpack dict. Don't change it or base_url, shards_base_url will be wrong. url: URL of repodata_shards.msgpack.zst rrr rrArrN) rr+rr rIr r rrr\rrV_shard_url_cache)r.rr+channel_base_urls&&& r%r/Shards.__init__s) &f-j9!1 HHd''/334ErJ!  #4#7#78AA"#34  L(  b  % !57 02r(c 6VPP4#r)packages_indexrr9s&r%rShards.package_namess""''))r(c (VPR,#r)rr9s&r%rShards.packages_indexs  **r(cV^8dQhRR/#rr#)r$s"r%r&rs%%%r(c VP#)zi Return self.url joined with shards_base_url. Note shards_base_url can be a relative or an absolute url. )r r9s&r%r Shards.shards_base_urls $$$r(c V^8dQhRRRR/#rr#)r$s"r%r&rs    r(c VPPV4;p'dV#\VPV,4P 4 R2pVP V 2pW@PV&V#)rz .msgpack.zst)rrIbytesrhexr )r.r cached shard_namer+s&& r%r*Shards.shard_urlss **..w7 76 7Md11':;??AB,O %%&zl3),g& r(c V^8dQhRRRR/#rr#)r$s"r%r&rs''C'D'r(c WP9#rrrs&&r%rShards.shard_loadeds,,&&r(c V^8dQhRRRR/#rr#)r$s"r%r&rsSYr(c ,VPV,pV#rrrs&& r%r8Shards.visit_packages W% r()rrr rr\rr+rVN)rrrrrrr/rrrr r*rr8rr#r(r%r6r6se'3R**++%% ' r(r6c V^8dQhRRRR/#)rr rr3r r#)r$s"r%r&r& sFFF5Fr(c \P'dgVPP4'dVPP 4#\ P PPVRRR7h\V4pVPp/pVPpVPpV'd\V4VR&V'd\V4VR&\V\4;_uu_4\P \P"3pVP%WVP&VR7pVP)4VP*p RRR4XP,R8Xd@VP.!R4;_uu_4VPP 4uuRRR4#\ P PP0V/p R \ P PP23R \ P PP43R \ P PP633Fwr\9WW4K VP;V 4X # +'giEL ;i +'giL;i) z Fetch shards index with cache. Update cache state. Return shards data, either newly fetched or from cache. In offline mode, returns cached data even if expired. If no cache exists in offline mode, raises RepodataIsEmpty to signal unavailability. iN) status_coderOz If-None-MatchzIf-Modified-Since)headersproxiesrEi0r+Etagz Last-Modifiedz Cache-Control)rofflinecache_path_shardsexists read_bytescondagatewaysrRepodataIsEmptyrstateetagmodr!r rrGrHrIr/rJrKr-lockURL_KEYETAG_KEYLAST_MODIFIED_KEYCACHE_CONTROL_KEYr ra) r+r r\r9r.r: last_modifiedrErOresponse_bytes saved_fieldsheaderkeys && r%_repodata_shardsrF s  " " ) ) + +**557 7..))99t: #G KKEG ::DIIM #&t9 '*='9#$ 3 2 3 3  / /  , , %[[ '//7)  !!#!)) 4s"ZZ  **557 NN++33S9L ((112  NN # # 5 5  %..11CCD   ,D LL K 4 3 3( s2AI$I8$ I5 8 J c V^8dQhRRRR/#)rsdrr3z Shards | Noner#)r$s"r%r&r&VsVV:V-Vr(cPVPpVPpVPR4;_uu_4p\P!VP 44pVP PV4RRR4TP pTPR4'EdRpTP R\ 2pTPP4'gRTnRTnMRTP#4'g=TPR4;_uu_4TPP%4pRRR4Tf0\'Yr4pTP)RR4TP+T4T'd>\DP!\FPH!T\JR 74p \MY4p T #R# +'giELG;i \\P3dELhi;i +'giL;i \,P.P0P2dHp\5TP64'dTP)RR4TP94Rp?LRp?i\,P:P<dp\?TP@R4'dh\?TP@PBR 4'dB\5TP@PBP64'dTP)RR4TP94Rp?ELRp?ii;i) a Check a SubdirData's URL for shards. Return shards index bytes from cache or network. Return None if not found; caller should fetch normal repodata. TODO: If this function fails to retrieve the sharded repodata index file, it will mark it is as not supporting this feature in cache. This can problematic because sometimes server errors can happen which will lead it to wrongly assuming the channel doesn't support sharding. We need to rethink our logic for determining shard support. r0Nrbr rTFrOr-ri)' repo_fetch repo_cacher<jsonrnreadr9raFileNotFoundErrorJSONDecodeErrorshould_check_format url_w_subdirrr3r4r:r;staler5rFset_has_formatsaver6r7rUnavailableInvalidChannelr r-refresh exceptionsCondaHTTPErrorhasattr _caused_byrOrmrorprqr6) rHr:rK state_filer9 cache_state shards_datashards_index_urlerrrrbs & r%fetch_shards_indexr`Vsg MME!!J __T " "jJJz01E    # #E * #""K&&x00  oo.a0B/CD++2244!K  KO!!##&&(::EEG '   %./?L **8T: ,( ,3MM$$[BUV-LL;FM w# " " t33 4   '&>>**DD %1AA..x?""$$##22 %CNNJ77 7 7GG5//;; ..x?""$$ %sfGAF13GG'<.G:1 G <GGG$#G$' G7 :)L%#=I%% L%L%BL  L%c(V^8dQhRRRRRRRR/#) r shardlikeszSequence[ShardBase]rAz list[str]r"zcache.ShardCacher3list[ShardFetch]r#)r$s"r%r&r&s,((#(/8(GW((r(c VUu.uFp\V\4'gKVNK pp.pVF6pVF-pWc9gK VPW6VPV434K/ K8 \P R\ V44V'gO\P R4.pVF/pVF&pWc9gK VP\W6V44K( K1 V#TPVUU u.uFEvrV NK up p4p .p VFMwr

!fetch_channels.. s@*?}*?sFTz/repodata.json)rWrXrYrrr rZr[r`r]rlryallrrJfetch_latest_parsedr)rsr+ channel_datanon_sharded_channelsre channel_url subdir_datarHrXfutures_non_shardedrffoundr repodata_jsonrs& r%fetch_channelsrs<GU0UnsdnL0U    . .') /    . -  GK$89 9-  $/#4#4#6 #6  OO. 3[ @#6  ! ((55g>F!/KMMOE,1[)$++['+:N,OP ? 3@,*=*=*?@333@,*=*=*?@ @ @-  63NK  w{34??SS 3!((556IJF-5K%}} M !M0Cm1E(- %KE Z*6););)= S)=:3JCJ)= SSc1V    Z TsU H7I H<'I<"I A7II8(I!I,BI I-I< I I ir#)?r __future__rrconcurrent.futuresrWrLlogging collectionsrtypingrrmroconda.exceptionsr6conda.gateways.repodataconda.base.constantsrconda.base.contextrconda.core.subdir_datar!conda.gateways.connection.sessionrr r conda.models.channelr rr miscr rrrr getLoggerrr^collections.abcrrrrequestsrrrrrrqrrABCrrr r6rFr`rnrqrr#r(r%rs #  # 3&-9)!<<!5@@S0S0p- @\)\)~K K\:YYYxFZVr(V#?Tr(