h- dZddlZddlZddlZddlZddlmZmZ ddl m Z dZ dZGddeZGd d eZd Zd Zd ZdZiddefddefddefddefddefddefddefddefddefddefddefd d!efd"d"efd#d#efd$d$efd%d&efd'd(efd)efd*efd+efd,efd-efd.efd/efd0Zdd1iZd8d2Zd3Zd4Zd5ZGd6d7eZy#e $r ddl m Z YwxYw)9a  Parsing for Bandwidth Authority metrics as described in Tor's `bandwidth-file-spec `_. **Module Overview:** :: BandwidthFile - Tor bandwidth authority measurements. .. versionadded:: 1.8.0 N) _mappings_for Descriptor) OrderedDicts=====s====ceZdZdZdZy) RecentStatsaE Statistical information collected over the last 'data_period' (by default five days). :var int consensus_count: number of consensuses published during this period :var int prioritized_relays: number of relays prioritized to be measured :var int prioritized_relay_lists: number of times a set of relays were prioritized to be measured :var int measurement_attempts: number of relay measurements we attempted :var int measurement_failures: number of measurement attempts that failed :var RelayFailures relay_failures: number of relays we failed to measure chd|_d|_d|_d|_d|_t |_yN)consensus_countprioritized_relaysprioritized_relay_listsmeasurement_attemptsmeasurement_failures RelayFailuresrelay_failuresselfs h/var/www/betterdocs.net/sherlock_api/venv/lib/python3.12/site-packages/stem/descriptor/bandwidth_file.py__init__zRecentStats.__init__:s4D"D#'D $D $D'/DN__name__ __module__ __qualname____doc__rrrrr)s  *rrceZdZdZdZy)ra Summary of the number of relays we were unable to measure. :var int no_measurement: number of relays that did not have any successful measurements :var int insuffient_period: number of relays whos measurements were collected over a period that was too small (1 day by default) :var int insufficient_measurements: number of relays we did not collect enough measurements for (2 by default) :var int stale: number of relays whos latest measurement is too old (5 days by default) c<d|_d|_d|_d|_yr )no_measurementinsuffient_periodinsufficient_measurementsstalers rrzRelayFailures.__init__Qs!D!D%)D"DJrNrrrrrrCs  rrc|Sr rvals r_strr%[s *rc@|r|jr t|SdSr )isdigitintr#s r_intr)_sckkmS6$6rct tjjj|S#t$rYywxYwr )stemutil str_tools_parse_iso_timestamp ValueErrorr#s r_dater0cs4 99   3 3C 88  s (+ 77cT|%ttd|jdSdS)Nc"|jSr )strip)vs rz_csv..ks AGGIr,)listmapsplitr#s r_csvr:js';>?c%syy~6 7TPTTrversionsoftwaresoftware_versionearliest_bandwidthlatest_bandwidth created_at file_created generated_atgenerator_startedconsensus_sizenumber_consensus_relayseligible_countnumber_eligible_relayseligible_percentpercent_eligible_relays min_countminimum_number_eligible_relays min_percentminimum_percent_eligible_relaysscanner_countrydestinations_countriestime_to_report_half_networkzrecent_stats.consensus_countrecent_consensus_countz$recent_stats.prioritized_relay_listsrecent_priority_list_countrecent_priority_relay_count recent_measurement_attempt_count recent_measurement_failure_count(recent_measurements_excluded_error_count'recent_measurements_excluded_near_count&recent_measurements_excluded_few_count&recent_measurements_excluded_old_count)zrecent_stats.prioritized_relaysz!recent_stats.measurement_attemptsz!recent_stats.measurement_failuresz*recent_stats.relay_failures.no_measurementz-recent_stats.relay_failures.insuffient_periodz5recent_stats.relay_failures.insufficient_measurementsz!recent_stats.relay_failures.stale1.0.0c+FKt|j|fi|yw)a Iterates over the bandwidth authority metrics in a file. :param file descriptor_file: file with descriptor content :param bool validate: checks the validity of the descriptor's content if **True**, skips these checks otherwise :param dict kwargs: additional arguments for the descriptor constructor :returns: :class:`stem.descriptor.bandwidth_file.BandwidthFile` object :raises: * **ValueError** if the contents is malformed and validate is **True** * **IOError** if the file can't be read N) BandwidthFileread)descriptor_filevalidatekwargss r _parse_fileras# o**,hA&AAs!c &t}tj|j}|j d}d} |j j }|snw|t tfvrnh|sd|vrnad|vrItjjj|jdd\}}|||<|dk(r|}ntd|z|dz }||_t|_t"j%D]w\} \} } |} | jdddD]} t'| | } t)| | jdd| |j+| t,j+| y||dk7r td yy) Nsnode_id===r;z3Header expected to be key=value pairs, but had '%s'.z3The 'version' header must be in the second position)rioBytesIO get_bytesreadliner3 HEADER_DIVHEADER_DIV_ALTr+r,r- _to_unicoder9r/headerr recent_stats HEADER_ATTRitemsgetattrsetattrgetHEADER_DEFAULT) descriptorentriesrocontentindex version_indexlinekeyvalue full_attrkeywordclsobjattrs r _parse_headerrs =& JJz++- .'  %-     # # %D  *n- -  t+  t|99&&2248>>sAFjc5fSk  LtS TT QJE' **'M*#.#4#4#6di'3 C$Sb) C c C%b)3vzz'>CUCUV_C`/a+bc d=A#5 J KK$6rctj|jjj }|j r.t j jt||_ ytd|z)Nz3First line should be a unix timestamp, but was '%s') rhrirjrkr3r'datetimeutcfromtimestampr( timestampr/)rwrx first_lines r_parse_timestamprsezz*..01::<BBD*#,,==c*oNJ JZW XXrctj|j}|jdk(r|j nX|j j dt tfvr- |j j dt tfvr-i}|jD]}tjjj|j }ttd|}|jddj!d}|st#d|z||vrt#d|z|||<||_y)NrZ measurementnode_id$z+Every meaurement must include 'node_id': %szBRelay %s is listed multiple times. It should only be present once.)rhrirjr;rkr3rlrm readlinesr+r,r-rndictrrulstripr/ measurements)rwrxryrr|r fingerprints r _parse_bodyrs) JJz++- .'7"      " " $R^,L L      " " $R^,L L,! %d 99   * *4::< 8D  mT2 3D((9b)005K  DtK LL  $ [^ii jj $L %)*rc eZdZdZdZdefiefiefdZeje e jDcgc] }|dt ffc}}}e ddZdfd ZxZScc}}}w) r\aX Tor bandwidth authority measurements. :var dict measurements: **\*** mapping of relay fingerprints to their bandwidth measurement metadata :var dict header: **\*** header metadata :var datetime timestamp: **\*** time when these metrics were published :var str version: **\*** document format version :var str software: application that generated these metrics :var str software_version: version of the application that generated these metrics :var datetime earliest_bandwidth: time of the first sampling :var datetime latest_bandwidth: time of the last sampling :var datetime created_at: time when this file was created :var datetime generated_at: time when collection of these metrics started :var int consensus_size: number of relays in the consensus :var int eligible_count: relays with enough measurements to be included :var int eligible_percent: percentage of consensus with enough measurements :var int min_count: minimum eligible relays for results to be provided :var int min_percent: minimum measured percentage of the consensus :var str scanner_country: country code where this scan took place :var list destinations_countries: all country codes that were scanned :var int time_to_report_half_network: estimated number of seconds required to measure half the network, given recent measurements :var RecentStats recent_stats: statistical information collected over the last 'data_period' (by default five days) **\*** attribute is either required when we're parsed with validation or has a default value, others are left as **None** if undefined zbandwidth-fileN)rrorc |rtd|jz| t|n t}|jdt t t j }|jdg}|jdtjd}g}d|vr8|jtjjj||dk(r |r td|dk7rd|vrJ|jtjjjd|jdz|jD]B\} } |jtjjj| d| D|jt |D]:} |jtjjj| <d j#|S) a Creates descriptor content with the given attributes. This descriptor type differs somewhat from others and treats our attr/exclude attributes as follows... * 'timestamp' is a reserved key for our mandatory header unix timestamp. * 'content' is a reserved key for our bandwidth measurement lines. * All other keys are treated as header fields. For example... :: BandwidthFile.content({ 'timestamp': '12345', 'version': '1.2.0', 'content': [], }) zSigning of %s not implementedrryr;rZz2Headers require BandwidthFile version 1.1 or laterz version=%sre )NotImplementedErrorrrpopstrr(timerurvappendr+r,r- _to_bytesr/rrrljoin) rrexcludesignrorryr;lineskr4rs rryzBandwidthFile.content4s0  ?#,, N OO"&"2[  F ;C ,<(=>IjjB'GjjN$6$6y$ABG E'! ll499&&00;<'f K LL G  ' ! TYY((22<&**YBW3WXY,,.F$!Q TYY((22a3CDEF ll:?  ll499&&00=>? ::e rctt| || |r%t|dt |dt |dyy)N) lazy_load)superr\rrrr)r raw_contentr_ __class__s rrzBandwidthFile.__init__ks? -' X'NtT"D$$r)NrFF)rrrrTYPE_ANNOTATION_NAMErrr ATTRIBUTESupdaterrqkeys classmethodryr __classcell__).0rrrs000@rr\r\s#J*()=!%*  Dk>N>N>PQQ1t]34QRS44lsRsA(r\r)rrrhrstem.util.str_toolsr+stem.descriptorrr collectionsr ImportErrorstem.util.ordereddictrlrmobjectrrr%r)r0r:rqrvrarrrr\rrrrs$   0% *&*4F0 7U ' i '  z4 ' )40 '-u5')51'''&.'.5' -t4!'"0$7#'$0$7%'&3T:''.'./'05t<1'8 "?!F9'<!#;T"B='>)+G*N?'@'DT%J(JD'Q(JD'Q1[]a0b4]_c3d