o fa;@sJddlZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl m Z ddlm Z ddl m Z ddlmZmZddlmZeeZGdddeZGd d d ejd ZGd d d eZGdddeZGdddeZGdddeZe eeeeefZeZe dee dee dee dedS)N)datetime)Event)Union) url_helperutil) DictRegistryc@s eZdZdS)ReportExceptionN)__name__ __module__ __qualname__r r >/usr/lib/python3/dist-packages/cloudinit/reporting/handlers.pyrsrc@s&eZdZdZejddZddZdS)ReportingHandlerzBase class for report handlers. Implement :meth:`~publish_event` for controlling what the handler does with an event. cCdS)zPublish an event.Nr selfeventr r r publish_event"zReportingHandler.publish_eventcCr)z0Ensure ReportingHandler has published all eventsNr rr r r flush&rzReportingHandler.flushN)r r r __doc__abcabstractmethodrrr r r r rs   r) metaclasscs*eZdZdZdfdd ZddZZS) LogHandlerzBPublishes events to the cloud-init log at the ``DEBUG`` log level.DEBUGcs`tt|t|tr n|}z tt|}Wnty*t d|tj }Ynw||_ dS)Nzinvalid level '%s', using WARN) superr__init__ isinstanceintgetattrloggingupper ExceptionLOGwarningWARNlevel)rr( input_level __class__r r r-s     zLogHandler.__init__cCs2tddd|j|jg}||j|dS)N. cloudinit reporting)r" getLoggerjoin event_typenamelogr( as_string)rrloggerr r r r:szLogHandler.publish_event)r)r r r rrr __classcell__r r r*r r*s rc@seZdZdZddZdS) PrintHandlerzPrint the event as a string.cCst|dSN)printr4rr r r rDszPrintHandler.publish_eventN)r r r rrr r r r r7As r7csBeZdZ      d fdd ZddZddZdd ZZS) WebHookHandlerNc stt|t||||grtj||||d}|j|_ntj|_||_||_||_ t |_ t |_t|_tj|jd|_d|j_|jdS)N) consumer_key token_key token_secretconsumer_secrettargetT)rr:ranyrOauthUrlHelperreadurlendpointtimeoutretriesrfetch_ssl_details ssl_detailsrflush_requestedqueueQueue threadingThreadprocess_requestsevent_processordaemonstart) rrDr;r<r=r>rErF oauth_helperr*r r rIs&    zWebHookHandler.__init__c Csd} |jr'|dkr'td|js%|j|j|jrd}|jjdd}z@z|j |d|d|d|d|dd d d}Wnt yg}ztd |d||d7}WYd}~nd}~wwW|jn|jwq) NrTzNMultiple consecutive failures in WebHookHandler. Cancelling all queued events.blockF)datarErFrH log_req_respz0Failed posting event: %s. This was caused by: %s) rIis_setr%r&rJempty get_nowait task_donegetrCr$)rconsecutive_failedargser r r rNjsD    zWebHookHandler.process_requestscCs@|}td|j||j|jt||j|j |j fdS)NzQueuing POST to %s, data: %s) as_dictr%debugrDrJputjsondumpsrErFrH)rr event_datar r r rszWebHookHandler.publish_eventcCs,|jtd|j|jdS)Nz(WebHookHandler flushing remaining events)rIsetr%rdrJr0clearrr r r rs   zWebHookHandler.flush)NNNNNN)r r r rrNrrr6r r r*r r:Hs!&r:cseZdZdZdZdZdZeeZdZdZ dZ dZ d Z d Z d Ze d ffd d ZeddZddZddZddZddZddZddZddZded ed!d fd"d#Zd$d%Zd&d'Zd(d)Zd*d+ZZS),HyperVKvpReportingHandlera, Reports events to a Hyper-V host using Key-Value-Pair exchange protocol and can be used to obtain high level diagnostic information from the host. To use this facility, the KVP user-space daemon (hv_kvp_daemon) has to be running. It reads the kvp_file when the host requests the guest to enumerate the KVP's. This reporter collates all events for a module (origin|name) in a single json string in the dictionary. For more information, see https://technet.microsoft.com/en-us/library/dn798287.aspx#Linux%20guests iii CLOUD_INITmsgresultmsg_i),:z/var/lib/hyperv/.kvp_pool_1FNcsrtt|||_t|j||_t|_| |_ d |j |j |_ tj|jd|_d|j_|jdS)Nz{0}|{1}r?T)rrkr_kvp_file_path_truncate_guest_pool_file _event_typesrJrKq_get_incarnation_noincarnation_noformat EVENT_PREFIXevent_key_prefixrLrM_publish_event_routinepublish_threadrPrQ)r kvp_file_path event_typesr*r r rs   z"HyperVKvpReportingHandler.__init__c Cs|jrdSttt}zFztj||kr.t|dWdn1s)wYWnt t fyI}z t d|WYd}~n d}~wwWd|_dSWd|_dSd|_w)a Truncate the pool file if it has not been truncated since boot. This should be done exactly once for the file indicated by KVP_POOL_FILE_GUEST constant above. This method takes a filename so that we can use an arbitrary file during unit testing. Since KVP is a best-effort telemetry channel we only attempt to truncate the file once and only if the file has not been modified since boot. Additional truncation can lead to loss of existing KVPs. Nwz$failed to truncate kvp pool file, %sT) _already_truncated_pool_filetimefloatruptimeospathgetmtimeopenOSErrorIOErrorr%r&)clskvp_file boot_timerbr r r rss"   z3HyperVKvpReportingHandler._truncate_guest_pool_filecCs@t}z ttt|WStytd|YdSw)z use the time passed as the incarnation number. the incarnation number is the number which are used to distinguish the old data stored in kvp and the new data. z"uptime '%s' not in correct format.r)rrr rr ValueErrorr%r&)r uptime_strr r r rvs  z-HyperVKvpReportingHandler._get_incarnation_noccst|jd>}t|tj||||j}t||jkr6| |}|V||j}t||jks!t|tj WddS1sHwYdS)z-iterate the kvp file from the current offset.rbN) rrrfcntlflockLOCK_EXseekreadHV_KVP_RECORD_SIZElen_decode_kvp_itemLOCK_UN)roffsetf record_datakvp_itemr r r _iterate_kvpss    "z'HyperVKvpReportingHandler._iterate_kvpscCsd|j|j|jtS)z the event key format is: CLOUD_INIT|||| [|subevent_index] z{0}|{1}|{2}|{3})rxrzr1r2uuiduuid4rr r r _event_key sz$HyperVKvpReportingHandler._event_keycCs*td|j|jf|d|d}|S)Nz%ds%dsutf-8)structpackHV_KVP_EXCHANGE_MAX_KEY_SIZEHV_KVP_EXCHANGE_MAX_VALUE_SIZEencoderkeyvaluerYr r r _encode_kvp_items z*HyperVKvpReportingHandler._encode_kvp_itemcCsdt|}||jkrtd||j|d|jdd}||j|jdd}||dS)Nz$record_data len not correct {0} {1}.rr)rr)rrrrxrdecodestrip)rrrecord_data_lenkvr r r r!s$    z*HyperVKvpReportingHandler._decode_kvp_itemcCsjt|jd%}t|tj|D]}||q|t|tjWddS1s.wYdS)Nab)rrrrrrwriterr)rrrrYr r r _append_kvp_item8s "z*HyperVKvpReportingHandler._append_kvp_itemc Cs||j=t|}|dt|d}d}g}d|jd} |||j<d||j<tj||jd}|jt|d} ||d j|j|d| d } d ||} | | | | |d7}|| d}t|dkrl |Sq) NrVr"z":""T separatorsz"{key}":"{desc}")rdescz{}|{}) MSG_KEYrfrgr DESC_IDX_KEYJSON_SEPARATORSHV_KVP_AZURE_MAX_VALUE_SIZEreplacerxappendr) rr meta_data description des_in_jsoni result_arraymessage_place_holderdata_without_desc room_for_descrsubkeyr r r _break_down@s8      z%HyperVKvpReportingHandler._break_downrrreturnc Csft||jkr|d|jd}|||g}z||WdSttfy2td||YdSw)zJWrite KVP key-value. Values will be truncated as needed. rrVzfailed posting kvp=%s value=%sN)rrrrrrr%r&rr r r write_key^sz#HyperVKvpReportingHandler.write_keycCs||}|j|jt|jdd}t||jr!|j ||j<|j ||j <t j ||jd}t||jkr>||||j S|||}|gS)z encode the event into kvp data bytes. if the event content reaches the maximum length of kvp value. then it would be cut to multiple slices. Z)r2typetsr)rr2r1rutcfromtimestamp timestamp isoformathasattr RESULT_KEYrnrrrfrgrrrrr)rrrrrrYr r r _encode_eventms     z'HyperVKvpReportingHandler._encode_eventc Cs  d}zv|jjdd}|d7}g}|dur:|||7}z |jjdd}|d7}Wn tjy5d}Ynw|dusz0z||Wnttfy\}z t d|WYd}~nd}~wwWt |D]}|j qbn t |D]}|j qowWn t yYdSwq)NTrrTrVFz failed posting events to kvp, %s) rur_rrJEmptyrrrr%r&ranger^EOFError)ritems_from_queuer encoded_datarb_r r r r{s>     z0HyperVKvpReportingHandler._publish_event_routinecCs&|jr |j|jvr|j|dSdSr8)rtr1rurerr r r rsz'HyperVKvpReportingHandler.publish_eventcCstd|jdS)Nz0HyperVReportingHandler flushing remaining events)r%rdrur0rr r r rs zHyperVKvpReportingHandler.flush) r r r rrrrrryrrrrKVP_POOL_FILE_GUESTrr classmethodrsrvrrrrrrstrrrr{rrr6r r r*r rks:     rkr3r9webhookhyperv)!rrrfr"rrJrrLrrrrtypingrr-rrcloudinit.registryrr/r r%r$rABCMetarrr7r:rk HandlerTypeavailable_handlers register_itemr r r r sJ     `