o b @sdZddlmZmZddlmZmZmZmZm Z m Z m Z m Z ddl mZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZeZeeefZd edefddZ dedefddZ!ddedddddfddede e!fgZ"dde"DZ#dede$fddZ%d e$defd!d"Z&d#edefd$d%Z'd&edefd'd(Z( )d4d*eed+edefd,d-Z) . /d5d0eed+e ed1e*de efd2d3Z+d.S)6zA Tools for saving and loading log events in a structured format. )dumpsloads)IOAnyAnyStrDictIterableOptionalUnioncast)UUID) NamedConstant)FailureFileLogObserver) flattenEvent)LogEvent)LogLevel)LoggerfailurereturncCs t|t|jj|jjddS)z Convert a failure to a JSON-serializable data structure. @param failure: A failure to serialize. @return: a mapping of strings to ... stuff, mostly reminiscent of L{Failure.__getstate__} ) __module____name__)type)dict __getstate__rrr)rr6/usr/lib/python3/dist-packages/twisted/logger/_json.py failureAsJSONs r failureDictcCs0tt}|d}t|dd||d<||_|S)z Load a L{Failure} from a dictionary deserialized from JSON. @param failureDict: a JSON-deserialized object like one previously returned by L{failureAsJSON}. @return: L{Failure} rrr)r__new__r__dict__)r ftypeInforrrfailureFromJSON.s r%cCst|to tt|jd|uSN) isinstancer getattrrnamelevelrrr@s r,z$02E59486-F24D-46AD-8224-3ACDF2A5732AcCs t|jdS)N)r))rr)r*rrrr,Es cCstt|ddS)Nr))r(rr*rrrr,FscCs t|tSr&)r'r)orrrr,Is z$E76887E2-20ED-49BF-A8F8-BA25CC586F2DcCsi|] \}}}}||qSrr).0 predicateuuidsaverloaderrrr Qsr3aDictcCs d|vrtt|d|S|S)a# Dictionary-to-object-translation hook for certain value types used within the logging system. @see: the C{object_hook} parameter to L{json.load} @param aDict: A dictionary loaded from a JSON object. @return: C{aDict} itself, or the object represented by C{aDict} __class_uuid__) uuidToLoaderr )r4rrrobjectLoadHookTs r7 pythonObjectcCs>tD]\}}}}||r||}t||d<|SqddiS)a Object-to-serializable hook for certain value types used within the logging system. @see: the C{default} parameter to L{json.dump} @param pythonObject: Any object. @return: If the object is one of the special types the logging system supports, a specially-formatted dictionary; otherwise, a marker dictionary indicating that it could not be serialized. r5 unpersistableT) classInfostr)r8r/r0r1r2resultrrrobjectSaveHookds  r=eventcCs0dtdtttffdd}t|t||ddS)a Encode an event as JSON, flattening it if necessary to preserve as much structure as possible. Not all structure from the log event will be preserved when it is serialized. @param event: A log event dictionary. @return: A string of the serialized JSON; note that this will contain no newline characters, and may thus safely be stored in a line-delimited file. unencodablercSst|tr |dSt|S)z Serialize an object not otherwise serializable by L{dumps}. @param unencodable: An unencodable object. @return: C{unencodable}, serialized charmap)r'bytesdecoder=)r?rrrdefaults  zeventAsJSON..defaultT)rCskipkeys)objectr JSONDictr;rr)r>rCrrr eventAsJSONys rG eventTextcCsttt|tdS)z Decode a log event from JSON. @param eventText: The output of a previous call to L{eventAsJSON} @return: A reconstructed version of the log event. ) object_hook)r rFrr7)rHrrr eventFromJSONsrJoutFilerecordSeparatorcst|fddS)a Create a L{FileLogObserver} that emits JSON-serialized events to a specified (writable) file-like object. Events are written in the following form:: RS + JSON + NL C{JSON} is the serialized event, which is JSON text. C{NL} is a newline (C{"\n"}). C{RS} is a record separator. By default, this is a single RS character (C{"\x1e"}), which makes the default output conform to the IETF draft document "draft-ietf-json-text-sequence-13". @param outFile: A file-like object. Ideally one should be passed which accepts L{str} data. Otherwise, UTF-8 L{bytes} will be used. @param recordSeparator: The record separator to use. @return: A file log observer. cst|dS)N )rG)r>rMrrr,sz%jsonFileLogObserver..r)rLrMrrOrjsonFileLogObservers rPNinFile bufferSizec #sdtdtfdd}dtdttfdd|dur*||d }|d kr'|}n d }n||}d }|d kr9d }}n dtdttffd d }t|} ||}|set|dkrc||} | durc| VdS|||7}||} | ddD]} t| dkr|| } | dur| Vqv| d}qK)aM Load events from a file previously saved with L{jsonFileLogObserver}. Event records that are truncated or otherwise unreadable are ignored. @param inFile: A (readable) file-like object. Data read from C{inFile} should be L{str} or UTF-8 L{bytes}. @param recordSeparator: The expected record separator. If L{None}, attempt to automatically detect the record separator from one of C{"\x1e"} or C{""}. @param bufferSize: The size of the read buffer used while reading from C{inFile}. @return: Log events as read from C{inFile}. srcSst|tr|S|dS)Nutf-8)r'rAencode)rTrrrasBytess  z&eventsFromJSONLogFile..asBytesrecordcSslz t|d}Wntytjdt|dYdSwzt|WSty5tjdt|dYdSw)NrUz2Unable to decode UTF-8 for JSON record: {record!r}rXz&Unable to read JSON record: {record!r})rArBUnicodeDecodeErrorlogerrorrJ ValueError)rXtextrrreventFromBytearrays   z1eventsFromJSONLogFile..eventFromBytearrayNr cs.|dtdkr |Stjdt|ddS)NrNz0Unable to read truncated JSON record: {record!r}rY)ordr[r\rArYr_rreventFromRecordsz.eventsFromJSONLogFile..eventFromRecordTrrc)rrA bytearrayr rreadlensplit) rRrMrSrWfirstrecordSeparatorBytesrfbuffernewDatar>recordsrXrrereventsFromJSONLogFilesB      rp)rK)NrQ),__doc__jsonrrtypingrrrrrr r r r0r constantlyr twisted.python.failurer_filer_flattenr _interfacesr_levelsr_loggerrr[r;rFrr%r:r6rEr7r=rGrJrPintrprrrrsd(