o b2@s dZddlZddlZddlZzddlZWn eydZYnwddlmZddlm Z m Z ddl m Z m Z ddlmZmZddlmZmZmZmZmZmZmZmZmZmZmZddlmZdd lm Z dd l!m"Z"ee j#$e  d Gd d d e"Z%ee j#$e  d Gddde"Z&dS)z Whitebox tests for TCP APIs. N)skipIf) interfacesreactor) gatherResults maybeDeferred)Protocol ServerFactory) _ACCEPT_ERRORSEAGAIN ECONNABORTED EINPROGRESSEMFILEENFILEENOBUFSENOMEMEPERM EWOULDBLOCKPort)log)platform)TestCasez?This test only applies to reactors that implement IReactorFDsetc@sFeZdZdZdZddZddZddZee d kd d d Z d S)PlatformAssumptionsTestsz4 Test assumptions about platform behaviors. i cCs`g|_tdur.ddlm}t|d}ttj|_ttj||jdf|d|_ dSdS)Nr) _listOpenFDsd) openSocketsresourcetwisted.internet.processrlen getrlimit RLIMIT_NOFILEoriginalFileLimit setrlimit socketLimit)selfrnewLimitr'A/usr/lib/python3/dist-packages/twisted/test/test_tcp_internals.pysetUp4s zPlatformAssumptionsTests.setUpcCs\|jr |j|jstdur,ttjd}t|jd|}ttj||fdSdS)Nrr) rpopcloserr r!minr"r#)r%currentHardLimit newSoftLimitr'r'r(tearDownFsz!PlatformAssumptionsTests.tearDowncCst}|j||S)z| Create and return a new socket object, also tracking it so it can be closed in the test tear down. )socketrappend)r%sr'r'r(r0Rs zPlatformAssumptionsTests.socketwin32zhWindows requires an unacceptably large amount of resources to provoke this behavior in the naive manner.c Cs|}|d|d}|d|}|dt|jD]%}z|Wq"tyG}z|jdt t fvrBWYd}~n d}~ww| d| | d|fdtf|tj|j}| |jdt t fdS) z Test that the platform accept(2) call fails with either L{EMFILE} or L{ENOBUFS} when there are too many file descriptors open. ) 127.0.0.1rrFrNz7Could provoke neither EMFILE nor ENOBUFS from platform.r4)r0bind getsocknamelisten setblockingranger$OSErrorargsr rfailassertIn connect_exr assertRaiseserroraccept)r%portserverPortNumberclientieexcr'r'r(test_acceptOutOfFiles[s*      z.PlatformAssumptionsTests.test_acceptOutOfFilesN) __name__ __module__ __qualname____doc__r$r)r/r0rrgetTyperIr'r'r'r(r)s  rc@seZdZdZddZddZddZdd Zd d Zd d Z ddZ e e dkdddZe e dkdddZe ejddkdddZe e dkdddZdd Zd!S)"SelectReactorTestsz7 Tests for select-specific failure conditions. cCsg|_g|_t|jjdSN)portsmessagesr addObserverr1r%r'r'r(r)szSelectReactorTests.setUpcCs"t|jjtdd|jDS)NcSsg|]}t|jqSr')r stopListening).0pr'r'r( sz/SelectReactorTests.tearDown..)rremoveObserverrRr1rrQrTr'r'r(r/szSelectReactorTests.tearDowncCs&t|||d}||j||S)z Create, start, and return a new L{Port}, also tracking it so it can be stopped in the test tear down.  interface)rstartListeningrQr1)r% portNumberfactoryr[rWr'r'r(rCs zSelectReactorTests.portcsGfddd}t}|jd|dd}||d||dtjfdd |jD}|t|dd |jfd S) a Test behavior in the face of an exception from C{accept(2)}. On any exception which indicates the platform is unable or unwilling to allocate further resources to us, the existing port should remain listening, a message should be logged, and the exception should not propagate outward from doRead. @param socketErrorNumber: The errno to simulate from accept. ceZdZdZfddZdS)z9SelectReactorTests._acceptFailureTest..FakeSocketzI Pretend to be a socket in an overloaded system. csttrP)r;osstrerrorrTsocketErrorNumberr'r(rBsz@SelectReactorTests._acceptFailureTest..FakeSocket.acceptNrJrKrLrMrBr'rbr'r( FakeSocketsrerr4rZr0z/Could not accept new connection ({acceptError})cs(g|]}|dko|dkqS) log_format acceptError)get)rVmsg)expectedErrorCodeexpectedFormatr'r(rXs  z9SelectReactorTests._acceptFailureTest..z+Log event for failed accept not found in %rN) rrCpatchdoReaderrno errorcoderR assertGreaterr)r%rcrer^rCmatchingMessagesr')rjrkrcr(_acceptFailureTests    z%SelectReactorTests._acceptFailureTestcC |tS)a* C{accept(2)} can fail with C{EMFILE} when there are too many open file descriptors in the process. Test that this doesn't negatively impact any other existing connections. C{EMFILE} mainly occurs on Linux when the open file rlimit is encountered. )rrr rTr'r'r(test_tooManyFilesFromAccept z.SelectReactorTests.test_tooManyFilesFromAcceptcCrs)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOBUFS}. This mainly occurs on Windows and FreeBSD, but may be possible on Linux and other platforms as well. )rrrrTr'r'r(test_noBufferSpaceFromAccept z/SelectReactorTests.test_noBufferSpaceFromAcceptcCrs)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ECONNABORTED}. It is not clear whether this is actually possible for TCP connections on modern versions of Linux. )rrr rTr'r'r( test_connectionAbortedFromAcceptrwz3SelectReactorTests.test_connectionAbortedFromAcceptr3z(Windows accept(2) cannot generate ENFILEcCrs)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENFILE}. This can occur on Linux when the system has exhausted (!) its supply of inodes. )rrrrTr'r'r(test_noFilesFromAcceptruz)SelectReactorTests.test_noFilesFromAcceptz(Windows accept(2) cannot generate ENOMEMcCrs)a Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOMEM}. On Linux at least, this can sensibly occur, even in a Python program (which eats memory like no ones business), when memory has become fragmented or low memory has been filled (d_alloc calls kmem_cache_alloc calls kmalloc - kmalloc only allocates out of low memory). )rrrrTr'r'r(test_noMemoryFromAccepts z*SelectReactorTests.test_noMemoryFromAcceptINFRASTRUCTUREAZUREPIPELINESz(Hangs on Azure Pipelines due to firewallcst}t|_|jd|dd|jgfdd}||fdd}|d_| jd|| jd| jdd S) z L{tcp.Port.doRead} increases the number of consecutive C{accept} calls it performs if all of the previous C{accept} calls succeed; otherwise, it reduces the number to the amount of successful calls. rr4rZcsD]}|qdSrP)r+rE)clientsr'r(closeAlls z7SelectReactorTests.test_acceptScaling..closeAllcs(ttjtj}|djf|S)Nr4)r0AF_INET SOCK_STREAMconnectgetHostrCr})rCr'r(rsz6SelectReactorTests.test_acceptScaling..connectrN) rrprotocolrC addCleanuprUr1 numberAcceptsrmrp assertEqual)r%r^rrr')r~rCr(test_acceptScalings"       z%SelectReactorTests.test_acceptScalingz'Windows accept(2) cannot generate EPERMcsddgGfddd}tD] }tj|jqj|jdgt}jd|dd}d|_ |d||  |jdd S) z C{accept(2)} returning C{EPERM} is treated as a transient failure and the call retried no more than the maximum number of consecutive C{accept(2)} calls. {rcs eZdZdZfddZdS)zLSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit Pretend to be a socket in an overloaded system whose C{accept} method can only be called C{maximumNumberOfAccepts} times. cs6dd7<dkrdtttt)Nrrz(Maximum number of accept calls exceeded.)r=r;rr`raoself acceptCallsmaximumNumberOfAcceptsr%r'r(rBCs  zSSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit.acceptNrdr'rr'r(FakeSocketWithAcceptLimit<srr4rZr0rN) r:r@r0rArBfailureExceptionrrCrrlrm assertEquals)r%r_r^rCr'rr(test_permissionFailure2s z)SelectReactorTests.test_permissionFailurecstt}|tttgtdd|DdGfddd}t}|jd|dd}| |d || | t j }|dt|||djjdd S) z} A C{socket.error} raised by C{accept(2)} whose C{errno} is unknown to the recovery logic is logged. css|] }t|tr|VqdSrP) isinstanceint)rVrAr'r'r( gszBSelectReactorTests.test_unknownSocketErrorRaise..rcr_)zYSelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptErrorrcs td)Nzunknown socket error message)r;runknownAcceptErrorr'r(rBqs z`SelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptError.acceptNrdr'rr'r( FakeSocketWithUnknownAcceptErrorjsrrr4rZr0N)listr extendr rrmaxrrCrlrmflushLoggedErrorsr0rArrvaluer<)r% knownErrorsrr^rCfailuresr'rr(test_unknownSocketErrorRaise^s  z/SelectReactorTests.test_unknownSocketErrorRaiseN)rJrKrLrMr)r/rCrrrtrvrxrrrNryrzr`environrhrrrr'r'r'r(rOs* )      )  +rO)'rMrnr`r0r ImportErrorunittestrtwisted.internetrrtwisted.internet.deferrrtwisted.internet.protocolrrtwisted.internet.tcpr r r r r rrrrrrtwisted.pythonrtwisted.python.runtimertwisted.trial.unittestr IReactorFDSet providedByrrOr'r'r'r(s6   4   [