oj2dZddlZddlZddlZ ddlZddlmZddlm Z m Z ddl m Z m Z ddlmZmZddlmZmZmZmZmZmZmZmZmZmZmZddlmZdd lm Z dd l!m"Z"ee jFjIe  d Gd d e"Z%ee jFjIe  d Gdde"Z&y#e$rdZYwxYw)z Whitebox tests for TCP APIs. N)skipIf) interfacesreactor) gatherResults maybeDeferred)Protocol ServerFactory) _ACCEPT_ERRORSEAGAIN ECONNABORTED EINPROGRESSEMFILEENFILEENOBUFSENOMEMEPERM EWOULDBLOCKPort)log)platform)TestCasez?This test only applies to reactors that implement IReactorFDsetcheZdZdZdZdZdZdZee jdk(ddZ y ) PlatformAssumptionsTestsz4 Test assumptions about platform behaviors. i cg|_tddlm}t |dz}tj tj |_tjtj ||jdf|dz|_ yy)Nr) _listOpenFDsd) openSocketsresourcetwisted.internet.processrlen getrlimit RLIMIT_NOFILEoriginalFileLimit setrlimit socketLimit)selfrnewLimits A/usr/lib/python3/dist-packages/twisted/test/test_tcp_internals.pysetUpzPlatformAssumptionsTests.setUp4s{   ><>*Q.H%-%7%78N8N%OD "   &&43I3I!3L(M  (#~D  c^|jr5|jjj|jr5tftjtj d}t |jd|}tjtj ||fyy)Nrr) rpopcloser r#r$minr%r&)r(currentHardLimit newSoftLimits r*tearDownz!PlatformAssumptionsTests.tearDownFs    " ( ( *   (11(2H2HI!L t55a8:JKL   x55 FV7W X r,cdtj}|jj||S)z| Create and return a new socket object, also tracking it so it can be closed in the test tear down. )socketrappend)r(ss r*r5zPlatformAssumptionsTests.socketRs( MMO "r,win32zhWindows requires an unacceptably large amount of resources to provoke this behavior in the naive manner.c|j}|jd|jd}|jd|j}|j dt |j D]} |j|jd|j|jd|fdtf|jtj |j"}|j|jdttfy#t$r'}|jdttfvrYd}~d}~wwxYw) z Test that the platform accept(2) call fails with either L{EMFILE} or L{ENOBUFS} when there are too many file descriptors open. ) 127.0.0.1rrFrNz7Could provoke neither EMFILE nor ENOBUFS from platform.r:)r5bind getsocknamelisten setblockingranger'OSErrorargsrrfailassertIn connect_exr assertRaiseserroraccept)r(portserverPortNumberclientieexcs r*test_acceptOutOfFilesz.PlatformAssumptionsTests.test_acceptOutOfFiles[s {{} "#++-a0 A5!t''( QA   Q IIO P   {,<= >K@P  dkk: chhqkFG#45% 66!9 11  sD  E)E  E  EN) __name__ __module__ __qualname____doc__r'r+r3r5rrgetTyperOr,r*rr)sO K.$ Y g% 5 %6  %6r,rc\eZdZdZdZdZdZdZdZdZ dZ e e jd k(d d Ze e jd k(d d Ze ej"j%ddk(ddZe e jd k(ddZdZy)SelectReactorTestsz7 Tests for select-specific failure conditions. crg|_g|_tj|jjyN)portsmessagesr addObserverr6r(s r*r+zSelectReactorTests.setUps&    ,,-r,ctj|jjt |j Dcgc]}t |jc}Scc}wrY)rremoveObserverr[r6rrZr stopListening)r(ps r*r3zSelectReactorTests.tearDowns@ 4==//0djjQmAOO<QRRQsA cxt|||}|j|jj||S)z Create, start, and return a new L{Port}, also tracking it so it can be stopped in the test tear down.  interface)rstartListeningrZr6)r( portNumberfactoryrdras r*rIzSelectReactorTests.ports5 W :  !r,cGfdd}t}|jd|d}|j|d||jd}tj }|j Dcgc],}|jd|k(xr|jd |k(.}}|jt|dd |j y cc}w) a Test behavior in the face of an exception from C{accept(2)}. On any exception which indicates the platform is unable or unwilling to allocate further resources to us, the existing port should remain listening, a message should be logged, and the exception should not propagate outward from doRead. @param socketErrorNumber: The errno to simulate from accept. ceZdZdZfdZy)9SelectReactorTests._acceptFailureTest..FakeSocketzI Pretend to be a socket in an overloaded system. cBttjrY)rAosstrerror)r(socketErrorNumbers r*rHz@SelectReactorTests._acceptFailureTest..FakeSocket.accepts/=N1OPPr,NrPrQrRrSrH)rnsr* FakeSocketrjs  Qr,rprr:rcr5z/Could not accept new connection ({acceptError}) log_format acceptErrorz)Log event for failed accept not found in N) r rIpatchdoReaderrno errorcoder[get assertGreaterr") r(rnrprgrIexpectedFormatexpectedErrorCodemsgmatchingMessagess ` r*_acceptFailureTestz%SelectReactorTests._acceptFailureTests Q Q /yyG{y; 4:<0 J!OO,=> }}   %7@GGM*.??@     ! @D O  s71Cc,|jtS)a* C{accept(2)} can fail with C{EMFILE} when there are too many open file descriptors in the process. Test that this doesn't negatively impact any other existing connections. C{EMFILE} mainly occurs on Linux when the open file rlimit is encountered. )r}rr]s r*test_tooManyFilesFromAcceptz.SelectReactorTests.test_tooManyFilesFromAccept&&v..r,c,|jtS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOBUFS}. This mainly occurs on Windows and FreeBSD, but may be possible on Linux and other platforms as well. )r}rr]s r*test_noBufferSpaceFromAcceptz/SelectReactorTests.test_noBufferSpaceFromAccepts&&w//r,c,|jtS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ECONNABORTED}. It is not clear whether this is actually possible for TCP connections on modern versions of Linux. )r}r r]s r* test_connectionAbortedFromAcceptz3SelectReactorTests.test_connectionAbortedFromAccepts&&|44r,r8z(Windows accept(2) cannot generate ENFILEc,|jtS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENFILE}. This can occur on Linux when the system has exhausted (!) its supply of inodes. )r}rr]s r*test_noFilesFromAcceptz)SelectReactorTests.test_noFilesFromAcceptrr,z(Windows accept(2) cannot generate ENOMEMc,|jtS)a Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOMEM}. On Linux at least, this can sensibly occur, even in a Python program (which eats memory like no ones business), when memory has become fragmented or low memory has been filled (d_alloc calls kmem_cache_alloc calls kmalloc - kmalloc only allocates out of low memory). )r}rr]s r*test_noMemoryFromAcceptz*SelectReactorTests.test_noMemoryFromAccepts&&v..r,INFRASTRUCTUREAZUREPIPELINESz(Hangs on Azure Pipelines due to firewallc8t}t|_|jd|d|j j gfd}|j |fd}j |d_j|jjdj |j|jjdj|jjdy)z L{tcp.Port.doRead} increases the number of consecutive C{accept} calls it performs if all of the previous C{accept} calls succeed; otherwise, it reduces the number to the amount of successful calls. rr:rcc4D]}|jyrY)r/)rKclientss r*closeAllz7SelectReactorTests.test_acceptScaling..closeAlls!   r,ctjtjtj}|jdj j f|S)Nr:)r5AF_INET SOCK_STREAMconnectgetHostrI)rKrIs r*rz6SelectReactorTests.test_acceptScaling..connects?]]6>>63E3EFF NNK)<)<= >Mr,rN) r rprotocolrI addCleanupr`r6 numberAcceptsrtrx assertEqual)r(rgrrrrIs @@r*test_acceptScalingz%SelectReactorTests.test_acceptScalings /#yyG{y; **+  !  wy!  4--q1wy!  ++Q/  ++Q/r,z'Windows accept(2) cannot generate EPERMcddgGfdd}tD]1}jtj|j3jj |jdgt }jd|d}d|_j|d||jj|jdy ) z C{accept(2)} returning C{EPERM} is treated as a transient failure and the call retried no more than the maximum number of consecutive C{accept(2)} calls. {rc eZdZdZfdZy)LSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit Pretend to be a socket in an overloaded system whose C{accept} method can only be called C{maximumNumberOfAccepts} times. cdxxdz cc<dkDrjdtttjt)Nrrz(Maximum number of accept calls exceeded.)rCrArrlrm)oself acceptCallsmaximumNumberOfAcceptsr(s r*rHzSSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit.acceptCsAA!#q>$::IIHIeR[[%788r,Nro)rrr(sr*FakeSocketWithAcceptLimitr<s    9r,rr:rcr5rN) r@rFr5rGrHfailureExceptionr rIrrsrt assertEquals)r(r_rgrIrrs` @@r*test_permissionFailurez)SelectReactorTests.test_permissionFailure2s"%c  9 9-. PA   fll,E,G,N,N O P $//1J1L1S1STc /yyG{y;  4#<#>?  $,,a0r,ctt}|jttt gt d|DdzGfdd}t}|jd|d}|j|d||j|jtj}|jdt||j|dj j"dy ) z} A C{socket.error} raised by C{accept(2)} whose C{errno} is unknown to the recovery logic is logged. c3BK|]}t|ts|ywrY) isinstanceint).0rGs r* zBSelectReactorTests.test_unknownSocketErrorRaise..gsI%*UC2HIsrceZdZdZfdZy)YSelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptErrorrctd)Nzunknown socket error message)rA)runknownAcceptErrors r*rHz`SelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptError.acceptqs02PQQr,Nro)rsr* FakeSocketWithUnknownAcceptErrorrjs   Rr,rrr:rcr5N)listr extendr rrmaxr rIrsrtflushLoggedErrorsr5rGrr"valuerB)r( knownErrorsrrgrIfailuresrs @r*test_unknownSocketErrorRaisez/SelectReactorTests.test_unknownSocketErrorRaise^s >* FE;78 I;I IA M  R R /yyG{y; 4#C#EF ))&,,7 CM* !**//24FGr,N)rPrQrRrSr+r3rIr}rrrrrrTrrrlenvironrwrrrrUr,r*rWrWs . S' R /05 H   ' )+UV/W/ H   ' )+UV /W /  '(,<<2'0 '0R H   ' )+TU)1V)1VHr,rW)'rSrurlr5r ImportErrorunittestrtwisted.internetrrtwisted.internet.deferrrtwisted.internet.protocolrr twisted.internet.tcpr r r r rrrrrrrtwisted.pythonrtwisted.python.runtimertwisted.trial.unittestr IReactorFDSet providedByrrWrUr,r*rs  0?=    ++  ++G44EX6xX6 X6v  ++G44EpHpH pH{HsCC  C