o bn!@sdZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z ddl mZmZdd lmZdd lmZmZdd lmZdd lmZGd ddZdS)z This module contains the trial distributed runner, the management class responsible for coordinating all of trial's behavior at the highest level. @since: 12.3 N) DeferredList cooperate)FilePath) theSystemPath) _iterateTests)_WORKER_AMP_STDIN_WORKER_AMP_STDOUT) DistReporter) LocalWorkerLocalWorkerAMP)UncleanWarningsReporterWrapper)_unusedTestDirectoryc@sjeZdZdZeZddZ      dd d Zd d Zd dZ ddZ ddZ de dfddZ ddZdS)DistTrialRunneraY A specialized runner for distributed trial. The runner launches a number of local worker processes which will run tests. @ivar _workerNumber: the number of workers to be spawned. @type _workerNumber: C{int} @ivar _stream: stream which the reporter will use. @ivar _reporterFactory: the reporter class to be used. cCs.|j|j|j|jd}|jrt|}||S)zL Make reporter factory, and wrap it with a L{DistReporter}. )realtime)_reporterFactory_stream _tbformat _rterrors_uncleanWarningsr _distReporterFactory)selfreporterr?/usr/lib/python3/dist-packages/twisted/trial/_dist/disttrial.py _makeResult*s   zDistTrialRunner._makeResultNdefaultFtest.log _trial_tempc Cs`||_||_||_|durtj}||_||_||_||_d|_ | |_ ||_ d|_ d|_ d|_dS)NF) _workerNumber_workerArgumentsrsysstdoutrrrr_result_workingDirectory_logFile_logFileObserver_logFileObject _logWarnings) rreporterFactory workerNumberworkerArgumentsstreamtracebackFormatrealTimeErrorsuncleanWarningslogfileworkingDirectoryrrr__init__5s  zDistTrialRunner.__init__cCs |dS)z Write test run final outcome to result. @param result: A C{TestResult} which will print errors and the summary. N)done)rresultrrr writeResultsQs zDistTrialRunner.writeResultscsfddt|DS)aY Create local worker protocol instances and return them. @param protocols: An iterable of L{LocalWorkerAMP} instances. @param workingDirectory: The base path in which we should run the workers. @type workingDirectory: C{str} @return: A list of C{quantity} C{LocalWorker} instances. c s,g|]\}}t|tjt|jqSr)r ospathjoinstrr%).0xprotocolrr1rr esz6DistTrialRunner.createLocalWorkers..) enumerate)r protocolsr1rr=rcreateLocalWorkersYs z"DistTrialRunner.createLocalWorkersc Csvtdjj}ddddddtdtdi}tj}tj t j|d<|D]}t j |g}| |||t j |||dq"d S) a Spawn processes from a list of process protocols. @param spawner: A C{IReactorProcess.spawnProcess} implementation. @param protocols: An iterable of C{ProcessProtocol} instances. @param arguments: Extra arguments passed to the processes. ztwisted.trial._dist.workertrialrwrTRIAL_PYTHONPATH)argschildFDsenvN) rfilePathr7rr r6environcopypathsepr8r! executableextend) rspawnerr@ argumentsworkertrialPathrHrKworkerrGrrrlaunchWorkerProcessesjs    z%DistTrialRunner.launchWorkerProcessescs6fddfdd|fdd|DS)a Drive a L{LocalWorkerAMP} instance, iterating the tests and calling C{run} for every one of them. @param worker: The L{LocalWorkerAMP} to drive. @param result: The global L{DistReporter} instance. @param testCases: The global list of tests to iterate. @param cooperate: The cooperate function to use, to be customized in tests. @type cooperate: C{function} @return: A C{Deferred} firing when all the tests are finished. csj|||SN)original addFailure)errorcase)r4rr resultErrbacksz3DistTrialRunner._driveWorker..resultErrbackcs|}|||SrU)run addErrback)rYd)r4rZrSrrtasks  z*DistTrialRunner._driveWorker..taskc3s|]}|VqdSrUr)r:rY)r^rr sz/DistTrialRunner._driveWorker..)whenDone)rrSr4 testCasesrr)r4rZr^rSr _driveWorkers zDistTrialRunner._driveWorkerc s@dur ddlm }jd|f|s* jSt t j \} t |j }ddt|D|j}dd|Dj|j fdd g  fd d  fd d }  fdd} fdd} | | | dd| S)a{ Spawn local worker processes and load tests. After that, run them. @param suite: A tests suite to be run. @param reactor: The reactor to use, to be customized in tests. @type reactor: A provider of L{twisted.internet.interfaces.IReactorProcess} @param cooperate: The cooperate function to use, to be customized in tests. @type cooperate: C{function} @param untilFailure: If C{True}, continue to run the tests until they fail. @type untilFailure: C{bool}. @return: The test result. @rtype: L{DistReporter} Nr)reactorzRunning %d tests. cSsg|]}tqSr)r )r:r;rrrr>z'DistTrialRunner.run..cSsg|]}|jqSr) endDeferred)r:rSrrrr>rdc sDttt}g}D]}|j||dq t|dddS)NrT) consumeErrorsfireOnOneErrback)iterlistrappendrbr)raworkerDeferredsrS) ampWorkersrr4rsuiterrrunTestssz%DistTrialRunner.run..runTestscs.s dSsdS}|SrU)r5 wasSuccessful addCallback)ignr])nextRunr4rnr untilFailurerrrrs  z$DistTrialRunner.run..nextRuncs&sddSdSrU)unlockrjstoprq)rcstopping testDirLockrrrus   z!DistTrialRunner.run..stopcs(sdtdd}|SdS)NT)rf)rjrrp)r])continueShutdownprocessEndDeferredsrwrrbeforeShutDowns    z+DistTrialRunner.run..beforeShutDowncs|SrU)r5rv)r4rrrrys z-DistTrialRunner.run..continueShutdownbeforeshutdown)twisted.internetrcrcountTestCasesrwriter[rVr5rrr$minrrangerAr7rT spawnProcessr rpaddBothaddSystemEventTrigger) rrmrcrrscounttestDirr*workersrur{r]r) rlryrrrrzrcr4rnrrwrmrxrsrr[s6        zDistTrialRunner.runcCs|j|ddS)z| Run the tests with local worker processes until they fail. @param suite: A tests suite to be run. T)rs)r[)rrmrrrrunUntilFailureszDistTrialRunner.runUntilFailure)NrFFrr)__name__ __module__ __qualname____doc__r rrr2r5rArTrbrr[rrrrrrs"   Xr)rr6r!twisted.internet.deferrtwisted.internet.taskrtwisted.python.filepathrtwisted.python.modulesrtwisted.trial._asyncrunnerrtwisted.trial._distrr twisted.trial._dist.distreporterr twisted.trial._dist.workerr r twisted.trial.reporterr twisted.trial.utilrrrrrrs