ojdZddlmZddlmZddlmZmZmZddl m Z ddl m Z ddl mZdd lmZGd d Ze e Gd d Zy)zZ Implementation of a L{Team} of workers; a thread-pool that can allocate work to workers. ) annotations)deque)CallableOptionalSet) implementer)IWorker)Quit)IExclusiveWorkerc(eZdZdZ ddZy) Statisticsa Statistics about a L{Team}'s current activity. @ivar idleWorkerCount: The number of idle workers. @type idleWorkerCount: L{int} @ivar busyWorkerCount: The number of busy workers. @type busyWorkerCount: L{int} @ivar backloggedWorkCount: The number of work items passed to L{Team.do} which have not yet been sent to a worker to be performed because not enough workers are available. @type backloggedWorkCount: L{int} c.||_||_||_yN)idleWorkerCountbusyWorkerCountbackloggedWorkCount)selfrrrs 8/usr/lib/python3/dist-packages/twisted/_threads/_team.py__init__zStatistics.__init__%s /.#6 N)rintrrrrreturnNone)__name__ __module__ __qualname____doc__rrrrrs, 7"7587OR7 7rrcheZdZdZ d dZd dZddZdddZdddZddZ dd Z dd Z dd Z y)Teamax A composite L{IWorker} implementation. @ivar _quit: A L{Quit} flag indicating whether this L{Team} has been quit yet. This may be set by an arbitrary thread since L{Team.quit} may be called from anywhere. @ivar _coordinator: the L{IExclusiveWorker} coordinating access to this L{Team}'s internal resources. @ivar _createWorker: a callable that will create new workers. @ivar _logException: a 0-argument callable called in an exception context when there is an unhandled error from a task passed to L{Team.do} @ivar _idle: a L{set} of idle workers. @ivar _busyCount: the number of workers currently busy. @ivar _pending: a C{deque} of tasks - that is, 0-argument callables passed to L{Team.do} - that are outstanding. @ivar _shouldQuitCoordinator: A flag indicating that the coordinator should be quit at the next available opportunity. Unlike L{Team._quit}, this flag is only set by the coordinator. @ivar _toShrink: the number of workers to shrink this L{Team} by at the next available opportunity; set in the coordinator. ct|_||_||_||_t |_d|_t|_ d|_ d|_ y)a @param coordinator: an L{IExclusiveWorker} which will coordinate access to resources on this L{Team}; that is to say, an L{IExclusiveWorker} whose C{do} method ensures that its given work will be executed in a mutually exclusive context, not in parallel with other work enqueued by C{do} (although possibly in parallel with the caller). @param createWorker: A 0-argument callable that will create an L{IWorker} to perform work. @param logException: A 0-argument callable called in an exception context when the work passed to C{do} raises an exception. rFN) r _quit _coordinator _createWorker _logExceptionset_idle _busyCountr_pending_shouldQuitCoordinator _toShrink)r coordinator createWorker logExceptions rrz Team.__init__MsO(V '))$'5 8= &+#rc|tt|j|jt|jS)z Gather information on the current status of this L{Team}. @return: a L{Statistics} describing the current state of this L{Team}. )rlenr(r)r*rs r statisticszTeam.statisticsms( #djj/4??C .createOneWorker~s:1X ,++->##F+  ,rNrrr#checkr$do)rr:r;s`` rgrowz Team.growus3      ,  ,rNczjjjjfdy)z Decrease the number of idle workers by C{n}. @param n: The number of idle workers to shut down, or L{None} (or unspecified) to shut down all workers. @type n: L{int} or L{None} c&jSr) _quitIdlers)r:rsrzTeam.shrink..sT%5%5a%8rNr=)rr:s``rshrinkz Team.shrinks*  89rcn|"t|j|jz}t|D]L}|jr)|jj j 8|xj dz c_N|jr+|jdk(r|jj yyy)z| The implmentation of C{shrink}, performed by the coordinator worker. @param n: see L{Team.shrink} Nr r) r1r(r)r6popquitr,r+r$)rr:r8s rrCzTeam._quitIdlerss 9DJJ$//1Aq $Azz  %%'!#  $  & &4??a+?    " " $,@ &rczjjjjfdy)zu Perform some work in a worker created by C{createWorker}. @param task: the callable to run c&jSr)_coordinateThisTaskrtasksrrDzTeam.do..sT%=%=d%CrNr=rLs``rr?zTeam.dos*  CDrcjrjjnj}|jj y|xj dz c_|j dfd }y)z Select a worker to dispatch to, either an idle one or a new one, and perform it. This method should run on the coordinator worker. @param task: the task to dispatch @type task: 0-argument callable Nr c jjdfd }y#t$rjY.doWork..idleAndPendings1$##O4rr<) BaseExceptionr&r$r?)rRrQrrMs rdoWorkz(Team._coordinateThisTask..doWorksJ %   ! ! 5" 5 ! %""$ %s+AAr<)r(rGr%r*appendr)r?)rrMr9rTrQs`` @rrKzTeam._coordinateThisTasksk&*ZZ!T5G5G5I > MM  &   1  5  5rc|jj||jr*|j|jj y|j r|j y|jdkDrA|xjdzc_|jj||jyy)z Called only from coordinator. Recycle the given worker into the idle pool. @param worker: a worker created by C{createWorker} and now idle. @type worker: L{IWorker} rr N) r(addr*rKpopleftr+rCr,removerH)rr9s rr7zTeam._recycleWorkers v ==  $ $T]]%:%:%< =  ( (     ^^a  NNa N JJ  f % KKM rcxjjjjdfd }y)zA Stop doing work and shut down all idle workers. c4d_jy)NT)r+rCr2srstartFinishingz!Team.quit..startFinishings*.D '    rNr<)r#r'r$r?)rr\s` rrHz Team.quits3         r)r-r r.zCallable[[], Optional[IWorker]]r/Callable[[], None])rr)r:rrrr)r:z Optional[int]rr)rMr]rr)rMzCallable[..., object]rr)r9r rrr<) rrrrrr3r@rErCr?rKr7rHrrrr!r!-sS<%6) @P," :% E5>* rr!N)r __future__r collectionsrtypingrrrzope.interfacerr _conveniencer _ithreadsr rr!rrrresO #**&'770 Wzzzr