/hIOdZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z ddl mZddlmZmZmZdd lmZdd lmZdd lmZmZmZmZdd lmZmZdd lm Z ddl!m"Z"ddl#m$Z$m%Z%m&Z&ddl'm(Z(ddl)m*Z*dZ+e$e,Z-ej.dZ/e0edZ1gdZ2dZ3dZ4dZ5ej6fdZ7Gdde*Z8dddedfde8fd Z9de8fd!Z:de8fd"Z;de8fd#Znd(xZ=Z>d)Z?e/see9d*e?e+Z@nd,Z@d-ZAd6d/ZBd7d1ZC d8d4ZDd6d5ZEdS)9zWorker command-line program. This module is the 'program-version' of :mod:`celery.worker`. It does everything necessary to run that module as an actual application, like installing signal handlers, platform tweaks, and so on. N)datetime)partial) REMAP_SIGTERM)current_process)safe_str)VERSION_BANNER platformssignals)trace) AppLoader) EX_FAILUREEX_OKcheck_privilegesisatty)staticterm)cry)qualname) get_logger in_sighandlerset_in_sighandler) pluralize)WorkController)Workerjavapypy_version_info)  ----------------- ***** ------- ******* ----- *** --- * ---- ** ----------r!r!r!r rrrz{hostname} v{version} {platform} {timestamp} [config] .> app: {app} .> transport: {conninfo} .> results: {results} .> concurrency: {concurrency} .> task events: {events} [queues] {queues} z [tasks] {tasks} cPddlm}td|DS)Nr enumeratec3NK|] }|jddV!dS)zDummy-N)name startswith).0ts V/var/www/html/e360mart/e360mart_env/lib/python3.11/site-packages/celery/apps/worker.py z&active_thread_count..LsJ33Qf''113q333333) threadingr$sumr#s r+active_thread_countr0JsG###### 33))++333 3 33r-ct|drS|Atj|d|ddSdSdS)Nfileno )hasattrr2oswriteencode)msgfs r+safe_sayr:Pseq(4 6 \#\\\00223333344 6 6r-ceZdZdZddZ dfd ZdZfdZdZd Z dd Z d Z ddZ dZ ddZdZdZdZxZS)rzWorker as a program.Fc ||_tj|j|jt j|j||jj|t|jjj dS)N)senderinstanceconfoptions) quietr setup_worker_optimizationsapphostnamer celeryd_initsendr?raccept_content)selfrAkwargss r+on_before_initzWorker.on_before_initXso  (4=AAA !!=4 "    566666r-Nc r|jd||_|jd||_t jdi|||_||_ttj |_ |jj |j|| n||_ dS)Nworker_redirect_stdoutsworker_redirect_stdouts_level)enabled)rCeitherredirect_stdoutsredirect_stdouts_levelsupersetup_defaultspurgeno_colorrsysstdout_isattylogcoloredlogfile)rHrUrVrQrRrI __class__s r+ on_after_initzWorker.on_after_initds!% %'7!9!9&*hoo +-C'E'E#(((((   cj)) x|++ L$,$8LLh,   r-cv||_tj|j|jdSN) setup_logging_custom_loggingr rBrCrDrHs r+on_init_blueprintzWorker.on_init_blueprintts5#1133 (4=AAAAAr-c|j}ttj|j||j|jr| |j s| | d| ||js&|jr|j|jd}|j}t'|t(r|dv}|r5|jrt.ddSdSdS)N)r=r>r?z-active-T)zdjango.conf:settingszPlease run `celery upgrade settings path/to/settings.py` to avoid these warnings and to allow a smoother upgrade to Celery 6.0.)rCrSon_startr celeryd_after_setuprFrDr?rUpurge_messagesrA emit_bannerset_process_statusinstall_platform_tweaksrbrQrZrR_config_source isinstancestrlowermaybe_warn_deprecated_settingsloggerwarning)rHrCwarn_deprecated config_sourcer]s r+rfzWorker.on_startzsvh  #((=4ch )    : "    ! ! !z         +++ $$T***# B(= B G $ $T%@ A A A* mS ) ) ,1133<O  x6688 %    r-ctj}|r2ttjt jtt dt|j d| | t|j | pdgtjddS)Nz )artlinesT)fileflush)rsupports_imagesprintimgcatrlogorjoinrnr[cyan startup_inforeset extra_inforW __stdout__)rH use_images r+rizWorker.emit_banners(**  . $+fkmm,, - - - hrww  !!t((i-(@@BB C C  ""4??#4#4#:;; < <     .  . . . . . .r-ctj|tdt |jdS)N)r=z %s ready.)r worker_readyrFrqinforrD)rHconsumers r+on_consumer_readyzWorker.on_consumer_readys@!!!222 K$-!8!899999r-c||j|j }|jj|j|jd||jS)NF)rQcolorizerD)rVrCrZsetuploglevelr\rD)rHrs r+razWorker.setup_loggingsL   9=(Hx|!! M4<"X "   r-c |j5}|jj|}|r&t d|dt |dddddddS#1swxYwYdS)N) connectionzpurge: Erased  messagez from the queue. T)ry)rCconnection_for_writecontrolrUr{r)rHrcounts r+rhzWorker.purge_messagess X * * , , l H$**j*AAE l^u^^y /J/J^^^fjkkkk l l l l l l l l l l l l l l l l l lsA A00A47A4Tr3celery.cx|fdt|jjDS)Nc3VK|]#}s|n|d|V$dS)z . N)r()r)taskinclude_builtinsint_s r+r,z"Worker.tasklist..sd  "1A OOD))  GK 4MM      r-)r~sortedrCtasks)rHrseprs ` `r+tasklistzWorker.tasklistsQxx     &,TX^&<&<      r-c|jdS|jtjkrF|jtjk}||}t |SdS)N)r)r)rloggingINFODEBUGrEXTRA_INFO_FMTformat)rHrrs r+rzWorker.extra_infos` = F =GL ( (#} = }}6F}GGH!((x(88 8 ) (r-c|j}t|j}d|jpdt |}t |jts 6~HC5355c555K}$$$ #?D2DJJsOOB/2222  GFFdm,,lnn,,,;;"X((**1133H$++--#i022338?)))GG    *,,   5!&)) 5 515 #(1+vay)A B BF1II!555 (6!9 4F1III5yy  4''s+H==IIc<|jjr||js+|jjrt |nt |t |t|t|ttdS)z1Install platform specific tweaks and workarounds.N) rCIS_macOS macOS_proxy_detection_workaroundrY!install_HUP_not_supported_handlerinstall_worker_restart_handlerinstall_worker_term_handler install_worker_term_hard_handlerinstall_worker_int_handlerinstall_cry_handlerinstall_rdb_handler)rHworkers r+rkzWorker.install_platform_tweakss 8  4  1 1 3 3 3| 7x  72&9999.v666#F+++(000"6***r-cFtjdddS)z6See https://github.com/celery/celery/issues#issue/161.celery_dummy_proxyset_by_celerydN)r5environ setdefaultrcs r+rz'Worker.macOS_proxy_detection_workarounds" 24DEEEEEr-c~tjd|dtjtjd|jS)Ncelerydrr)rrD)r set_mp_process_titlestrargvrWargvrD)rHrs r+rjzWorker.set_process_statussE- ::I-ch77:::]    r-)F)FNNNr`)Tr3r)T)__name__r __qualname____doc__rJr^rdrfrirrarhrrrrkrrj __classcell__)r]s@r+rrUs7 7 7 7 737DH      BBB &&&&&P . . .:::    lll     999((((((((T,FFF       r-rSIGTERMWarmTrcrfd}td|_|tj<dS)a<Install signal handler for warm/cold shutdown. The handler will run from the MainProcess. Args: worker (Worker): The worker that received the signal. sig (str, optional): The signal that was received. Defaults to 'TERM'. how (str, optional): The type of shutdown to perform. Defaults to 'Warm'. callback (Callable, optional): Signal handler. Defaults to None. exitcode (int, optional): The exit code to use. Defaults to EX_OK. verbose (bool, optional): Whether to print the type of shutdown. Defaults to True. cnt5ddlm}tjdkrUr rt ddt jtj j t|ddd ddddS#1swxYwYdS) Nrstate MainProcesszworker: z shutdown (MainProcess))r=sighowexitcode should_stopshould_terminate)rCold) r celery.workerrr_namer:rWrr worker_shutting_downrFrDsetattr)argsrcallbackrrrverbosers r+_handle_requestz*_shutdown_handler.._handle_request'sI __ H H + + + + + +  &-77%HV$$$VDDDDcnUUU,11!?%2 EM$6888;=>F H H H H H H H H H H H H H H H H H H H H HsB B**B.1B.worker_N)rnrr r )rrrrrrrs`````` r+_shutdown_handlerrso H H H H H H H H H H #?S??33O,Icr-c.ddlm}|t)auSignal handler for hard shutdown. The handler will terminate the worker immediately by force using the exit code ``EX_FAILURE``. In practice, you should never get here, as the standard shutdown process should be enough. This handler is only for the worst-case scenario, where the worker is stuck and cannot be terminated gracefully (e.g., spamming the Ctrl+C in the terminal to force the worker to terminate). Args: worker (Worker): The worker that received the signal. Raises: WorkerTerminate: This exception will be raised in the MainProcess to terminate the worker immediately. r)WorkerTerminate)celery.exceptionsrr )rrs r+on_hard_shutdownr9s&211111 /* % %%r-ct|dtdt|dt|jt dt jdS)amThis signal handler is called when the worker is in the middle of the soft shutdown process. When the worker is in the soft shutdown process, it is waiting for tasks to finish. If the worker receives a SIGINT (Ctrl+C) or SIGQUIT signal (or possibly SIGTERM if REMAP_SIGTERM is set to "SIGQUIT"), the handler will cancels all unacked requests to allow the worker to terminate gracefully and replace the signal handler for SIGINT and SIGQUIT with the hard shutdown handler ``on_hard_shutdown`` to terminate the worker immediately by force next time the signal is received. It will give the worker once last chance to gracefully terminate (the cold shutdown), after canceling all unacked requests, before using the hard shutdown handler to terminate the worker forcefully. Args: worker (Worker): The worker that received the signal. SIGINTF)rrrSIGQUITrrz3Waiting gracefully for cold shutdown to complete...N)rrrcancel_all_unacked_requestsr:rWrrs r+during_soft_shutdownr Lsd"%VDT^cdddd$VEUVVVV O//111 BCNSSSSSr-cptdtjt|dtt|dtt dkrt|dt||j|jj dS)aZ Signal handler for cold shutdown. Registered for SIGQUIT and SIGINT (Ctrl+C) signals. If REMAP_SIGTERM is set to "SIGQUIT", this handler will also be registered for SIGTERM. This handler will initiate the cold (and soft if enabled) shutdown procesdure for the worker. Worker running with N tasks: - SIGTERM: -The worker will initiate the warm shutdown process until all tasks are finished. Additional. SIGTERM signals will be ignored. SIGQUIT will transition to the cold shutdown process described below. - SIGQUIT: - The worker will initiate the cold shutdown process. - If the soft shutdown is enabled, the worker will wait for the tasks to finish up to the soft shutdown timeout (practically having a limited warm shutdown just before the cold shutdown). - Cancel all tasks (from the MainProcess) and allow the worker to complete the cold shutdown process gracefully. Caveats: - SIGINT (Ctrl+C) signal is defined to replace itself with the cold shutdown (SIGQUIT) after first use, and to emit a message to the user to hit Ctrl+C again to initiate the cold shutdown process. But, most important, it will also be caught in WorkController.start() to initiate the warm shutdown process. - SIGTERM will also be handled in WorkController.start() to initiate the warm shutdown process (the same). - If REMAP_SIGTERM is set to "SIGQUIT", the SIGTERM signal will be remapped to SIGQUIT, and the cold shutdown process will be initiated instead of the warm shutdown process using SIGTERM. - If SIGQUIT is received (also via SIGINT) during the cold/soft shutdown process, the handler will cancel all unacked requests but still wait for the soft shutdown process to finish before terminating the worker gracefully. The next time the signal is received though, the worker will terminate immediately by force. So, the purpose of this handler is to allow waiting for the soft shutdown timeout, then cancel all tasks from the MainProcess and let the WorkController.terminate() to terminate the worker naturally. If the soft shutdown is disabled, it will immediately cancel all tasks let the cold shutdown finish normally. Args: worker (Worker): The worker that received the signal. z>worker: Hitting Ctrl+C again will terminate all running tasks!rr rrN) r:rWrrr rwait_for_soft_shutdownrr rstopr s r+on_cold_shutdownrksJ Ms~^^^%VDXYYYY$VEYZZZZ !!(YI]^^^^ !!### O//111 Or-rr)rrrr)rrcdSr`rO)akws r+rsDr-c^tdtjt|dddS)NzXworker: Hitting Ctrl+C again will initiate cold shutdown, terminating all running tasks!rF)rr)r:rWrrr s r+ on_SIGINTrs7 g ^$V5IIIIIIr-r)rrrcdSr`rO)rrIs r+rrs r-ctjtjtjtjgt jtjtjgtj zdSr`) r close_open_fdsrW __stdin__r __stderr__r5execv executablerrOr-r+_reload_current_workerrsQ  s~s~HS^cn-899999r-SIGHUPc*d}|tj|<dS)Nctdtddtjdtjddl}|tddl m }t|_ dS)z5Signal handler restarting the current python program.TzRestarting celery worker (rrrNr) rr:r~rWrratexitregisterrrrrr)rr"rs r+restart_worker_sig_handlerzBinstall_worker_restart_handler..restart_worker_sig_handlers$Cchhsx.@.@CCC ! ! ! .///''''''!r-r r )rrr$s r+rrs&"""8Icr-SIGUSR1c<trdSd}|tj|<dS)Nct5ttddddS#1swxYwYdS)z=Signal handler logging the stack-trace of all active threads.N)rr:r)rs r+ cry_handlerz(install_cry_handler..cry_handlers __   SUUOOO                  s 8<<)is_pypyr r )rr)s r+rrs3)Icr- CELERY_RDBSIGSIGUSR2cld}tj|r|tj|<dSdS)Nct5ddlm}m}|r|dn|j}||ddddS#1swxYwYdS)z=Signal handler setting a rdb breakpoint at the current frame.r)_frame set_tracer&N)rcelery.contrib.rdbr/r0f_back)rr/r0frames r+ rdb_handlerz(install_rdb_handler..rdb_handlers __   < < < < < < < < $8DGGE Ie                      s-A  A A )r5rgetr r )envvarrr4s r+rrsF z~~f-!, #--r-c0fd}|tj<dS)Nct5tdddddS#1swxYwYdS)NzH{sig} not supported: Restarting with {sig} is unstable on this platform!)r)rr:r)signumr3rs r+warn_on_HUP_handlerz>install_HUP_not_supported_handler..warn_on_HUP_handlers __ C C 228&S&// C C C C C C C C C C C C C C C C C C C C Cs$AAAr%)rrr:s ` r+rrs6CCCCC1Icr-)r)r&)r+r,)Frrr5rrrWr functoolsrbilliard.commonrbilliard.processrkombu.utils.encodingrceleryrr r celery.appr celery.loaders.appr celery.platformsr rrr celery.utilsrrcelery.utils.debugrcelery.utils.importsrcelery.utils.logrrrcelery.utils.textrrr__all__rrqr( is_jythonr4r*rrrr0rr:rrrr rrrrrrrrrrrOr-r+rJs  )))))),,,,,,))))))5555555555((((((HHHHHHHHHHHH%%%%%%%%""""""))))))IIIIIIIIII''''''((((((  H   L # #F + + '#* + +      333 N4444 B B B B B ^B B B J+4$Y^hl--f---->&V&&&&&TTTTT>5 V5 5 5 5 rI")'yf?OZd####*'yf### A'.wyf?OZd((($$ ,A+@A(JJJ  !(x)"""    ::: 8 8 8 8 ) ) ) ) /% - - - -111111r-