pi%dZddlmZddlmZddlZddlmZmZddl m Z m Z m Z m Z mZmZmZmZgdZd efd Zd efd Zdd ed eej.fd Zd efdZedeeZde_ded dfdZedeeZde_dded ej<fdZdej<d dfdZ dded dfdZ!GddZ"y)z] This package introduces support for the current :ref:`accelerator` in python. )Optional) deprecatedN) _device_t_get_device_index) empty_cachemax_memory_allocatedmax_memory_reservedmemory_allocatedmemory_reserved memory_statsreset_accumulated_memory_statsreset_peak_memory_stats)current_acceleratorcurrent_device_idxcurrent_device_indexcurrent_streamr device_count device_index is_availabler r r r r rrset_device_idxset_device_index set_stream synchronizereturncft}|ytj|}|jS)aReturn the number of current :ref:`accelerator` available. Returns: int: the number of the current :ref:`accelerator` available. If there is no available accelerators, return 0. .. note:: This API delegates to the device-specific version of `device_count`. On CUDA, this API will NOT poison fork if NVML discovery succeeds. Otherwise, it will. For more details, see :ref:`multiprocessing-poison-fork-note`. r)rtorchget_device_moduleraccmods \/opt/services/ai/voice_agent/venv/lib/python3.12/site-packages/torch/accelerator/__init__.pyrr.s3  C {  ! !# &C    cft}|ytj|}|jS)aCheck if the current accelerator is available at runtime: it was build, all the required drivers are available and at least one device is visible. See :ref:`accelerator` for details. Returns: bool: A boolean indicating if there is an available :ref:`accelerator`. .. note:: This API delegates to the device-specific version of `is_available`. On CUDA, when the environment variable ``PYTORCH_NVML_BASED_CUDA_CHECK=1`` is set, this function will NOT poison fork. Otherwise, it will. For more details, see :ref:`multiprocessing-poison-fork-note`. Example:: >>> assert torch.accelerator.is_available() "No available accelerators detected." F)rrrrrs r"rrAs3*  C {  ! !# &C    r#check_availablecdtjjx}|r |r tr|Sy)aJReturn the device of the accelerator available at compilation time. If no accelerator were available at compilation time, returns None. See :ref:`accelerator` for details. Args: check_available (bool, optional): if True, will also do a runtime check to see if the device :func:`torch.accelerator.is_available` on top of the compile-time check. Default: ``False`` Returns: torch.device: return the current accelerator as :class:`torch.device`. .. note:: The index of the returned :class:`torch.device` will be ``None``, please use :func:`torch.accelerator.current_device_index` to know the current index being used. This API does NOT poison fork. For more details, see :ref:`multiprocessing-poison-fork-note`. Example:: >>> # xdoctest: >>> # If an accelerator is available, sent the model to it >>> model = torch.nn.Linear(2, 2) >>> if (current_device := current_accelerator(check_available=True)) is not None: >>> model.to(current_device) N)r_C_accelerator_getAcceleratorr)r%r s r"rr^s-4xx3355B_J r#c>tjjS)zReturn the index of a currently selected device for the current :ref:`accelerator`. Returns: int: the index of a currently selected device. )rr'_accelerator_getDeviceIndexr#r"rr~s 88 / / 11r#z#Use `current_device_index` instead.)categorya (Deprecated) Return the index of a currently selected device for the current :ref:`accelerator`. Returns: int: the index of a currently selected device. .. warning:: :func:`torch.accelerator.current_device_idx` is deprecated in favor of :func:`torch.accelerator.current_device_index` and will be removed in a future PyTorch release. devicec\t|d}tjj|y)a Set the current device index to a given device. Args: device (:class:`torch.device`, str, int): a given device that must match the current :ref:`accelerator` device type. .. note:: This function is a no-op if this device index is negative. FoptionalN)rrr'_accelerator_setDeviceIndexr-rs r"rrs"%Ve` device type. .. warning:: :func:`torch.accelerator.set_device_idx` is deprecated in favor of :func:`torch.accelerator.set_device_index` and will be removed in a future PyTorch release. cZt|d}tjj|S)aReturn the currently selected stream for a given device. Args: device (:class:`torch.device`, str, int, optional): a given device that must match the current :ref:`accelerator` device type. If not given, use :func:`torch.accelerator.current_device_index` by default. Returns: torch.Stream: the currently selected stream for a given device. Tr/)rrr'_accelerator_getStreamr2s r"rrs%%Vd;L 88 * *< 88r#streamcBtjj|y)aSet the current stream to a given stream. Args: stream (torch.Stream): a given stream that must match the current :ref:`accelerator` device type. .. note:: This function will set the current device index to the device index of the given stream. N)rr'_accelerator_setStream)r5s r"rrs HH##F+r#c\t|d}tjj|y)aWait for all kernels in all streams on the given device to complete. Args: device (:class:`torch.device`, str, int, optional): device for which to synchronize. It must match the current :ref:`accelerator` device type. If not given, use :func:`torch.accelerator.current_device_index` by default. .. note:: This function is a no-op if the current :ref:`accelerator` is not initialized. Example:: >>> # xdoctest: +REQUIRES(env:TORCH_DOCTEST_CUDA) >>> assert torch.accelerator.is_available() "No available accelerators detected." >>> start_event = torch.Event(enable_timing=True) >>> end_event = torch.Event(enable_timing=True) >>> start_event.record() >>> tensor = torch.randn(100, device=torch.accelerator.current_accelerator()) >>> sum = torch.sum(tensor) >>> end_event.record() >>> torch.accelerator.synchronize() >>> elapsed_time_ms = start_event.elapsed_time(end_event) Tr/N)rrr'_accelerator_synchronizeDevicer2s r"rrs".%Vd;L HH++L9r#c>eZdZdZdeeddfdZd dZdeddfdZ y) raContext manager to set the current device index for the current :ref:`accelerator`. Temporarily changes the current device index to the specified value for the duration of the context, and automatically restores the previous device index when exiting the context. Args: device (Optional[int]): a given device index to temporarily set. If None, no device index switching occurs. Examples: >>> # xdoctest: +REQUIRES(env:TORCH_DOCTEST_CUDA) >>> # Set device 0 as the current device temporarily >>> with torch.accelerator.device_index(0): ... # Code here runs with device 0 as the current device ... pass >>> # Original device is now restored >>> # No-op when None is passed >>> with torch.accelerator.device_index(None): ... # No device switching occurs ... pass r-rNc ||_d|_y)N)idxprev_idx)selfr-s r"__init__zdevice_index.__init__s r#cz|j/tjj|j|_yyN)r=rr'_accelerator_exchangeDevicer>)r?s r" __enter__zdevice_index.__enter__ s+ 88 !HH@@JDM r#exc_infocp|j*tjj|jyyrB)r=rr' _accelerator_maybeExchangeDevicer>)r?rEs r"__exit__zdevice_index.__exit__s' 88  HH 5 5dmm D r#)rN) __name__ __module__ __qualname____doc__rintr@rDobjectrHr+r#r"rrs:.x}DKE&ETEr#r)FrB)#rLtypingrtyping_extensionsrr_utilsrrmemoryrr r r r r rr__all__rMrboolrr-rr FutureWarningrrrStreamrrrrr+r#r"rWs!( 0    .c&d:(5<<:P@2c2Z)   7Y 7d 7%   99 95<< 9,u||,,: ::6"E"Er#