pi. ddlZddlZddlmZddlmZmZmZddlm Z ddl m Z ddl m Z ddlmZdd lmZdd lmZej(eZd Zed ZGd dej2ZGddeZGddeZy)N)Future)AnyOptionalTypeVar)CheckpointProcess)CheckpointReader)CheckpointWriter)CheckpointStager) STATE_DICT) wrap_future<TceZdZdZej dededeee fde e e e ffdZ ej dddd dede ed e d edeee fdef d Zej dd Zy) CheckpointeraT WARNING: This class is experimental, and is created to validate certain ideas, and is subjected to change or deprecation and we strong discourage any usages at this time. Abstract base class that defines the API for checkpointing. This class defines the interface for coordinating the writing and loading of model state dictionaries to and from storage. It provides abstract methods to save and load model states with support for both synchronous and asynchronous operations. Concrete implementations of this class must implement all the abstract methods. path state_dictkwargsreturnc y)a Save a state dictionary to storage. Args: path: The path where the checkpoint should be saved. state_dict: The state dictionary to save. **kwargs: Additional keyword arguments to pass to the writer. Returns: For synchronous implementations: None For asynchronous implementations: tuple of (stage_future, write_future) representing the staging and writing operations. Nselfrrrs y/opt/services/ai/voice_agent/venv/lib/python3.12/site-packages/torch/distributed/checkpoint/_experimental/checkpointer.pysavezCheckpointer.save#NFdefault_map_locationstrictrr c y)ah Load a state dictionary from storage. Args: path: The path from which to load the checkpoint. state_dict: Optional state dictionary to update with loaded values. If provided, only keys in this dictionary will be loaded. default_map_location: Device mapping function or device name for relocating tensors. strict: If True, raises an error when there are missing keys in the checkpoint. **kwargs: Additional keyword arguments to pass to the reader. Returns: The loaded state dictionary. Nr)rrrrr rs rloadzCheckpointer.load8rrcy) Close the checkpointer and release any resources. This method should be called when the checkpointer is no longer needed to ensure proper cleanup of resources. Nrrs rclosezCheckpointer.closeQrrNrN)__name__ __module__ __qualname____doc__abcabstractmethodstrr dictrrtuplerrboolr"r&rrrrrs     sCx.  %' (   ( ,0 %)   Z( "    sCx.    0   rrceZdZdZdedefdZdedede ee fde e e e ffd Z dd d d dede ed e dede ee fdef dZddZy )SyncCheckpointera Synchronous implementation of Checkpointer. This class coordinates the writing and loading of model state dictionaries to and from storage using only synchronous operations. It provides a simple, efficient interface for checkpoint operations without async overhead. Attributes: _writer: CheckpointWriter for writing state dictionaries to storage. _reader: CheckpointReader for reading state dictionaries from storage. Example: checkpointer = SyncCheckpointer(writer=writer, reader=reader) checkpointer.save(state_dict, path) loaded_state_dict = checkpointer.load(path) writerreaderc ||_||_y)z Initialize a synchronous checkpointer. Args: writer: CheckpointWriter for writing checkpoints to storage. reader: CheckpointReader for reading checkpoints from storage. N)_writer_reader)rr5r6s r__init__zSyncCheckpointer.__init__ms  rrrrrc ltjd||jj||fi|y)a Save a state dictionary to storage synchronously. Args: path: The path where the checkpoint should be saved. state_dict: The state dictionary to save. **kwargs: Additional keyword arguments to pass to the writer. Returns: Always returns None as operations are synchronous. Example: checkpointer.save("/path/to/checkpoint", state_dict) z%Saving checkpoint synchronously to %sN)loggerdebugr8writers rrzSyncCheckpointer.save|s1(  r rH)rrrrstaging_results rrzAsyncCheckpointer.saves,  [     )    % % ' 8960066 !    6=;T55;; D $*   5t<    )~.0B0BB BBC CrNFrrr c tjd||jjd|||d|\}}|r||gk7rt d|d||S)ac Load a state dictionary from storage. Loading is always performed synchronously, even in AsyncCheckpointer. Args: path: The path from which to load the checkpoint. state_dict: Optional state dictionary to update with loaded values. If provided, only keys in this dictionary will be loaded. default_map_location: Device mapping function or device name for relocating tensors. strict: If True, raises an error when there are missing keys in the checkpoint. **kwargs: Additional keyword arguments to pass to the reader. Returns: The loaded state dictionary. Raises: RuntimeError: If strict=True and there are missing keys in the checkpoint. FileNotFoundError: If the checkpoint file is not found. r@rArCrDrrErIs rr"zAsyncCheckpointer.load#sw:  0$7*;$,,*;*;+ !-+  + '< l.<23Ev5G ~VW W  rc|jj|jjtj dy)z Close the checkpointer and release any resources. This method should be called when the checkpointer is no longer needed to ensure proper cleanup of async resources. zAsyncCheckpointer closedN)rRr&rSr<rFr%s rr&zAsyncCheckpointer.closeLs5 %%'   &&( ./rr'r()r)r*r+r,r rr r:r/r rrr1rrr2r"r&rrrrNrNs09+9.9! 9&/D/D/D /D %' ( /Dh,0'! %) '!'!Z('! " '!  '!'! '!R 0rrN)r-loggingconcurrent.futuresrtypingrrrrPrcheckpoint_readerr checkpoint_writerr stagingr typesr utilsr getLoggerr)r< LOG_INTERVALrABCrr4rNrrrrfsx %))1//%   8 $  CLD 377D Nh/|h/VO0 O0r