pibdZddlmZmZmZddlmZddlm Z ddl m Z ddl m Z ddlmZmZmZdd lmZmZdd lmZdd lmZdd lmZd efdZded dfdZded efdZeddfdedeedeed efdZedededfdedeededdeedfdedefdee e!efd efdZ"y)a Factory functions for creating checkpointer instances with sensible defaults. This module provides high-level factory functions that simplify the creation of checkpointer instances by automatically handling component initialization and configuration with reasonable defaults. )AnyCallableOptionalN)create_barrier_from_config)CheckpointProcess)CheckpointReader)CheckpointWriterCheckpointWriterConfig WriterHook)AsyncCheckpointerSyncCheckpointer)CheckpointerConfig) DefaultStager)RankInforeturnctjr1ttjtjStddS)z Get default rank information from the current distributed environment. Returns: RankInfo: Rank information from the default process group if initialized, otherwise single-rank fallback. )global_world_size global_rankrr)distis_initializedrget_world_sizeget_rankt/opt/services/ai/voice_agent/venv/lib/python3.12/site-packages/torch/distributed/checkpoint/_experimental/builder.py_get_default_rank_inforsA "113   !;;r_cy)z3Default subprocess initialization function (no-op).Nr)rs rdefault_subprocess_init_fnr )sr rank_infoc,tt|S)z2Default checkpoint writer initialization function.)configr!)r r r!s rdefault_writer_init_fnr%-s %' rr# commit_hookc| t}t|}t|j}t |j |||}t ||S)a Factory function to create a SyncCheckpointer instance with sensible defaults. This function creates a synchronous checkpointer with default components, automatically detecting rank information from the default process group if available, and using the provided component configurations. Args: config: CheckpointerConfig containing component-specific configurations (writer_config, staging_config, process_config). Defaults to CheckpointerConfig(). rank_info: RankInfo for distributed training. Defaults to auto-detection from the default PyTorch distributed process group if initialized, otherwise falls back to single-rank (world_size=1, rank=0). commit_hook: Optional hook for custom actions before and after checkpoint commits. Returns: SyncCheckpointer: A configured synchronous checkpointer instance. Examples: # Simplest usage - auto-detect rank, default config checkpointer = make_sync_checkpointer() # Explicit rank configuration checkpointer = make_sync_checkpointer( rank_info=RankInfo(global_world_size=4, global_rank=0) ) # Disable barrier from .barriers import BarrierConfig config = CheckpointerConfig(barrier_config=BarrierConfig(barrier_type=None)) checkpointer = make_sync_checkpointer(config=config) r$)r#r!barrierr&)writerreader)rr rbarrier_configr writer_configr)r#r!r&r*r(r)s rmake_sync_checkpointerr-5scJ*, F))>)>?G ## F  rrsubprocess_init_fn).Nsubprocess_init_args.checkpoint_writer_init_fncheckpoint_writer_init_argsc| t}t|}t|j}|xsi}t ||j ||||}t |||S)aw Factory function to create an AsyncCheckpointer instance with sensible defaults. This function creates an asynchronous checkpointer using the provided configuration, automatically detecting rank information if not provided. Args: config: CheckpointerConfig containing component-specific configurations. rank_info: RankInfo for distributed training. Defaults to auto-detection. subprocess_init_fn: Function to initialize the subprocess. Defaults to no-op. subprocess_init_args: Arguments to pass to subprocess_init_fn. checkpoint_writer_init_fn: Function to create CheckpointWriter instance. checkpoint_writer_init_args: Arguments to pass to checkpoint_writer_init_fn. Returns: AsyncCheckpointer: A configured asynchronous checkpointer instance. Examples: # Create with default config checkpointer = make_async_checkpointer() # Create with custom init functions checkpointer = make_async_checkpointer( subprocess_init_fn=my_subprocess_init_fn, checkpoint_writer_init_fn=my_writer_init_fn ) r$)r#)r!r#r.r/r0r1)checkpoint_stagercheckpoint_processr*)rr rstaging_configrprocess_configr ) r#r!r.r/r0r1r*r3r4s rmake_async_checkpointerr7ps~F*, F&$$#>"C*$$-1";$?  +- r)#__doc__typingrrrtorch.distributed distributedrbarriersrr4rcheckpoint_readerr checkpoint_writerr r r checkpointerr rr#rstagingrtypesrrr r%r-tupledictstrr7rrrrEs-+* 01/SS=&"<<$>3>4>h3C"4!5$((,8 8!8*%8 8x"4!5$(.H,.AW<@ = =!=!+= S/ = (-=(=> = "*$sCx.!9 ==r