pik8dZddlZddlZddlZddlmZdZ ddeejzejzdeejzde de d e d edzd e d e d e edzde edzde e eefdzde de fdZedk(reZeej"ej$ej&ej(ej*ej,ej.ej0ej2ej4ej6ej8 yy)z@Provide entry point to preprocess ONNX model especially for QNN.N)qnncLtjd}|jdddd|jdd dd |jd d d |jdd d|jdd|jddtd|jdd d|jdd d|jdddd |jd!ddd" |jd#d$d%tdd&'|jd(d d)|j S)*zParse cmdline arguments.z#Arguments for QNN model preprocess.) descriptionz--input_model_pathz-iTzPath to the input ONNX model.)requiredhelpz--output_model_pathz-ozPath to the output ONNX model.z--save_as_external_data store_truez;Whether the output model would be saved with external data.)actionrz--all_tensors_to_one_filezgWhether to save all external data in one file or save each tensor to a file named with the tensor name.z--external_data_locationzbFilename of the external file where all tensors are saved. The path is relative to the model path.)rz--external_data_size_thresholdzQTensors with data size larger than this threshold are converted to external data.)defaulttyperz!--external_data_convert_attributezKWhether to save all tensors, including attribute tensors, to external data.z--fuse_layernormzLWhether to fuse matched sequences into LayerNormalization nodes if possible.z--inputs_to_make_channel_last+Nz=List of graph input names to be transposed into channel-last.)nargsr rz--outputs_to_make_channel_lastz>List of graph output names to be transposed into channel-last.z--dynamic_input_shapesappendzdModel input name and desired static shape in comma seprated format, for example: 'input' 1,3,256,256)rr r r rz --exclude_initializer_from_inputzBWhether to exclude initializer from input if model.ir_version >= 4)argparseArgumentParser add_argumentintstr parse_args)parsers b/opt/services/ai/voice_agent/venv/lib/python3.12/site-packages/onnxruntime/tools/qnn/preprocess.py_parse_argumentsrs  $ $1V WF ,dTHgh -tdIij ! J  # v  " q (  `   + Z  [ ' L  ( M     s  * Q     model_input model_outputfuse_layernormsave_as_external_dataall_tensors_to_one_fileexternal_data_locationexternal_data_size_thresholdexternal_data_convert_attributeinputs_to_make_channel_lastoutputs_to_make_channel_lastdynamic_input_shapesexclude_initializer_from_inputreturnc Dtj|||||||||| | |  S)a<Preprocess ONNX model for QNN. Args: model_input: A path or ONNX ModelProto specifiying the model to be preprocessed. model_output: A path specifying where the preprocessed model to be saved. fuse_layernorm: A bool specifying whether to fuse the matched sequence into a single LayerNormalization node. Defaults to False. save_as_external_data: A bool specifying whether to save model with external data. Defaults to False. all_tensors_to_one_file: A bool specifying whether to save all external data in one file or save each tensor to a file named with the tensor name. This argument is effective only when `save_as_external_data` is True. Defaults to False. external_data_location: A str specifying where to save the external data. The path is relative to the model path. This argument is effective only when `save_as_external_data` is True. Defaults to the model name. external_data_size_threshold: An int specifying the threshold of data size for tensors be saved as external data. This argument is effective only when `save_as_external_data` is True. Defaults to 1024. external_data_convert_attribute: A bool specifying whether to save all tensors including attributes as external data. This argument is effective only when `save_as_external_data` is True. Defaults to False. inputs_to_make_channel_last: A list of strs specifying graph input names to be transposed into channel-last. Defaults to None. outputs_to_make_channel_last: A list of strs specifying graph output names to be transposed into channel-last. Defaults to None. dynamic_input_shapes: A list of tuples specifying model input name to and its static shape in comma seprated format, for example: [('input', '1,3,256,256')]. Defaults to None. exclude_initializer_from_input: A bool specifying whether to exclude initializer from input. Defaults to False. Returns: A bool indicating whether the model is modified. rrrr r!r"r#r$r%r&)rqnn_preprocess_model) rrrrrr r!r"r#r$r%r&s rr*r*\s<T  # #%3 75%A(G$?%A1'E  r__main__r)) FFFNr FNNNF)__doc__rpathlibonnx,onnxruntime.quantization.execution_providersrrrPath ModelProtoboolrlisttupler*__name__argsinput_model_pathoutput_model_pathrrrr r!r"r#r$r%r&rrr:s G <I^!"'$))-(,,148599=+07w||#doo57 $77 7 " 7  $J 7#&7&*7"&cT!17#'s)d"27uS#X/$67%)7 7t z  D  **"88 $ < <#::%)%F%F(,(L(L$($D$D%)%F%F!66'+'J'J r