o j6hO@sdZddlmZddlZddlZddlZddlmZmZm Z m Z m Z ddl m Z ddl mZddl mZddl mZdd l mZdd l mZdd l mZdd l mZdd l mZddlmZddlmZddlmZddlmZdZdZdJddZdKddZdLd#d$Z dMd&d'Z!dKd(d)Z"dNd,d-Z#dOd0d1Z$dPd2d3Z%dOd4d5Z&dOd6d7Z'dOd8d9Z(dPd:d;Z)dOdd?Z+dPd@dAZ,dQdBdCZ-dRdFdGZ.GdHdIdIZ/dS)SzParses an LLM command line.) annotationsN) AbstractSetAnyCallableMutableMappingSequence)argument_parser)flag_def) input_utils)model_registry) output_utils)parsed_args_lib)post_process_utils)py_utils) sheets_utils) llm_function)llmfn_inputs_source) llmfn_outputs)modelsource%llmfn_inputs_source.LLMFnInputsSource placeholdersAbstractSet[str]returnNonecCs2|D]}|D] }||vrtd|qqdS)Nz#Placeholder "{}" not found in input)to_normalized_inputs ValueErrorformat)rrinputskeywordr"{/var/www/html/chefvision.cloud.itp360.com/venv/lib/python3.10/site-packages/google/generativeai/notebook/cmd_line_parser.py+_validate_input_source_against_placeholders*s r$AbstractSet[str] | None6Callable[[str], llmfn_inputs_source.LLMFnInputsSource]cdfdd }|S)Nvar_namestrrrcst|}r t||SN)r get_inputs_source_from_py_varr$)r(rrr"r#_fn7s  z._get_resolve_input_from_py_var_fn.._fn)r(r)rrr"rr-r"r,r#!_get_resolve_input_from_py_var_fn4sr/namer)/tuple[str, parsed_args_lib.TextResultCompareFn]cCs*t|}t|tstd|||fS)z*Resolves a value passed into --compare_fn.z0Variable "{}" does not contain a Callable object)r get_py_var isinstancerrr)r0fnr"r"r#_resolve_compare_fn_var@s  r5 Sequence[str]cCs\t|}t|trt|tst|trtd||D]}t|ts+td|q|S)z,Resolves a value passed into --ground_truth.z4Variable "{}" does not contain a Sequence of strings)rr2r3rr)bytesrr)r0valuexr"r"r#_resolve_ground_truth_varKs  r:cr')Nr8r)rrcs&t|}t|}rt||Sr*)rget_sheets_id_from_str SheetsInputsr$)r8 sheets_idrr,r"r#r-\s   z*_get_resolve_sheets_inputs_fn.._fn)r8r)rrr"r.r"r,r#_get_resolve_sheets_inputs_fnYsr>r8llmfn_outputs.LLMFnOutputsSinkcCst|}t|Sr*)rr; SheetsOutputs)r8r=r"r"r#_resolve_sheets_outputsfs  rAparserargparse.ArgumentParsercCstjddtjtjjdd|ddd }tjd d td |d d|tjddd dd|ddd}tjddt d |dd|tj ddd|d S)z:Adds flags that are related to model selection and config. model_typemtzThe type of model to use.)r0 short_name enum_type default_valuehelp_msgr9floatrcSs|dkr td||S)Nrz5Value should be greater than or equal to zero, got {})rrr9r"r"r#'_check_is_greater_than_or_equal_to_zerowszA_add_model_flags.._check_is_greater_than_or_equal_to_zero temperaturetNzControls the randomness of the output. Must be positive. Typical values are in the range: [0.0, 1.0]. Higher values produce a more random and varied response. A temperature of zero will be deterministic.)r0rF parse_typerHparse_to_dest_type_fnrIrmzLThe name of the model to use. If not provided, a default model will be used.)r0rFrHrIrintcSs*|tks|tkrtdtt|t|S)Nz-Value should be in the range [{}, {}], got {})_MIN_CANDIDATE_COUNT_MAX_CANDIDATE_COUNTrrrRrKr"r"r#_check_candidate_count_rangesz6_add_model_flags.._check_candidate_count_rangecandidate_countccz$The number of candidates to produce.uniquez3Whether to dedupe candidates returned by the model.)r0rI)r9rJrrJ)r9rrrR) r EnumFlagDefr ModelName ModelRegistry DEFAULT_MODELadd_argument_to_parserSingleValueFlagDefrJrRBooleanFlagDef)rBrLrUr"r"r#_add_model_flagsksP     r`cCsDtjddtjt|dd|tjddtjt|dd|dS) z;Adds flags to read inputs from a Python variable or Sheets.r izOptional names of Python variables containing inputs to use to instantiate a prompt. The variable must be either: a dictionary {'key1': ['val1', 'val2'] ...}, or an instance of LLMFnInputsSource such as SheetsInput.r0rF dest_typerPrIsheets_input_namessizOptional names of Google Sheets to read inputs from. This is equivalent to using --inputs with the names of variables that are instances of SheetsInputs, just more convenient to use.N)r MultiValuesFlagDefrLLMFnInputsSourcer/r]r>rBrr"r"r#_add_input_flagss   ricCs>tjddtjtjdd|tjddtjtdd|dS) z1Adds flags to write outputs to a Python variable.outputsoaOptional names of Python variables to output to. If the Python variable has not already been defined, it will be created. If the variable is defined and is an instance of LLMFnOutputsSink, the outputs will be written through the sink's write_outputs() method.rbsheets_output_namessozOptional names of Google Sheets to write inputs to. This is equivalent to using --outputs with the names of variables that are instances of SheetsOutputs, just more convenient to use.N)r rfrLLMFnOutputsSinkr get_outputs_sink_from_py_varr]rArBr"r"r#_add_output_flagss   rqcCstjdttdd|dS)N compare_fnzAn optional function that takes two inputs: (lhs_result, rhs_result) which are the results of the left- and right-hand side functions. Multiple comparison functions can be provided.)r0rcrPrI)r rftupler5r]rpr"r"r#_add_compare_flagss rtcCstjddttdd|dS)N ground_truthTzA variable containing a Sequence of strings representing the ground truth that the output of this cell will be compared against. It should have the same number of entries as inputs.)r0requiredrcrPrI)r r^rr:r]rpr"r"r#_add_eval_flagss rwcCst|t||t|dS)zAdds flags for the `run` command. `run` sends one or more prompts to a model. Args: parser: The parser to which flags will be added. placeholders: Placeholders from prompts in the cell contents. N)r`rirqrhr"r"r#_create_run_parser s  rxcCs*d dd}d}|jd||dt|d S) zAdds flags for the compile command. `compile` "compiles" a prompt and model call into a callable function. Args: parser: The parser to which flags will be added. r(r)rc Ss>zt|W|Sty}z tdd||d}~ww)N{})rvalidate_var_namerargparse ArgumentErrorr)r(er"r"r#_compile_save_name_fn(s z5_create_compile_parser.._compile_save_name_fnz?The name of a Python variable to save the compiled function to.compile_save_namehelptypeN)r(r)rr)) add_argumentr`)rBr~save_name_helpr"r"r#_create_compile_parsers  rcCsLd dd}d}|jd||d |jd ||d t||t|t|d S) zAdds flags for the compare command. Args: parser: The parser to which flags will be added. placeholders: Placeholders from prompts in the compiled functions. r(r)r$tuple[str, llm_function.LLMFunction]c Sslzt|Wnty}z tdd||d}~wwt|}t|tj s2tdd|||fS)Nryz7{} is not a function created with the "compile" command) rrzrr{r|rr2r3r LLMFunction)r(r}r4r"r"r#_resolve_llm_function_fnAs  z8_create_compare_parser.._resolve_llm_function_fnzbThe name of a Python variable containing a function previously created with the "compile" command.lhs_name_and_fnrrhs_name_and_fnN)r(r)rr)rrirqrt)rBrr name_helpr"r"r#_create_compare_parser5s   rcCs.t|t||t|t|t|dS)zAdds flags for the eval command. Args: parser: The parser to which flags will be added. placeholders: Placeholders from prompts in the cell contents. N)r`rirqrtrwrhr"r"r#_create_eval_parser^s   rcCsd}d}d}tj|||d}|jdd}t|tjjj|t |tjj jt |tjj j|t |tjjj||S)zCreate the full parser.llmz#A system for interacting with LLMs.)prog descriptionepilogcmd)dest)rArgumentParseradd_subparsersrx add_parserr CommandNameRUN_CMDr8r COMPILE_CMDr COMPARE_CMDrEVAL_CMD)r system_namerrrB subparsersr"r"r#_create_parseros. r parsed_argsparsed_args_lib.ParsedArgscCs2|jr|jjdus|jjdkrtddSdSdS)Nrzr"--unique" works across candidates only: it should be used with --candidate_count set to a value greater-than one.)rX model_argsrVprint)rr"r"r#_validate_parsed_argss  rc@s^eZdZdZejjZdZe dddZ e dd d Z e dddZ ddddZ d ddZdS)! CmdLineParserz-Implementation of Magics command line parser.|tokensr6r:tuple[Sequence[str], parsed_args_lib.PostProcessingTokens]cCsg}d}t|D] \}}|dur|}|tjkr(||dur#|||ngd}q||dur5||dng|d|ddfS)aSplits inputs into the command and post processing tokens. The command is represented as a sequence of tokens. See comments on the PostProcessingTokens type alias. E.g. Given: "run --temperature 0.5 | add_score | to_lower_case" The command will be: ["run", "--temperature", "0.5"]. The post processing tokens will be: [["add_score"], ["to_lower_case"]] Args: tokens: The command line tokens. Returns: A tuple of (command line, post processing tokens). Nrr) enumeraterPIPE_OPappend)clsr split_tokens start_idx token_numtokenr"r"r#_split_post_processing_tokenss z+CmdLineParser._split_post_processing_tokensliner)cCsLt|}|s tjjg}|d}|ds!|dvr!tjjg|}t|S)zBParses `line` and returns command line and post processing tokens.r)z-hz--help)shlexsplitr DEFAULT_CMDr8isalphar)rrr first_tokenr"r"r#_tokenize_lines   zCmdLineParser._tokenize_lineparsed_resultsMutableMapping[str, Any]9tuple[MutableMapping[str, Any], model_lib.ModelArguments]cCs<|dd}|dd}|dd}tj|||d}||fS)alExtracts fields for model args from `parsed_results`. Keys specific to model arguments will be removed from `parsed_results`. Args: parsed_results: A dictionary of parsed arguments (from ArgumentParser). It will be modified in place. Returns: A tuple of (updated parsed_results, model arguments). rNrMrV)rrMrV)pop model_libModelArguments)rrrrMrVrr"r"r#_get_model_argss   zCmdLineParser._get_model_argsNrr%Gtuple[parsed_args_lib.ParsedArgs, parsed_args_lib.PostProcessingTokens]c Cst|\}}|j||d}|jtjjkr=|jdusJ|jdus#J|j\}}|j\}}|j|t |  | d}t ||D]} t | qC||fS)a>Parses the commandline and returns ParsedArgs and post-processing tokens. Args: line: The line to parse (usually contents from cell Magics). placeholders: Placeholders from prompts in the cell contents. Returns: A tuple of (parsed_args, post_processing_tokens). )rrN)rr%_get_parsed_args_from_cmd_line_tokensrr rrrr frozensetget_placeholdersunionrr'validate_one_post_processing_expression) selfrrrpost_processing_tokensr_lhs_fnrhs_fnexprr"r"r# parse_lines"    zCmdLineParser.parse_linercCsNt||}t|}t|d|d<t|\}}||d<tjdi|S)z1Returns ParsedArgs from a tokenized command line.rrNr")r parse_argsvarsr rrr ParsedArgs)rrrresults results_dictrr"r"r#rs z3CmdLineParser._get_parsed_args_from_cmd_line_tokens)rr6rr)rr)rr)rrrrr*)rr)rr%rr)rr6rr%rr)__name__ __module__ __qualname____doc__r rrrr classmethodrrrrrr"r"r"r#rs !   ,r)rrrrrr)rr%rr&)r0r)rr1)r0r)rr6)r8r)rr?)rBrCrr)rBrCrr%rr)rr%rrC)rrrr)0r __future__rr{rsystypingrrrrrgoogle.generativeai.notebookrr r r r r rrr google.generativeai.notebook.librrrrrrSrTr$r/r5r:r>rAr`rirqrtrwrxrrrrrrr"r"r"r#sN                  D       )