Skip to content

单个聊天会话的上下文token开销(第一次超限之前)怎么计算? #34

Description

@xmkid

研究了好一阵,核心应该是input_tokens、output_tokens、cache_creation_input_tokens、cache_read_input_tokens这些字段?但是agent和大模型给的答案都不太像,返回的数值看着也不太对,想直接抄答案了,猫猫帮忙回答下吧

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions