推理Inference
推理是什么?
训练完成的 AI 模型对新输入进行计算并产生输出的阶段，与训练相对。随着大规模部署，推理正成为 AI 算力需求与成本中更大且持续的部分，推动对推理优化芯片的投资。
What is Inference?
The phase where a trained AI model runs on new inputs to generate outputs, as opposed to training. As deployment scales, inference is becoming the larger and recurring share of AI compute demand and cost, driving investment in inference-optimized chips.
天际投资视角 · Agent 与企业智能
Agent 正从演示走向生产环境。价值向两端集中——掌握业务工作流的应用层,和按 token 计价的基础设施;中间的通用薄壳会被挤掉。