Skip to content

[Bug]: 使用6月2日的PaddleNLP gpt-3代码复现A800单卡推理结果与官网84.93ms不符 #6581

Description

@115967783

软件环境

paddle-bfloat       0.1.7
paddle2onnx         1.0.6
paddlefsl           1.1.0
paddlenlp           2.5.2   commit id:de8c91d92de69299e3c6b98ae40b673ef7bd82ea
paddlepaddle-gpu    0.0.0.post116

重复问题

  • I have searched the existing issues

错误描述

参考[https://github.com/PaddlePaddle/PaddleNLP/blob/develop/model_zoo/gpt-3/projects/gpt/docs/inference.md去执行推理,PaddleNLP使用6月2日版本de8c91d92de69299e3c6b98ae40b673ef7bd82ea;复现出的GPT-3(6.7B) 单卡推理| 128 | 8 | 1 | 1 | 结果为121ms,与官网84.93ms数据不符。

稳定复现步骤 & 代码

参考[https://github.com/PaddlePaddle/PaddleNLP/blob/develop/model_zoo/gpt-3/projects/gpt/docs/inference.md

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingtriage

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions