Skip to content

关于使用uie模型中state_dict()保存模型参数的问题 #6658

Description

@xinlaid

请提出你的问题

$ uie_model.encoder.encoder.layers[0].linear1

Linear(in_features=768, out_features=3072, dtype=float32)

$ uie_model.encoder.encoder.layers[0].linear1.weight.shape

[768, 3072]

对于这一个线性的模型参数, 线性层的input是768,output是3072, 那么隐藏层的参数不应该是3072*768么?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

questionFurther information is requestedtriage

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions