test/fastNLP
1
0
Fork 0
mirror of https://gitee.com/fastnlp/fastNLP.git synced 2024-11-30 03:07:59 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #139 from fastnlp/choosewhatulike-patch-1

Browse Source 
fix mask bug in star-transformer
This commit is contained in:
Yunfan Shao 2019-03-23 13:31:04 +08:00 committed by GitHub
commit 56410c9e31
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
fastNLP/modules/encoder/star_transformer.py
View File

@ -46,6 +46,7 @@ class StarTransformer(nn.Module):
return f(x.permute(0, 2, 3, 1)).permute(0, 3, 1, 2)
B, L, H = data.size()
mask = (mask == 0) # flip the mask for masked_fill_
smask = torch.cat([torch.zeros(B, 1, ).byte().to(mask), mask], 1)
embs = data.permute(0, 2, 1)[:,:,:,None] # B H L 1