You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I noticed that I had accidentally changed min_length from 6 to 7. Reverting that change brings following results which are very close to the ones reported in the paper.
>> ROUGE-F(1/2/l): 62.23/50.13/61.87
I noticed that the ROUGE scores change when running inference again (still staying relatively high). Do you know how to keep the results stable?
Hi @jinpeng01, I'd like to replicate the WGSum results on my hardware and have a question about the ROUGE score I get.
What I did so far:
model_trans/openi.pt
for here: https://drive.google.com/drive/folders/1okrhVfsfTqZ4mnsmABiZG0sWBqrHPOg2?usp=sharingsrc/WGSum_test.sh
and run inference on the data inbert_openI/radiology/
(see full log below)I get following ROUGE scores:
Questions:
OpenI WGSUM (TRANS+GAT)
with R1/R2/RL of 61.63/50.98/61.73?Thank you!
Jan
Conda environment:
Full execution log
The text was updated successfully, but these errors were encountered: