Search results

Funnel Transformer with Roberta Tokenizer.

Status: Open.

#13 In laiguokun/Funnel-Transformer;

· Vignesh-Sampat opened on Mar 5, 2022

Train From Scratch

Status: Open.

#12 In laiguokun/Funnel-Transformer;

· shivanisrivarshini opened on Oct 20, 2021

Pretrained models link error

Status: Open.

#11 In laiguokun/Funnel-Transformer;

· a2108073 opened on Aug 9, 2021

Question related to pretraining with residual connection

Status: Open.

#10 In laiguokun/Funnel-Transformer;

· hxu38691 opened on Mar 11, 2021

Deep VAEs as a research direction for the successor of XLnet

Status: Open.

#9 In laiguokun/Funnel-Transformer;

· LifeIsStrange opened on Nov 28, 2020

An Issue about the position embedding code

Status: Open.

#8 In laiguokun/Funnel-Transformer;

· hscspring opened on Oct 11, 2020

Pretraining Issues

Status: Open.

#6 In laiguokun/Funnel-Transformer;

· nemani opened on Aug 2, 2020

Do you apply wnli trick ? If so, can you open the code ?

Status: Open.

#4 In laiguokun/Funnel-Transformer;

· richarddwang opened on Jul 18, 2020

How long does it take to do pre-training?

Status: Open.

#3 In laiguokun/Funnel-Transformer;

· shizhediao opened on Jul 1, 2020