Knowledge Grounded Dialogue System Implementation with HuggingFace and PyTorch

My implementation

• package list

• conda create -n kgc-torch python==3.8
• conda install pytorch cudatoolkit=11.3 -c pytorch
• pip install transformers (4.22.2)
• pip install parlai (1.7.1)
• pip install colorlog (6.7.0)
• pip install git+https://github.com/bckim92/language-evaluation.git

Batch size tip

• per_device_train_batch_size : 1
• per_device_eval_batch_size : 1
• grad_accumulation_steps : 4

• which is available for 2080ti (nearly 110000MB)