1. The Raw Data folder stores the raw data crawled through the API, and the Refine Data folder stores the processed files that are passed on to the next step.
2. The train_set05.csv is the manually labeled training set.
3. The BERTmodel folder stores the fine-tuned BERT model.
4. The fine-tuning BERT model script runs on an A100 40GB, and the fine-tuning process requires about 34GB of graphics memory.
5. The first seven scripts are all Python programming. The last regression script is an R markdown document.# MasterThesis