Skip to content
#

corpus-management

Star

Here are 5 public repositories matching this topic...

Language: All
Filter by language
All 5 Python 4 TypeScript 1

jknafou / TransCorpus

Star 0

TransCorpus is a scalable toolkit for large-scale, parallel translation and preprocessing of text corpora, built for language model pretraining and research.

nlp research deep-learning hpc machine-translation parallel-computing distributed-computing pytorch research-project corpus-data preprocessing language-model research-paper multi-gpu synthetic-data synthetic-dataset-generation fairseq synthetic-data-generation corpus-management
  • Updated Dec 3, 2025
  • Python

Improve this page

Add a description, image, and links to the corpus-management topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the corpus-management topic, visit your repo's landing page and select "manage topics."

Learn more