FazBrowse GitHub Viewer | Trending | | Home

Tools: [Original HTTPS Page]

HPLT - High Performance Language Technologies · GitHub

HPLT - High Performance Language Technologies

A space that combines petabytes of natural language data with large-scale model training

Overview
Repositories
Discussions
Projects
Packages
People

Pinned Loading

OpusCleaner OpusCleaner Public

OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.

Python 59 17
OpusTrainer OpusTrainer Public

Curriculum training

Python 25 8

Repositories

Type Language Sort

hplt-e Public
Multilingual evaluation framework

hplt-project/hplt-e's past year of commit activity

Python 4 MIT 0 0 0 Updated Jul 24, 2026
data-analytics-tool Public
HPLT Analytics

hplt-project/data-analytics-tool's past year of commit activity

JavaScript 16 GPL-3.0 4 0 1 Updated Jul 22, 2026
HPLT-WP4 Public
Information and pipelines on WP4: language models training

hplt-project/HPLT-WP4's past year of commit activity

Jupyter Notebook 3 CC0-1.0 3 5 0 Updated Jul 16, 2026
HPLT-textpipes Public
Step-by-step schematic description of data processing in HPLT

hplt-project/HPLT-textpipes's past year of commit activity

Python 1 MIT 1 1 0 Updated Jun 21, 2026
openlid Public Forked from laurieburchell/open-lid-dataset
OpenLID-v3

hplt-project/openlid's past year of commit activity

Python 1 GPL-3.0 6 0 0 Updated Jun 17, 2026
bitextor-slurm Public Forked from paracrawl/cirrus-scripts
Scripts for running bitextor jobs

hplt-project/bitextor-slurm's past year of commit activity

Shell 0 1 1 0 Updated May 15, 2026
minhash-retrieval Public
Find your documents in the HPLT datasets

hplt-project/minhash-retrieval's past year of commit activity

Python 0 MIT 1 0 0 Updated May 11, 2026
openlid-v3-evaluation Public
OpenLID-v3

hplt-project/openlid-v3-evaluation's past year of commit activity

HTML 1 0 0 0 Updated Mar 9, 2026
monotextor-slurm Public
Set of scripts to run monotextor-like pipeline under slurm HPCs

hplt-project/monotextor-slurm's past year of commit activity

Rust 5 GPL-3.0 1 0 0 Updated Feb 26, 2026
monolingual-multilingual-instruction-tuning Public
Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca

hplt-project/monolingual-multilingual-instruction-tuning's past year of commit activity

Python 10 1 0 0 Updated Feb 16, 2026

View all repositories

People

Top languages

Loading…

Most used topics

Loading…

Back | FazBrowse Home | New Git URL