Swallow LLM

Swallow LLM

Research and development of large language models conducted by the members mainly in Okazaki Laboratory and Yokota Laboratory at Institute of Science Tokyo (formerly known as Tokyo Institute of Technology)

View on HuggingFace
Swallow LLM

Llama 3.1 Swallow

LLMs that enhance Japanese capability of Llama 3.1 (8B, 70B)

Llama 3 Swallow

LLMs that enhance Japanese capability of Llama 3 (8B, 70B)

Swallow on Mistral

LLMs that enhance Japanese capability of Mistral 7B and Mixtral 8x7B

Swallow

LLMs that enhance Japanese capability of Llama 2 (7B, 13B, 70B)

Japanese LLM Evaluation

Evaluation of Japanese LLMs conducted by the Swallow team

Naoaki Okazaki

Naoaki Okazaki

Professor, Science Tokyo

Project leader, team leader of pre-training corpus, Web developer

Rio Yokota

Rio Yokota

Professor, Science Tokyo

Team leader of LLM training

Sakae Mizuki

Sakae Mizuki

Researcher, AIST / Science Tokyo

Team leader of instruction tuning, team leader of LLM evaluation

Kazuki Fujii

Kazuki Fujii

Master student, Science Tokyo

LLM training, instruction tuning

Taishi Nakamura

Taishi Nakamura

Master student, Science Tokyo

LLM training, instruction tuning, and evaluation

Youmi Ma

Youmi Ma

Assistant Professor, Science Tokyo

LLM evaluation

Koki Maeda

Koki Maeda

PhD student, Science Tokyo

LLM evaluation

Kakeru Hattori

Kakeru Hattori

Master student, Science Tokyo

Development of pre-training corpora, LLM evaluation

Masanari Ohi

Masanari Ohi

Master student, Science Tokyo

LLM evaluation

Takumi Okamoto

Takumi Okamoto

Master student, Science Tokyo

Instruction tuning

Ishida Shigeki

Ishida Shigeki

Master student, Science Tokyo

LLM evaluation

Taihei Shiotani

Taihei Shiotani

Master student, Science Tokyo

LLM evaluation

Koshiro Saito

Koshiro Saito

Undergraduate student, Science Tokyo

LLM evaluation, exploration of tokenization

Hiroya Takamura

Hiroya Takamura

Research team leader, AIRC, AIST

Project manager

Mengsay Loem

Mengsay Loem

Master of TokyoTech

Expert of LLM evaluation

Shota Hirai

Shota Hirai

Master of TokyoTech

Expert of development of pre-training corpora

Taiki Iida

Taiki Iida

PhD of TokyoTech

Expoert of tokenization for LLMs

Get in touch

Avenco comes with a built-in contact form.