Swallow LLM

Swallow LLM

Research and development of large language models conducted by the members mainly in Okazaki Laboratory and Yokota Laboratory at Institute of Science Tokyo (formerly known as Tokyo Institute of Technology)

View on HuggingFace
Swallow LLM

Gemma-2-Llama Swallow

LLMs that enhance Japanese capability of Gemma 2 (2B, 9B, 27B)

Llama 3.1 Swallow 8B v0.5

LLMs that enhance Japanese capability of Llama 3.1 8B

Llama 3.3 Swallow 70B v0.4

LLMs that enhance Japanese capability of Llama 3.3 70B

Llama 3.1 Swallow

LLMs that enhance Japanese capability of Llama 3.1 (8B, 70B)

Llama 3 Swallow

LLMs that enhance Japanese capability of Llama 3 (8B, 70B)

Swallow on Mistral

LLMs that enhance Japanese capability of Mistral 7B and Mixtral 8x7B

Swallow

LLMs that enhance Japanese capability of Llama 2 (7B, 13B, 70B)

Swallow LLM Leaderbord

Evaluation of Japanese LLMs conducted by the Swallow team

Naoaki Okazaki

Naoaki Okazaki

Professor, Science Tokyo

Project leader, team leader of pre-training corpus, Web developer

Rio Yokota

Rio Yokota

Professor, Science Tokyo

Team leader of LLM training

Sakae Mizuki

Sakae Mizuki

Researcher, AIST / Science Tokyo

Team leader of instruction tuning, team leader of LLM evaluation

Kazuki Fujii

Kazuki Fujii

Master student, Science Tokyo

LLM training, instruction tuning

Taishi Nakamura

Taishi Nakamura

Master student, Science Tokyo

LLM training, instruction tuning, and evaluation

Youmi Ma

Youmi Ma

Assistant Professor, Science Tokyo

Post-training

Sangwhan Moon

Sangwhan Moon

Researcher, Science Tokyo

Post-training

Koki Maeda

Koki Maeda

PhD student, Science Tokyo

LLM evaluation

Masanari Ohi

Masanari Ohi

Master student, Science Tokyo

LLM evaluation

Takumi Okamoto

Takumi Okamoto

Master student, Science Tokyo

Instruction tuning

Shigeki Ishida

Shigeki Ishida

Master student, Science Tokyo

LLM evaluation

Masaki Kawamura

Masaki Kawamura

Master student, Science Tokyo

Development of Language resources

Yukito Tajima

Yukito Tajima

Master student, Science Tokyo

Development of Language resources

Taihei Shiotani

Taihei Shiotani

Master student, Science Tokyo

LLM evaluation

Hinari Shimada

Hinari Shimada

Master student, Science Tokyo

LLM evaluation, safety

Koshiro Saito

Koshiro Saito

Master student, Science Tokyo

LLM evaluation

Tatsuya Ichinose

Tatsuya Ichinose

Undergraduate student, Science Tokyo

LLM evaluation

Naoya Matsushita

Naoya Matsushita

Undergraduate student, Science Tokyo

LLM evaluation

Sora Miyamoto

Sora Miyamoto

Undergraduate student, Science Tokyo

LLM evaluation

Yuta Katayama

Yuta Katayama

Undergraduate student, Science Tokyo

Development of Language resources, instruction tuning

Nguyen Tien Dung

Nguyen Tien Dung

Undergraduate student, Science Tokyo

Development of Language resources

Hiroya Takamura

Hiroya Takamura

Research team leader, AIRC, AIST

Project manager

Mengsay Loem

Mengsay Loem

Master of TokyoTech

Expert of LLM evaluation

Shota Hirai

Shota Hirai

Master of TokyoTech

Expert of development of pre-training corpora

Taiki Iida

Taiki Iida

PhD of TokyoTech

Expert of tokenization for LLMs

Kakeru Hattori

Kakeru Hattori

Master student, Science Tokyo

Expert of development of pre-training corpora, LLM evaluation

Get in touch

Avenco comes with a built-in contact form.