LLM Large Language Model list, 거대 언어모델 개발 현황

 

 

AI 챗봇의 기반이 되는 LLM(Large Language Model, 거대언어모델) 개발 현황입니다.

잘못된 내용이 있다면 댓글 남겨주세요.

 

 

Open Source

T5(Oct 2019, Google AI), mT5(Oct 2020, Hugging Face), PanGu-α(Apr 2021, Huawei), CPM-2(Jun 2021, BAAI), T0(Oct 2021, Hugging Face), CodeGen(Mar 2022, Salesforce), GPT-NeoX-20B(Apr 2022, EleutherAI), Tk-Instruct(Apr 2022, AI2), UL2(May 2022, Google AI), OPT(May 2022, Meta), NLLB(Jul 2022, Meta), CodeGeeX(Sep 2022,  ZhipuAI), GLM(Oct 2022, Tsinghua Uni.), Flan-T5(Oct 2022, Google AI), BLOOM(Nov 2022, Hugging Face), mT0(Nov 2022, Hugging Face), Galactica(Nov 2022, Meta), BLOOMZ(Nov 2022, Hugging Face), OPT-IML(Dec 2022, Meta), LLaMA(Feb 2023, Meta), Claude(Mar 2023, Anthropic), Pythia(Apr 2023, EleutherAI)

Closed Source 

GPT-(May 2020, OpenAI), GShard(Jun 2020, Google AI), Codex(Jul 2021, OpenAI), ERNIE 3.0(Jul 2021, Baidu), Jurassic-1(Aug 2021, AI21), HyperCLOVA(Sep 2021, Naver), FLAN(Sep 2021, Google AI), Yuan 1.0(Oct 2021, Inspur), Anthropic(Dec 2021, Anthropic), WebGPT(Dec 2021, OpenAI), Gopher(Dec 2021, DeepMind), ERNIE 3.0 Titan(Dec 2021, Baidu), GLaM(Dec 2021, Google AI), LaMDA(Jan 2022, Google AI), MT-NLG(Jan 2022, Microsoft & NVIDIA), AlphaCode(Feb 2022, DeepMind), InstructGPT(Mar 2022, OpenAI), Chinchilla(Mar 2022, DeepMind), PaLM(Apr 2022, Google AI), AlexaTM(Aug 2022, Amazon), Sparrow(Sep 2022, DeepMind), WeLM(Sep 2022, WeChat AI), U-PaLM(Oct 2022, Google AI), Flan-PaLM(Oct 2022, Google AI), Flan-U-PaLM(Oct 2022, Google AI), GPT-4(Mar 2023, OpenAI), PanGu(Mar 2023, Huawei)

 

 

Pixabay, Kohji Asakawa