A Brief Introduction of Current Large Language Models (LLMs)
Table of Contents
This article will be updated during the time.
1. The Overview of LLMs
2. Librarys
2.1. RWKV
Introductions:
https://johanwind.github.io/2023/03/23/rwkv_overview.html https://johanwind.github.io/2023/03/23/rwkv_details.html
SpikeGPT that use the RWKV mechanism: https://github.com/ridgerchu/SpikeGPT
ChatRWKV: https://github.com/BlinkDL/ChatRWKV https://zhuanlan.zhihu.com/p/616351661