===

RWKV-Runner https://github.com/josStorer/RWKV-Runner 1.5B/3B/7B

https://modelscope.cn/studios/BlinkDL/RWKV-CHN/summary

===

AI-Writer

AI N/A/I GPU RWKV GPT https://github.com/BlinkDL/RWKV-LM

Nhttps://github.com/BlinkDL/AI-Writer/releases/tag/v2022-02-15

A/Ihttps://github.com/BlinkDL/AI-Writer/releases/tag/v2022-02-15-A

https://blinkdl.github.io/AI-Writer/

Python

1. ReleaseQQ model
2. python run.pyrun.batcmd

CPU exe QQ 553456870 325154699TGhttps://t.me/ai_writer

Python python server.pyserver.bat web-client index.htmlChrome

https://zhuanlan.zhihu.com/p/394766831

https://www.zhihu.com/people/bopengbopeng

Paddle https://github.com/JunnYu/Paddle-AI-Writer

python3.8.xWindowswin10 6421H1

WindowsQQCPU exeCPUAVX2intelAVX2WindowsCPU
WindowsNpython3.8CUDA 11.1CUDNNtorch1.9.1+cu111QQ940mx1050ti2G4G
WindowsA/Ipython3.8pip install torch onnxruntime-directmlA/I run.py  server.py  dml 
WindowsCPUpython3.8pip install torchN run.py  server.py  cpu 
LinuxNWindowsN
LinuxA/Ihttps://onnxruntime.ai/CPU
LinuxCPUWindowsCPU
MacCPUWindowsCPUMacpip3python3

1.  run.py  server.py 
2. no module named 'xxx' -->  pip install xxx NGPUpytorchcudaA/IGPUonnxruntime-directml
3. module 'torch' has no attribute 'tile' -->  pytorch 1.9 
4. no such file or directory: 'model/xxx' -->  model pythonpy
5.  --> run.pyserver.pyLENGTH_OF_EACH9999999
6.  --> https://github.com/BlinkDL/RWKV-LM QQ143626394
7.  --> 512xx%x
8. ctx_len --> 512

https://zhuanlan.zhihu.com/p/432263234

https://zhuanlan.zhihu.com/p/432715547

https://zhuanlan.zhihu.com/p/435972716

1.  RWKV-LM  AI-writer  run.py ctx_len n_layer n_head  RWKV-LM  train.py  WORD_NAMEjson MODEL_NAME
2.  run.py  UNKNOWN_CHAR \ue083 \uxxxx\ UNKNOWN_CHAR 
3.  server.py

   
  
  
  
  
  

  
  

  
------------------------------------------------------------
   
  
  
  
  

  
  
  
  

  
  
  

• 512

8849 768

• "" = 0.123 -1.534 ...-0.827 2.343 ...

• 768

• A"-"B"-"

• 0.001

• +0.001-0.001

512 512*768 = 393216

393216 768

768 8849