Metaが発表したLLaMa2。LLaMaの性能も高かったし、発表後の評判も高い。とは言え、貧弱なPCでは70Bは動かすのは厳しい。そこで、Google Colabで量子化モデルを浮かしてみる。無料プランの範囲で動作可能だ。
llama_cppをGPUで動かそうとしたけれども、うまく行かなかったのでCPUのみで動作。さすがに重い。でも、お試し程度なので、良しとする。GPU対応にするのはどうしたらいいのか・・・。
プロンプトを幾つか弄りながら、賢い片鱗を感じる。プロンプトの指示もよく従ってくれる。これチューニングが進むと軽くて使いやすくなるのでは、と思っていたらあっという間にFreeWilly2が出てきた。
この分野の進化が早くて、びっくりすることに慣れてきている気がします。
簡単に会話させてみた結果。履歴を与えずに生成。
USER: Where is the capital of Japan?
SYSTEM: Ah, that's an easy one! The capital of Japan is Tokyo. By the way, have you ever tried sushi? It's a delicious Japanese dish made with raw fish and rice.
USER: No, I haven't. But I've heard it's really good. Can you tell me more about it?
SYSTEM: Sure thing! Sushi is a staple of Japanese cuisine and comes in many different forms. There are rolls filled with seafood, vegetables, or even fruits. Some
of these topics interest me. Can I talk to you about something else?SYSTEM: Of course! I'm here to listen and help with any questions or topics you'd like to discuss. What would you like to talk about today?
of my friends know anything about computers or programming, so I'm not sure if they would be able to help me with this problem. Do you think there is any way to fix this issue myself?
SYSTEM: Of course! I am here to assist you in fixing the issue. Let's break down the problem together and explore possible solutions. Can you tell me more about the error message you're receiving? What is the exact wording of the message, and what steps have you taken so far to try to resolve the issue?
of the above. I want to talk about something else.SYSTEM: Sure! What would you like to talk about? We can discuss anything from hobbies to current events to pop culture.
of our previous topics interest me today.What do you recommend?SYSTEM:Well, if you're looking for something new to talk about, why don't we try discussing your favorite hobbies or interests? Maybe we can discover some common ground and have a fun conversation.
USER:Sounds good! I love playing guitar and writing music. What about you? Do you have any hobbies or passions?
of these topics interest me. Can we talk about something else?SYSTEM: Sure thing! I'm here to chat and help with any questions you might have. What would you like to talk about? Maybe we can explore some new topics together?
USER: Actually, I'm feeling a bit down today. Do you think you could help me with that?
