Machine Learning

Machine Learning in Linux: Dalai – LLaMA and Alpaca

Dalai bills itself as “the simplest way to run LLaMA on your local machine”.

Given that our Machine Learning in Linux series focuses on apps that make it easy to experiment with machine learning, Dalai looks an interesting project to spotlight.

What’s LLaMA? It’s an acronym for Large Language Model Meta AI, a collection of open and efficient foundation language models designed to help researchers advance their work in this subfield of AI.

Large Languages Models trained on massive amount of text can perform new tasks from textual instructions. They can generate creative text, solve maths problems, answer reading comprehension questions, and much more. Like other large language models, LLaMA works by taking a sequence of words as an input and predicts a next word to recursively generate text.

Installation

Dalai needs Python <= 3.10 and Node.js >=18. On our Ubuntu 22.04 LTS test system, we need to replace our version of Node.js as it’s too old. The simplest way to upgrade on Ubuntu is via a PPA (personal package archive). Run the following command:

$ curl -fsSL https://deb.nodesource.com/setup_19.x | sudo -E bash - &&\
sudo apt-get install -y nodejs

We can verify the new version of node.js with the command:

$ node -v
v19.8.1

We can now proceed and use npx for the installation. On a fresh installation of Ubuntu 22.04 LTS we’ll also need to install npm, a package manager for Node.js and JavaScript.

$ sudo apt install npm

We’re now ready to install Dalai and its 7B model (we recommend you start with this model as it’s the smallest).

$ npx dalai llama install 7B

Part of the installation process quantizes the model. On a fairly modern processor the quantization process takes under a minute.

The web UI server is launched with the command:

$ npx dalai serve

Next page: Page 2 – In Operation and Summary

Pages in this article:
Page 1 – Introduction and Installation
Page 2 – In Operation and Summary

Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

9 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
broken
broken
1 year ago

Not working for me, node -v now is now v12.22.9

Roge
Roge
1 year ago
Reply to  broken

Works fine for me

TheDogGod
TheDogGod
1 year ago

Loved this post – heress my feedback –
I think Dalai is an excellent project that makes it easy for researchers to experiment with machine learning on their local machines. The fact that it focuses on Large Language Model Meta AI (LLaMA) is impressive, as this subfield of AI has enormous potential. LLaMA’s ability to perform various tasks from textual instructions, generate creative text, solve math problems, and answer reading comprehension questions is truly remarkable. I am excited to see how Dalai will advance the work of researchers in this subfield and look forward to seeing more updates on this project.
Thanks for reading , Love The Blog !!

Mo
Mo
1 year ago
Reply to  TheDogGod

Sounds like spam written with ChatGPT

TheDogGod
TheDogGod
1 year ago
Reply to  Mo

not at all buddy lol !!!

Cody Hodges
Cody Hodges
8 months ago

Awesome! Its genuinely remarkable post, I have got much clear idea regarding from this post

Donald Knight
Donald Knight
7 months ago

Hi there to all, for the reason that I am genuinely keen of reading this website’s post to be updated on a regular basis. It carries pleasant stuff.

eti tiny house
eti tiny house
4 months ago

I just like the helpful information you provide in your articles

mirc sohbet
mirc sohbet
1 month ago

Pretty! This has been a really wonderful post. Many thanks for providing these details.