In this SDK, we include tutorials for achieving high-quality results with Language Models (LLMs) using Lamini.
With Lamini, you own the LLM you create -- you can deploy it or release it open source.
This SDK teaches effective tools for building LLMs.
We strongly encourage following the SDK in order as the concepts build on each other and are sorted by difficulty.

1. Playground - learn how to create a chat app that calls an LLM. We include examples using slack, python, and react.
2. Prompt Engineering - crafting and refining input queries or instructions to achieve desired responses from language models.
3. Retrieval Augmented Generation (RAG) - combining information retrieval with text generation to improve language models.
4. Instruction Fine Tuning (IFT) - train your LLM using data in a question and answer format.
5. JSON - extract structured output from an LLM, following a guaranteed JSON schema.
6. Evaluation - evaluate the quality of your LLM.
7. Classify - classify data using an LLM, e.g. to filter out low quality training data
8. Domain Adaptation - continue training your LLM using a large amount of new data. COMING SOON.
9. Pretraining - Train an LLM from scratch. Make sure you have 1,000s of GPUs allocated. COMING SOON.

The goal of this SDK is to teach and provide examples of important tools for building LLMs.
The examples emphasize simplicitly and readibility, not heavy optimization.
Once you have mastered a module from this SDK, consider forking it and adapting it to your own application.
All of the code in this repository is licensed Apache 2. You are free to use it for any purpose including commercial applications.

Before you start, please get your Lamini API key and install the python library.

First, get <YOUR-LAMINI-API-KEY> at https://app.lamini.ai/account. Add the key as an environment variable.

export LAMINI_API_KEY="<YOUR-LAMINI-API-KEY>"

Next, install the Python library.

pip install --upgrade lamini

The source code for SDK can be found on GitHub at lamini-ai/lamini-sdk. Feel free to explore and contribute!

Lamini is the LLM platform for developers to specialize LLMs on their own data and infrastructure: easier, faster, and better than any LLM for their use case.
Our mission is to build customizable superintelligence that anyone can build and own.