This repo has been deprecated, please refer to https://github.com/lamini-ai/lamini-sdk
In this SDK, we include tutorials for achieving high-quality results with Language Models (LLMs) like Llama3 using Lamini.
With Lamini, you own the LLM you create -- you can deploy it or release it open source.
This SDK teaches effective tools for building LLMs.
We strongly encourage following the SDK in order as the concepts build on each other and are sorted by difficulty.
- Llama3 - generate text with Llama3, a powerful LLM.
- Eval - evaluate the quality of your LLM.
- Prompt Tuning - improve the quality of your LLM by tuning the prompts you use.
- RAG Tuning - improve the quality of your LLM by tuning the retrieval component.
- Data Pipeline - prepare your data for training an LLM.
- Fine Tuning - fine tune an LLM on your data.
The goal of this SDK is to teach and provide examples of important tools for building LLMs.
The examples emphasize simplicitly and readibility, not heavy optimization.
Once you have mastered a module from this SDK, consider forking it and adapting it to your own application.
All of the code in this repository is licensed Apache 2. You are free to use it for any purpose including commercial applications.
This SDK follows an earnings call application where we use an LLM to answer analyst questions about earnings calls from public companies.
Before you start, please get your Lamini API key and install the python library.
First, get <YOUR-LAMINI-API-KEY> at https://app.lamini.ai/account.
Then add the key as an environment variable by creating a config file ~/.lamini/configure.yaml
production:
key: <YOUR-LAMINI-API-KEY>Next, install the Python library.
pip install --upgrade lamini
The source code for SDK can be found on GitHub at lamini-ai/lamini-earnings-sdk. Feel free to explore and contribute!
Lamini is the LLM platform for developers to specialize LLMs on their own data and infrastructure: easier, faster, and better than any LLM for their use case.
Our mission is to build customizable superintelligence that anyone can build and own.
