Skip to content
/  ...  /  
awesome-dec...  /  
  • Watch 24

    Notifications

    Get push notifications on iOS or Android.
  • Fork 9 Fork your own copy of imaurer/awesome-decentralized-llm
Watch

Notifications

Get push notifications on iOS or Android.
Open in github.dev Open in a new github.dev tab

imaurer/awesome-decentralized-llm

main
Switch branches/tags
Go to file
Add file
Code

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
April 12, 2023 10:21

awesome-decentralized-llm

Collection of LLM resources that can be used to build products you can "own" or to perform reproducible research. Please note there are Terms of Service around some of the weights and training data that should be investigated before commercialization.

Currently collecting information on Autonomous Agents and Edge LLMs, but will add new sections as the field evolves.


Autonomous Agents

Autonomous Agent Repositories

  • babyagi - Python script example of AI-powered task management system. Uses OpenAI and Pinecone APIs to create, prioritize, and execute tasks. (2023-04-06, Yohei Nakajima)

  • Auto-GPT - An experimental open-source attempt to make GPT-4 fully autonomous. (2023-04-06, Toran Bruce Richards)

  • JARVIS - JARVIS, a system to connect LLMs with ML community (2023-04-06, Microsoft)

Autonomous Agent Resources


Edge LLMs

Edge LLM Repositories

  • Basaran Open-source text completion API for Transformers-based text generation models. (2023-04-12, Hyperonym)

  • TurboPilot CoPilot clone that runs code completion 6B-LLM with CPU and 4GB of RAM. (2023-04-11, James Ravenscroft)

  • LMFlow An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. (2023-04-06, OptimalScale)

  • xturing - Build and control your own LLMs (2023-04-03, stochastic.ai)

  • GPTQ-for-LLaMA - 4 bits quantization of LLaMA using GPTQ (2023-04-01, qwopqwop200, Meta ToS)

  • GPT4All - LLM trained with ~800k GPT-3.5-Turbo Generations based on LLaMa. (2023-03-28, Nomic AI, OpenAI ToS)

  • Dolly - Large language model trained on the Databricks Machine Learning Platform (2023-03-24, Databricks Labs, Apache)

  • bloomz.cpp Inference of HuggingFace's BLOOM-like models in pure C/C++. (2023-03-16, Nouamane Tazi, MIT License)

  • alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM (2023-03-16, Kevin Kwok, MIT License)

  • Stanford Alpaca - Code and documentation to train Stanford's Alpaca models, and generate the data. (2023-03-13, Stanford CRFM, Apache License, Non-Commercial Data, Meta/OpenAI ToS)

  • llama.cpp - Port of Facebook's LLaMA model in C/C++. (2023-03-10, Georgi Gerganov, MIT License)

  • ChatRWKV - ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source. (2023-01-09, PENG Bo, Apache License)

  • RWKV-LM - RNN with Transformer-level LLM performance. Combines best of RNN and transformer: fast inference, saves VRAM, fast training. (2022?, PENG Bo, Apache License)

Edge LLM Spaces, Models & Datasets

Edge LLM Resources

About

Collection of LLM resources that can be used to build products you can "own" or to perform reproducible research.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published