most of this should've been committed a long time ago...
This commit is contained in:
@@ -0,0 +1,18 @@
|
||||
# LLM Tricks
|
||||
Trying to find *anything* useful to do with local LLMs.
|
||||
|
||||
All scripts work with data within `PRIVATE_DATA/` so that private data can't be
|
||||
accidentally committed.
|
||||
|
||||
###### `cosine_similarity.lua`
|
||||
Opens `embeddings.json` and creates `similarities.json` with a sorted list of
|
||||
comparisons.
|
||||
|
||||
###### `generate_embeddings.lua`
|
||||
Opens every file on its whitelist within the `notebook` directory, and generates
|
||||
embeddings (placed in `embeddings.json`). When files are too long, it truncates
|
||||
them.
|
||||
|
||||
###### `least_similar.lua`
|
||||
Opens `similarities.json`, reverses the sort order, and saves it as
|
||||
`differences.json`.
|
||||
Reference in New Issue
Block a user