19 lines
614 B
Markdown
19 lines
614 B
Markdown
# LLM Tricks
|
|
Trying to find *anything* useful to do with local LLMs.
|
|
|
|
All scripts work with data within `PRIVATE_DATA/` so that private data can't be
|
|
accidentally committed.
|
|
|
|
###### `cosine_similarity.lua`
|
|
Opens `embeddings.json` and creates `similarities.json` with a sorted list of
|
|
comparisons.
|
|
|
|
###### `generate_embeddings.lua`
|
|
Opens every file on its whitelist within the `notebook` directory, and generates
|
|
embeddings (placed in `embeddings.json`). When files are too long, it truncates
|
|
them.
|
|
|
|
###### `least_similar.lua`
|
|
Opens `similarities.json`, reverses the sort order, and saves it as
|
|
`differences.json`.
|