Rodrigo Rodriguez (Pragmatismo)
4e781b1815
Add logic to detect changes in llm-related configuration properties when syncing gbot configs. If any llm- keys differ from stored values, automatically restart LLaMA servers to apply updates. This ensures model servers stay in sync with configuration changes without unnecessary restarts.
779 B
779 B
| 1 | name | value |
|---|---|---|
| 2 | server_host | 0.0.0.0 |
| 3 | server_port | 8080 |
| 4 | sites_root | /tmp |
| 5 | llm-key | none |
| 6 | llm-url | http://localhost:8081 |
| 7 | llm-model | ../../../../data/llm/DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_M.gguf |
| 8 | embedding-url | http://localhost:8082 |
| 9 | embedding-model | ../../../../data/llm/bge-small-en-v1.5-f32.gguf |
| 10 | llm-server | false |
| 11 | llm-server-path | botserver-stack/bin/llm/build/bin |
| 12 | llm-server-host | 0.0.0.0 |
| 13 | llm-server-port | 8081 |
| 14 | llm-server-gpu-layers | 35 |
| 15 | llm-server-n-moe | 23 |
| 16 | llm-server-ctx-size | 16000 |
| 17 | llm-server-parallel | 8 |
| 18 | llm-server-cont-batching | true |
| 19 | llm-server-mlock | true |
| 20 | llm-server-no-mmap | true |
| 21 | email-from | from@domain.com |
| 22 | email-server | mail.domain.com |
| 23 | email-port | 587 |
| 24 | email-user | user@domain.com |
| 25 | email-pass | |
| 26 | custom-server | localhost |
| 27 | custom-port | 5432 |
| 28 | custom-database | mycustomdb |
| 29 | custom-username | |
| 30 | custom-password |