Rodrigo Rodriguez (Pragmatismo)
41d7377ab7
- Deduplicate consecutive messages with same role in conversation history - Add n_predict configuration option for LLM server - Prevent duplicate message storage in session manager - Update announcement schedule timing from 37 to 55 minutes - Add default n_predict value in default bot config
807 B
807 B
| 1 | name | value |
|---|---|---|
| 2 | server_host | 0.0.0.0 |
| 3 | server_port | 8080 |
| 4 | sites_root | /tmp |
| 5 | llm-key | none |
| 6 | llm-url | http://localhost:8081 |
| 7 | llm-model | ../../../../data/llm/DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_M.gguf |
| 8 | embedding-url | http://localhost:8082 |
| 9 | embedding-model | ../../../../data/llm/bge-small-en-v1.5-f32.gguf |
| 10 | llm-server | false |
| 11 | llm-server-path | botserver-stack/bin/llm/build/bin |
| 12 | llm-server-host | 0.0.0.0 |
| 13 | llm-server-port | 8081 |
| 14 | llm-server-gpu-layers | 0 |
| 15 | llm-server-n-moe | 0 |
| 16 | llm-server-ctx-size | 512 |
| 17 | llm-server-n-predict | 50 |
| 18 | llm-server-parallel | 6 |
| 19 | llm-server-cont-batching | true |
| 20 | llm-server-mlock | false |
| 21 | llm-server-no-mmap | false |
| 22 | email-from | from@domain.com |
| 23 | email-server | mail.domain.com |
| 24 | email-port | 587 |
| 25 | email-user | user@domain.com |
| 26 | email-pass | |
| 27 | custom-server | localhost |
| 28 | custom-port | 5432 |
| 29 | custom-database | mycustomdb |
| 30 | custom-username | |
| 31 | custom-password |