Rodrigo Rodriguez (Pragmatismo)
eb647530bf
- Split AIConfig into separate LLMConfig and embedding config structs - Update create_site.rs to use config.llm instead of config.ai - Improve config loading comments in bootstrap manager - Add new LLM-related environment variables with defaults - Maintain backward compatibility with existing config loading - Clean up unused AIConfig struct and related code The change better organizes the AI-related configuration by separating LLM and embedding configurations, making the code more maintainable and flexible for future AI service integrations.
863 B
863 B
| 1 | name | value |
|---|---|---|
| 2 | server_host | 0.0.0.0 |
| 3 | server_port | 8080 |
| 4 | sites_root | /tmp |
| 5 | llm-key | none |
| 6 | llm-url | http://localhost:8080/v1 |
| 7 | llm-model | botserver-stack/data/llm/DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_M.gguf |
| 8 | embedding-url | http://localhost:8082 |
| 9 | embedding-model | botserver-stack/data/llm/bge-small-en-v1.5-f32.gguf |
| 10 | llm-server | false |
| 11 | llm-server-path | botserver-stack/bin/llm/ |
| 12 | llm-server-model | botserver-stack/data/llm/DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_M.gguf |
| 13 | llm-server-host | 0.0.0.0 |
| 14 | llm-server-port | 8080 |
| 15 | llm-server-gpu-layers | 35 |
| 16 | llm-server-n-moe | 4 |
| 17 | llm-server-ctx-size | 2048 |
| 18 | llm-server-parallel | 4 |
| 19 | llm-server-cont-batching | true |
| 20 | llm-server-mlock | true |
| 21 | llm-server-no-mmap | true |
| 22 | email-from | from@domain.com |
| 23 | email-server | mail.domain.com |
| 24 | email-port | 587 |
| 25 | email-user | user@domain.com |
| 26 | email-pass | |
| 27 | custom-server | localhost |
| 28 | custom-port | 5432 |
| 29 | custom-database | mycustomdb |
| 30 | custom-username | |
| 31 | custom-password |