Commit graph

43 commits

Author SHA1 Message Date
f40cb6c7b4 Fix typos in bot file extensions and keyword names
Changed incorrect references to .vbs files to .bas and corrected
USE_WEBSITE keyword naming. Also added missing fields to API response
structure and clarified that start.bas is optional for bots.
2025-11-26 22:54:22 -03:00
f62e0d4f37 - From 8 to 13.5 2025-11-24 13:02:30 -03:00
a39bfce495 - New stuff, 6.1. 2025-11-21 23:23:53 -03:00
7779a915e9 - New keywords. 2025-11-21 10:44:29 -03:00
b79c483a2e feat(llm): pass model configuration to LLM generation and streaming
Include model parameter in LLM provider calls across automation, bot, and keyword modules to ensure correct model selection based on configuration. This improves flexibility and consistency in LLM usage.
2025-11-12 08:19:21 -03:00
baea0b942c feat: refactor prompt compaction and clean up test files
- Renamed `execute_compact_prompt` to `compact_prompt_for_bots` and simplified logic
- Removed redundant comments and empty lines in test files
- Consolidated prompt compaction threshold handling
- Cleaned up UI logging implementation by removing unnecessary whitespace
- Improved code organization in ui_tree module

The changes focus on code quality improvements, removing clutter, and making the prompt compaction logic more straightforward. Test files were cleaned up to be more concise.
2025-11-11 18:32:52 -03:00
a8e3a2c026 feat: improve prompt formatting and system metrics
- Update prompt formatting in BotOrchestrator to use clearer labels (SYSTEM/CONTEXT) with emphasis markers
- Remove unused token_ratio field from SystemMetrics struct
- Increase default context size (2048->4096) and prediction length (512->1024) in config
- Clean up metrics calculation by removing redundant token ratio computation

The changes improve readability of system prompts and simplify metrics collection while increasing default model capacity.
2025-11-05 12:46:08 -03:00
7f1e6dc91c feat: refactor auth and models, update LLM fallback strategy
- Simplified auth module by removing unused imports and code
- Cleaned up shared models by removing unused structs (Organization, User, Bot, etc.)
- Updated add-req.sh to comment out unused directories
- Modified LLM fallback strategy in README with additional notes about model behaviors

The changes focus on removing unused code and improving documentation while maintaining existing functionality. The auth module was significantly reduced by removing redundant code, and similar cleanup was applied to shared models. The build script was adjusted to reflect currently used directories.
2025-11-04 23:11:33 -03:00
ed70ae1e17 feat(session): add interaction tracking and history management
Added interaction count tracking for sessions with Redis or in-memory fallback. Implemented conversation history replacement functionality to compact and update message history. The changes include:
- New AtomicUsize counter in SessionManager for interaction tracking
- increment_and_get_interaction_count method with Redis support
- replace_conversation_history to update and compact message history
- Maintains existing functionality while adding new features
2025-11-03 17:22:54 -03:00
588cac89cc refactor(bot): restructure message handling and context flow
- Reformatted `update_session_context` call for better readability.
- Moved context‑change (type 4) handling to a later stage in the processing pipeline and removed early return, ensuring proper flow.
- Adjusted deduplication logic formatting and clarified condition.
- Restored saving of user messages after context handling, preserving message history.
- Added detailed logging of the LLM prompt for debugging.
- Simplified JSON extraction for `message_type` and applied minor whitespace clean‑ups.
- Overall code refactor improves maintainability and corrects context‑change handling behavior.
2025-11-03 15:20:53 -03:00
b420ea4f73 feat: implement message deduplication and LLM config improvements
- Deduplicate consecutive messages with same role in conversation history
- Add n_predict configuration option for LLM server
- Prevent duplicate message storage in session manager
- Update announcement schedule timing from 37 to 55 minutes
- Add default n_predict value in default bot config
2025-11-03 14:13:22 -03:00
aab87a8f0a feat(automation): improve cron matching and job locking
- Refactor cron matching to use individual variables for each time component with additional debug logging
- Replace SETEX with atomic SET NX EX for job locking in Redis
- Add better error handling and logging for job execution tracking
- Skip execution if Redis is unavailable or job is already held
- Add verbose flag to LLM server startup command for better logging
2025-11-03 13:52:28 -03:00
d20d08d2df feat: optimize suggestions and LLM server configuration
- Added duplicate filtering for suggestions in both backend (Rust) and frontend (JavaScript)
- Changed announcement summary schedule from every 15 minutes to hourly at :37
- Simplified LLM prompt for document summarization
- Updated LLM server configuration with reduced GPU layers and increased context size
- Removed memory mapping and lock settings for LLM server
- Improved HTML formatting and added missing newline at EOF
2025-11-03 13:38:55 -03:00
82dea88188 feat: add trace logging, refactor bot streaming, add config fallback
- Added `trace!` logging in `bot_memory.rs` to record retrieved memory values for easier debugging.
- Refactored `BotOrchestrator` in `bot/mod.rs`:
  - Removed duplicate session save block and consolidated message persistence.
  - Replaced low‑level LLM streaming with a structured `UserMessage` and `stream_response` workflow, improving error handling and readability.
- Updated configuration loading in `config/mod.rs`:
  - Imported `get_default_bot` and enhanced `get_config` to fall back to the default bot configuration when the primary query fails.
  - Established a fresh DB connection for the fallback path to avoid borrowing issues.
2025-11-03 10:13:39 -03:00
2e9fb67ac3 feat(drive_monitor): restart LLaMA servers on llm- config changes
Add logic to detect changes in llm-related configuration properties when syncing gbot configs. If any llm- keys differ from stored values, automatically restart LLaMA servers to apply updates. This ensures model servers stay in sync with configuration changes without unnecessary restarts.
2025-11-01 14:23:40 -03:00
588220d7ac refactor(config): replace raw SQL with Diesel query for bot config
Updated `ConfigManager::get_config` to use Diesel query builder instead of raw SQL for improved safety and maintainability. Adjusted parameter naming and integrated schema references. Also refactored `ensure_llama_servers_running` to fetch configuration from the database using `AppState` and `ConfigManager`. Removed unused imports in bootstrap module.
2025-11-01 11:48:46 -03:00
4ece2e3bf3 feat(config): refactor AI config into separate LLM and embedding configs
- Split AIConfig into separate LLMConfig and embedding config structs
- Update create_site.rs to use config.llm instead of config.ai
- Improve config loading comments in bootstrap manager
- Add new LLM-related environment variables with defaults
- Maintain backward compatibility with existing config loading
- Clean up unused AIConfig struct and related code

The change better organizes the AI-related configuration by separating LLM and embedding configurations, making the code more maintainable and flexible for future AI service integrations.
2025-11-01 08:43:14 -03:00
1c80c026d2 feat: refactor database connection handling and add LLM component
- Replace direct database connection establishment with shared `establish_pg_connection` utility
- Add "llm" to required components list in bootstrap manager
- Lower default RUST_LOG level from debug to info in VSCode config
- Clean up imports and connection error messages
- Remove hardcoded database URL strings in favor of centralized connection handling

The changes improve code maintainability by centralizing database connection logic and adding support for the new LLM component in the bootstrap process.
2025-11-01 07:20:04 -03:00
7b4e7bc800 refactor(config): remove unused S3 bucket configuration and setup logic
Eliminates the `s3_bucket` field from `AppConfig` and deletes related initialization code in `main.rs`. This simplifies configuration management since S3 bucket handling is no longer required or used in the application.
2025-10-29 09:54:39 -03:00
48eec70e74 Add AWS SDK integration and update bot configuration management
- Introduced AWS SDK dependencies for S3 and CSV handling.
- Implemented logic to check and update the default bot configuration in S3 after component installation.
- Added a new configuration CSV template for bot settings.
- Refactored package manager to register cache component with updated download URL and binary name.
- Updated README and Cargo files to reflect new dependencies and configuration options.
2025-10-26 14:15:43 -03:00
c88a240903 Migration to Rust removal of Azure. 2025-10-06 10:29:14 -03:00
591e243892 chore: remove unused image assets and update API URL in configuration 2025-04-25 01:46:35 -03:00
2a4710b902 fix: update URLs and email addresses to reflect new domain 2025-04-15 12:49:05 -03:00
19e923d994 fix(all): Templates OK. 2024-09-29 20:23:13 -03:00
Rodrigo Rodriguez
2ebaa1151c fix (templates): ai-search OK. Fix themes. 2024-09-19 17:46:43 -03:00
Rodrigo Rodriguez
64ee0b7ee7 fix (templates): ai-search OK. Image by AI. 2024-09-19 09:17:30 -03:00
Rodrigo Rodriguez
b22a3dc87b fix (templates): ai-search OK. 2024-09-18 18:43:19 -03:00
Rodrigo Rodriguez
d7b80f596f fix (templates): ai-search OK. 2024-09-18 14:46:39 -03:00
Rodrigo Rodriguez
130ecd81fd fix (templates): ai-search OK. 2024-09-18 13:45:33 -03:00
Rodrigo Rodriguez
76bf359831 fix (templates): ai-search OK. 2024-09-18 13:21:21 -03:00
Rodrigo Rodriguez
723417f7aa new (basic.gblib): auto-publish. 2024-09-11 00:33:17 -03:00
Rodrigo Rodriguez
490fc426cd fix (all): path and fs normalization. 2024-09-10 23:25:07 -03:00
Rodrigo Rodriguez
c50d1f6e39 fix (all): path and fs normalization. 2024-09-09 17:54:25 -03:00
Rodrigo Rodriguez
81c604224a fix(llm.gblib): Tool fix. More templates. 2024-09-02 20:16:56 -03:00
Rodrigo Rodriguez
c85f7f6888 new(all): WebDav support for all bots. 2024-09-01 10:08:56 -03:00
Rodrigo Rodriguez
9207cffa52 new(all): WebDav support for all bots. 2024-08-31 16:26:54 -03:00
Rodrigo Rodriguez
02e78c6c88 new(all): WebDav support for all bots. 2024-08-31 15:35:32 -03:00
Rodrigo Rodriguez
28a4290b6a new(all): WebDav support for all bots. 2024-08-30 14:15:02 -03:00
Rodrigo Rodriguez
589c2b2f4c fix(all): TRUE multicloud. 2024-08-27 16:15:08 -03:00
Rodrigo Rodriguez
27a4441fc5 fix(all): TRUE multicloud. 2024-08-27 15:32:03 -03:00
Rodrigo Rodriguez
e7880e003b fix(all): New templates. 2024-08-23 00:00:04 -03:00
Rodrigo Rodriguez
ee1e026cb7 new(all): TRUE multicloud. 2024-08-20 23:04:33 -03:00
Rodrigo Rodriguez
f021baabc3 new(all): TRUE multicloud. 2024-08-19 23:03:58 -03:00