7a7d455414
Change verbose startup logs from INFO to TRACE (credentials, spawn commands)
2025-12-29 10:34:25 -03:00
30a0619ec8
Exit cleanly on server bind failure instead of returning raw error
2025-12-29 10:28:49 -03:00
586e5e7a6e
Add proper ERROR logging for server bind failures
2025-12-29 08:45:46 -03:00
6a41cbcc10
Remove redundant ensure_services_running() call - start_all() handles it
2025-12-29 08:41:42 -03:00
0e7b4b66ec
Add DROP TABLE for knowledge base tables to fix migration
2025-12-29 08:36:50 -03:00
6aceb4bc59
Remove embedding columns from PostgreSQL - Qdrant handles vector storage
2025-12-29 08:29:12 -03:00
84fa9abe0a
Make pgvector extension optional - use BYTEA fallback for embeddings
2025-12-29 08:27:57 -03:00
c665189279
Add DROP TABLE CASCADE at start of 6.1.0 migration for clean re-run
2025-12-29 08:18:14 -03:00
6112732e9c
Add DROP TABLE before user_organizations CREATE to fix partial migration
2025-12-29 08:12:17 -03:00
38f9abb7db
Fix organizations foreign key reference (org_id not id)
2025-12-29 08:07:42 -03:00
4fdad88333
Remove SECURITY_AUDIT.md
2025-12-28 21:28:01 -03:00
a5dee11002
Security audit: Remove all production .unwrap()/.expect(), add SafeCommand, ErrorSanitizer
...
- Phase 1 Critical: All 115 .unwrap() verified in test code only
- Phase 1 Critical: All runtime .expect() converted to proper error handling
- Phase 2 H1: Antivirus commands now use SafeCommand (added which/where to whitelist)
- Phase 2 H2: db_api.rs error responses use log_and_sanitize()
- Phase 2 H5: Removed duplicate sanitize_identifier (re-exports from sql_guard)
32 files modified for security hardening.
Moon deployment criteria: 10/10 met
2025-12-28 21:26:08 -03:00
928f29e888
feat(security): Complete security wiring and log audit
...
SECURITY WIRING:
- Auth middleware wired to main router with AnonymousPath config
- CORS allowed origins loaded from bot_configuration database (config.csv)
- Zitadel auth config loads from Vault via SecretsManager
- No more env vars for sensitive config (only VAULT_* allowed)
LOG AUDIT:
- Added is_sensitive_config_key() check in ask_later.rs
- Sensitive config values (password, secret, token, key, etc) now logged as [REDACTED]
- Removed potential credential exposure in pending_info logs
CONFIG LOADING ORDER:
1. VAULT_ADDR and VAULT_TOKEN from .env
2. All secrets from Vault (gbo/directory for Zitadel)
3. Bot config from config.csv (cors-allowed-origins, etc)
Auth Config Paths:
- Anonymous: /health, /healthz, /api/health, /ws, /auth
- Public: /static, /favicon.ico
2025-12-28 19:41:33 -03:00
c67aaa677a
feat(security): Complete security infrastructure implementation
...
SECURITY MODULES ADDED:
- security/auth.rs: Full RBAC with roles (Anonymous, User, Moderator, Admin, SuperAdmin, Service, Bot, BotOwner, BotOperator, BotViewer) and permissions
- security/cors.rs: Hardened CORS (no wildcard in production, env-based config)
- security/panic_handler.rs: Panic catching middleware with safe 500 responses
- security/path_guard.rs: Path traversal protection, null byte prevention
- security/request_id.rs: UUID request tracking with correlation IDs
- security/error_sanitizer.rs: Sensitive data redaction from responses
- security/zitadel_auth.rs: Zitadel token introspection and role mapping
- security/sql_guard.rs: SQL injection prevention with table whitelist
- security/command_guard.rs: Command injection prevention
- security/secrets.rs: Zeroizing secret management
- security/validation.rs: Input validation utilities
- security/rate_limiter.rs: Rate limiting with governor crate
- security/headers.rs: Security headers (CSP, HSTS, X-Frame-Options)
MAIN.RS UPDATES:
- Replaced tower_http::cors::Any with hardened create_cors_layer()
- Added panic handler middleware
- Added request ID tracking middleware
- Set global panic hook
SECURITY STATUS:
- 0 unwrap() in production code
- 0 panic! in production code
- 0 unsafe blocks
- cargo audit: PASS (no vulnerabilities)
- Estimated completion: ~98%
Remaining: Wire auth middleware to handlers, audit logs for sensitive data
2025-12-28 19:29:18 -03:00
561264521c
Add SECURITY_TASKS.md - security audit checklist, consolidate duplicate utils
2025-12-28 15:32:48 -03:00
61618a9641
Update PROMPT.md - 0 warnings achieved, document fix patterns
2025-12-28 14:29:44 -03:00
aeb4e8af0f
Fix all clippy warnings - 0 warnings
2025-12-28 14:27:52 -03:00
96cf7b57f8
App generator LLM-only, app logs, knowledge base, web search, designer magic
2025-12-28 11:50:50 -03:00
9dee342817
fix(intent_compiler): Use LLM-generated basic_code instead of hardcoded keyword mapping
...
- Remove hardcoded keyword switch/case (CREATE_TASK, LLM, RUN_PYTHON, etc.)
- Use step.basic_code directly from LLM generation
- LLM generates BASIC code for tools/schedulers/monitors
- Simple fallback if no code generated
2025-12-27 23:29:21 -03:00
8c24e25965
fix(bootstrap): Make S3/MinIO connection failure non-fatal
...
- Change from error to warn when bucket creation fails
- Continue bootstrap without drive if MinIO not available
- Prevents startup failure when S3 not configured
2025-12-27 23:15:51 -03:00
36fb7988cb
refactor: Move AutoTask system from basic/keywords to auto_task module
...
- Move app_generator, intent_classifier, intent_compiler, autotask_api, designer_ai, ask_later, auto_task, safety_layer to src/auto_task/
- Create auto_task/mod.rs with exports and route configuration
- Update imports in moved files
- Update main.rs to use auto_task::configure_autotask_routes
- Keep table_definition in keywords (shared utility)
2025-12-27 22:58:43 -03:00
a384678fb8
feat(autotask): Complete AutoTask flow with LLM-based app generation
...
- Add comprehensive platform capabilities prompt for LLM (all APIs, HTMX, BASIC)
- Add designer.js to all generated pages (dashboard, list, form)
- Add /api/autotask/pending endpoint for ASK LATER items
- Add /api/designer/modify endpoint for AI-powered app modifications
- Wire autotask routes in main.rs
- Create APP_GENERATOR_PROMPT.md with full API reference
- LLM decides everything - no hardcoded templates
2025-12-27 22:38:16 -03:00
06d0bf1f0a
feat(autotask): Add missing API endpoints for UI compatibility
...
- Add execute_task_handler for POST /api/autotask/:task_id/execute
- Add get_task_logs_handler for GET /api/autotask/:task_id/logs
- Add apply_recommendation_handler for POST /api/autotask/recommendations/:rec_id/apply
- Update route configuration in mod.rs
2025-12-27 21:16:12 -03:00
14b7cf70af
feat(autotask): Implement AutoTask system with intent classification and app generation
...
- Add IntentClassifier with 7 intent types (APP_CREATE, TODO, MONITOR, ACTION, SCHEDULE, GOAL, TOOL)
- Add AppGenerator with LLM-powered app structure analysis
- Add DesignerAI for modifying apps through conversation
- Add app_server for serving generated apps with clean URLs
- Add db_api for CRUD operations on bot database tables
- Add ask_later keyword for pending info collection
- Add migration 6.1.1 with tables: pending_info, auto_tasks, execution_plans, task_approvals, task_decisions, safety_audit_log, generated_apps, intent_classifications, designer_changes
- Write apps to S3 drive and sync to SITE_ROOT for serving
- Clean URL structure: /apps/{app_name}/
- Integrate with DriveMonitor for file sync
Based on Chapter 17 - Autonomous Tasks specification
2025-12-27 21:10:09 -03:00
5da86bbef2
Fix clippy warnings: match arms, async/await, Debug impls, formatting
...
- Fix match arms with identical bodies by consolidating patterns
- Fix case-insensitive file extension comparisons using eq_ignore_ascii_case
- Fix unnecessary Debug formatting in log/format macros
- Fix clone_from usage instead of clone assignment
- Fix let...else patterns where appropriate
- Fix format! append to String using write! macro
- Fix unwrap_or with function calls to use unwrap_or_else
- Add missing fields to manual Debug implementations
- Fix duplicate code in if blocks
- Add type aliases for complex types
- Rename struct fields to avoid common prefixes
- Various other clippy warning fixes
Note: Some 'unused async' warnings remain for functions that are
called with .await but don't contain await internally - these are
kept async for API compatibility.
2025-12-26 08:59:25 -03:00
db6d7a9859
fix: zero warnings in botserver
...
- drive/vectordb.rs: fix struct field name db_path -> _db_path
- meet/conversations.rs: prefix 38 unused variables with underscore
- console/mod.rs: rename border_active/inactive, title_bg/fg
- console/mod.rs: fix unnested or-pattern KeyCode::Char
- email/mod.rs: remove unnecessary raw string hashes, fix unused state
- attendance/drive.rs: update deprecated aws_config::from_env()
- Cargo.toml: attendance feature extends drive for AWS deps
2025-12-24 10:31:18 -03:00
d09a584443
Fix dead code warnings: prefix unused fields with underscore
2025-12-24 09:53:03 -03:00
c2588d80d5
Fix conditional parameter usage and core_functions references
2025-12-24 09:50:30 -03:00
3a260a5703
Fix more clippy warnings: unused imports, raw string hashes, conditional imports
2025-12-24 09:42:16 -03:00
3a8510d191
Fix clippy warnings: raw strings, unused imports, format args, must_use attributes
2025-12-24 09:39:23 -03:00
7cbfe43319
Update attendance, keywords, calendar, compliance, console, core, drive, email, llm, msteams, security, and tasks modules
2025-12-24 09:29:27 -03:00
883c6d07e1
Remove all code comments and fix ratatui version
2025-12-23 18:40:58 -03:00
e2a5bf091a
Update server components and keywords
2025-12-23 15:52:35 -03:00
a491cc13a6
Update botserver
2025-12-21 23:40:43 -03:00
dd91fc2d3b
refactor: fix TaskEngine feature gate, thread-safe Extensions with Arc<RwLock>
2025-12-20 19:57:57 -03:00
5619cf2e16
fix: add DNS configuration to containers before apt-get
...
- Add Google DNS (8.8.8.8, 8.8.4.4) to /etc/resolv.conf
- Fixes 'Temporary failure resolving' errors in containers
2025-12-19 22:32:57 -03:00
2cff6bf430
fix: make exec_in_container return errors instead of silently warning
...
- Changed from warn() to error() and return Err()
- Added info logging for each command executed
- Now we can see why downloads/installs fail
2025-12-19 19:59:15 -03:00
27b5184f82
fix: pass VAULT_ADDR inside container via bash -c
...
- env() on Command only sets host env, not container env
- Use bash -c with VAULT_ADDR=... prefix for init and unseal commands
2025-12-19 13:19:50 -03:00
110ca2f3de
fix: store vault-unseal-keys in working directory, not /opt/gbo/secrets
2025-12-19 12:28:22 -03:00
c750e26c3b
feat: auto-generate .env and vault-unseal-keys on vault install
...
- Vault is automatically initialized with 5 keys, threshold 3
- Creates /opt/gbo/secrets/vault-unseal-keys with chmod 600
- Creates or appends to .env with VAULT_ADDR, VAULT_TOKEN, VAULT_UNSEAL_KEYS_FILE
- Vault is automatically unsealed after init
- No manual steps required for initial setup
2025-12-19 12:20:55 -03:00
4062c79cce
feat: use secrets file for Vault auto-unseal (more secure)
...
- VAULT_UNSEAL_KEYS_FILE points to /opt/gbo/secrets/vault-unseal-keys
- Unseal keys stored in separate file with chmod 600
- Not in .env (which might be in git, logs, etc.)
- Output shows step-by-step setup instructions
2025-12-19 11:36:00 -03:00
2a8f884864
fix: improve container IP detection and add VAULT_UNSEAL_KEYS to .env
...
- Wait for network before getting IP
- Try hostname -I as fallback for IP detection
- Add VAULT_UNSEAL_KEY_1/2/3 to .env output for auto-unseal
- botserver can auto-unseal Vault on startup using these keys
2025-12-19 11:02:27 -03:00
3eb86772fa
feat: show connection info after container install
...
- Only Vault returns .env variables (VAULT_ADDR, VAULT_TOKEN)
- All other components show 'botserver vault put' commands to store credentials
- Added proper vault init/unseal instructions
- CLI now prints InstallResult with IP, ports, and connection info
2025-12-19 10:49:09 -03:00
79e83dd3b8
fix: install base packages (wget, unzip, curl) in containers before download
...
- Vault download was failing because unzip was not installed
- Now all containers get wget, unzip, curl, ca-certificates as base packages
- Also added vault config.hcl generation in pre-install commands
2025-12-19 09:48:15 -03:00
2c61c816b5
fix: allow container install without Vault configured
...
- Make create_container_service work without DATABASE_URL from Vault
- Components like vault, vector_db that don't need DB can now install first
- DB_PASSWORD defaults to empty string when Vault is not available
2025-12-19 09:33:56 -03:00
8efeeaed4b
fix: make container installation fully non-interactive
...
- Add automatic lxd init --auto before container creation
- Use DEBIAN_FRONTEND=noninteractive for apt-get
- Add apt-get update -qq before installing packages
2025-12-18 21:20:47 -03:00
3987546ebc
feat: add fallback images for LXC container creation and install-dependencies.sh
...
- Try ubuntu:24.04, ubuntu:22.04, images:debian/12, images:debian/11 in order
- Clean up failed container attempts before trying next image
- Add install-dependencies.sh script for runtime library installation
- Fixes 404 error when LXD image server has outdated cached images
2025-12-18 21:09:26 -03:00
5d5668fee2
chore: consolidate migrations 6.1.1-6.1.3 into 6.1.0_enterprise_suite
...
- Integrate config ID type fixes (TEXT → UUID)
- Integrate connected_accounts, session_account_associations, account_sync_items
- Integrate bot hierarchy (parent_bot_id, enabled_tabs_json, inherit_parent_config)
- Integrate email_monitors, folder_monitors, folder_change_events, email_received_events
- Integrate user_organizations table
- Remove separate 6.1.1, 6.1.2, 6.1.3 migration folders
- Maximum version remains 6.1.0 per project standards
2025-12-18 18:52:52 -03:00
5b552f633f
ci: debug build, no swap (fastest)
2025-12-18 17:33:04 -03:00
44e1281b63
ci: fix swap setup and optimize release build for low memory
2025-12-18 17:14:36 -03:00
