Commit graph

4713 commits

Author SHA1 Message Date
d2314ce44b fix: unified atomic redis guard for start.bas in both websocket and stream flows
All checks were successful
BotServer CI / build (push) Successful in 47s
2026-04-30 17:08:38 -03:00
e9b1a3078c fix: claude client should not duplicate /v1/messages in URL
All checks were successful
BotServer CI / build (push) Successful in 48s
2026-04-30 16:56:45 -03:00
d15b712180 fix: sanitize malformed HTML tags (remove spaces after <)
All checks were successful
BotServer CI / build (push) Successful in 2m21s
2026-04-30 16:47:11 -03:00
debe29a6dc fix: start.bas redundant execution with atomic SET NX guard
All checks were successful
BotServer CI / build (push) Successful in 42s
2026-04-30 16:45:37 -03:00
5c54f7bc72 fix: robust HTML stripping for XLSX to remove CSS garbage and decode entities
All checks were successful
BotServer CI / build (push) Successful in 46s
2026-04-30 16:10:36 -03:00
2cf30ac388 trigger CI: actual file change
All checks were successful
BotServer CI / build (push) Successful in 19m24s
2026-04-30 15:40:54 -03:00
9a92d33568 trigger CI: push to ALM 2026-04-30 15:39:51 -03:00
8c8e548377 fix: XLSX HTML stripping + start.bas session execution bug
Some checks failed
BotServer CI / build (push) Failing after 8m23s
2026-04-30 15:27:01 -03:00
2012f29324 fix: Strip HTML tags from XLSX content and frontend display
Some checks failed
BotServer CI / build (push) Failing after 7m9s
- Backend: Add strip_html_tags() function to remove HTML from XLSX cells
- Frontend: Strip HTML tags before displaying bot messages
- Prompt: Update PROMPT.md to instruct GPT not to show raw HTML

Fixes issue where XLSX cell content with HTML formatting
was being displayed as raw HTML tags in chat responses.
2026-04-30 14:15:12 -03:00
aeb567fb7f feat: optimize Salesianos bot with rich HTML, thinking strip, and updated deployment with backup
All checks were successful
BotServer CI / build (push) Successful in 51m13s
2026-04-30 09:50:03 -03:00
749b340cec Fix #498: XLSX and XLS files must be correctly indexed
- Changed extract_xlsx_text() to use open_workbook() instead of open_workbook_from_rs()
- Changed extract_xls_text() to use open_workbook() instead of open_workbook_from_rs()
- The calamine 0.26 API uses open_workbook(path) for direct file access
- This matches the pattern used in import_export.rs and vectordb.rs
- Updated AGENTS.md to clarify bots are stored as MinIO buckets
- Added test start.bas with USE KB "sheetlib" for testing KB injection

Root cause: open_workbook_from_rs() is not the correct API for calamine 0.26
Impact: XLSX and XLS files in .gbkb folders were failing to index into vector DB
Fix: Use standard open_workbook() API that accepts file path directly
2026-04-29 20:38:52 -03:00
3762cae53b Fix: XLSX and XLS files must be correctly indexed
- Changed extract_xlsx_text() to use open_workbook() instead of open_workbook_from_rs()
- Changed extract_xls_text() to use open_workbook() instead of open_workbook_from_rs()
- The calamine 0.26 API uses open_workbook(path) for direct file access
- This matches the pattern used in import_export.rs and vectordb.rs
- Fixes issue #498 where XLSX/XLS files were not being properly indexed into KB

Root cause: open_workbook_from_rs() is not the correct API for calamine 0.26
Impact: XLSX and XLS files in .gbkb folders were failing to index into vector DB
Fix: Use standard open_workbook() API that accepts file path directly
2026-04-29 19:23:52 -03:00
4e19d786ac fix(ci): git stash before pull to avoid unstaged changes error
All checks were successful
BotServer CI / build (push) Successful in 1m29s
2026-04-29 12:56:42 -03:00
0e260c9927 fix(ci): sccache wrapper + incremental=false for correct caching
Some checks failed
BotServer CI / build (push) Failing after 23s
- Add sccache wrapper that unsets CARGO_INCREMENTAL (sccache 0.14.0
  refuses to work when that env var is present, even if =0)
- Remove rustc-wrapper from .cargo/config.toml (use RUSTC_WRAPPER env in CI)
- Set [profile.dev] incremental = false to avoid sccache 'prohibited' error
- DEV-DEPENDENCIES.sh now installs sccache 0.14.0 + wrapper correctly
- CI workflow: unset CARGO_INCREMENTAL env (let sccache wrapper handle it)

Tested on alm-ci: 50% cache hit rate on rebuild after target/ removal.
2026-04-29 12:49:07 -03:00
5d9b88018f fix(ci): use direct download for sccache 0.14.0 in DEV-DEPENDENCIES.sh
cargo-binstall requires cargo env which may not be set for root.
Direct GitHub release download is simpler and more reliable.
2026-04-29 11:03:38 -03:00
93bb15997e fix(ci): upgrade sccache to 0.14.0, enable CARGO_INCREMENTAL=1
Some checks failed
BotServer CI / build (push) Failing after 45s
- DEV-DEPENDENCIES.sh: installs sccache 0.14.0 via cargo-binstall
  (was 0.7.5 which prohibited incremental compilation)
- Removes old sccache binary before installing new one
- Copies to /usr/local/bin so all users can access it
- CI workflow: CARGO_INCREMENTAL=1 now supported by sccache 0.14.0
2026-04-29 10:48:04 -03:00
36d2d42834 feat: Add Rust toolchain and dev tool setup to DEV-DEPENDENCIES.sh - Install rustup, sccache, mold, cargo-audit/machete/tree - Expand OS package lists with protobuf, sqlite, fontconfig deps - Auto-generate .cargo/config.toml with mold + sccache - Add idempotency checks for each tool
Some checks failed
BotServer CI / build (push) Failing after 14s
2026-04-29 10:35:16 -03:00
47cdb2bf78 refactor: remove deprecated documentation, configuration, and utility scripts 2026-04-29 10:35:16 -03:00
c445aa6de7 test(ci): trivial change to measure incremental build time with sccache
All checks were successful
BotServer CI / build (push) Successful in 25m59s
2026-04-29 10:13:14 -03:00
c5b84b4948 fix(ci): revert CARGO_INCREMENTAL to 0 - sccache prohibits incremental
All checks were successful
BotServer CI / build (push) Successful in 23m28s
sccache 0.7.5 errors with 'increment compilation is prohibited'
when CARGO_INCREMENTAL=1. Keep at 0 and rely on the fixed
touch-only-changed-files logic to preserve sccache cache hits.
2026-04-29 09:31:28 -03:00
c49a7ef65c fix(ci): correct YAML indentation causing workflow parse error
Some checks failed
BotServer CI / build (push) Failing after 39s
- Fixed CARGO_INCREMENTAL indent (was 8 spaces, needs 6)
- Quoted PATH value to avoid colon parsing issues
- Broke if/then across lines for readability
2026-04-29 09:24:27 -03:00
45c5a2b2e5 fix(ci): sccache effective - incremental=1, touch only changed files
- CARGO_INCREMENTAL=1 enables sccache to cache Rust compilations
  (was 0, making all compilations non-cacheable)
- Only touch files that changed between old and new rev
  (was touching ALL files, invalidating entire sccache cache)
- Use git pull --rebase to avoid merge conflicts in CI
2026-04-29 08:43:47 -03:00
7177e64079 chore: tweak startup message 2026-04-29 08:43:47 -03:00
2c8ee74428 fix: correct info! macro format string 2026-04-29 08:43:47 -03:00
9814b7c2c9 feat: add GENERAL BOTS ASCII logo on startup 2026-04-29 08:43:46 -03:00
945dd9a116 chore: bump auth log version 2026-04-29 08:43:46 -03:00
97e5db5b11 ci: remove submodule reference, fix health check port to 5858 2026-04-29 08:43:46 -03:00
5d9b1ebf80 chore: refine auth handler log format for traceability 2026-04-29 08:43:46 -03:00
7cb8f2887e refactor: remove staging environment automation scripts and documentation files 2026-04-29 07:16:04 -03:00
cd643f8f26 Merge branch 'main' of github.com:generalbots/generalbots 2026-04-29 07:12:48 -03:00
ac485f58da ci: Set all source mtime to HEAD commit time for consistent sccache hits
All checks were successful
BotServer CI / build (push) Successful in 16m34s
2026-04-28 20:06:46 -03:00
818a49ce00 ci: Restore git mtime after pull for sccache hits
Some checks failed
BotServer CI / build (push) Has been cancelled
2026-04-28 19:58:43 -03:00
c5b98c4e88 ci: timing test - incremental build
Some checks failed
BotServer CI / build (push) Has been cancelled
2026-04-28 19:46:27 -03:00
6c489d10ea fix: YAML indentation, botui release build, correct deploy paths
All checks were successful
BotServer CI / build (push) Successful in 22m5s
2026-04-28 19:21:38 -03:00
1a0c96fc7e fix: Build botui as release profile, deploy from target/release/ 2026-04-28 19:04:01 -03:00
89be3a59a2 fix: Use internal target dir, hostname system from /etc/hosts, remove env vars
Some checks failed
BotServer CI / build (push) Has been cancelled
- Remove CARGO_TARGET_DIR env var (use default target/ inside project)
- Remove STAGE_SYSTEM_HOST and SYSTEM_USER (use gbuser@system from /etc/hosts)
- Fix deploy paths to /opt/gbo/work/generalbots/target/debug/
- Frees 12G on alm-ci by removing /opt/gbo/work/target/
2026-04-28 18:53:14 -03:00
96fe7e5827 fix: Clean Cargo.toml junk, fix YAML indentation, sccache incremental=0 only in CI
Some checks failed
BotServer CI / build (push) Failing after 1m2s
2026-04-28 18:44:13 -03:00
ccce992587 fix: Clean YAML indentation, remove git reset from CI, CARGO_INCREMENTAL=0 only in CI
Some checks failed
BotServer CI / build (push) Failing after 11m48s
- Fix YAML parse error (line 29 colon issue) with proper indentation
- Remove git reset --hard and git clean -fd that invalidated sccache cache
- CARGO_INCREMENTAL=0 as env var in CI only (dev keeps incremental=true)
- .cargo/config.toml keeps incremental default for dev sccache benefit
2026-04-28 18:25:00 -03:00
203e874180 fix: Verify sccache cache preservation with CARGO_INCREMENTAL=0 2026-04-28 18:16:44 -03:00
0bc456629b Merge branch 'main' of github.com:generalbots/generalbots 2026-04-28 18:16:43 -03:00
71b9c38490 fix: Preserve sccache cache by removing git reset/clean, disable incremental compilation
- git reset --hard + git clean -fd invalidated file timestamps causing 566 Rust cache misses
- Just git pull preserves timestamps and lets sccache hit cached artifacts
- CARGO_INCREMENTAL=0 prevents sconflict between incremental and sccache
- systemctl stop with || true to avoid deploy failure
2026-04-28 18:13:02 -03:00
bb027b22c8 test: Trigger CI to verify runner polling
All checks were successful
BotServer CI / build (push) Successful in 30m21s
2026-04-28 17:35:30 -03:00
848eda7b68 trigger: Force new CI job with updated workflow
Some checks are pending
BotServer CI / build (push) Waiting to run
2026-04-28 17:22:39 -03:00
8e7c9c6d27 trigger: Test deploy with correct IP after workspace update 2026-04-28 17:14:02 -03:00
130bfd0e54 config: Set sccache, 6 jobs, and mold linker in .cargo/config.toml
- rustc-wrapper = "sccache" for faster rebuilds
- jobs = 6 for parallel compilation
- linker = "clang" with mold for faster linking

This ensures all developers and CI use the same optimized build settings.
Run: cargo build -p botserver --bin botserver
2026-04-28 17:00:13 -03:00
9eed5ab1f9 trigger: Force CI to pick up new jobs after runner restart 2026-04-28 16:55:08 -03:00
8e43c0f74f trigger: Force new CI run with updated workflow 2026-04-28 16:44:06 -03:00
6d201b847b trigger: Rebuild after runner fix 2026-04-28 16:38:59 -03:00
a0f0b26c95 fix: Runner agora roda como gbuser (não-root)
- Criado serviço systemd para forgejo-runner como gbuser
- Removido runner root antigo
- Todas permissões de /opt/gbo/work agora são gbuser:gbuser
- Fim dos erros de permissão no cache do sccache
2026-04-28 16:31:28 -03:00
c0269fadc2 fix: Use IP instead of hostname for stage deploy
Some checks failed
BotServer CI / build (push) Failing after 1m43s
- Change STAGE_SYSTEM_HOST from 'system' to '10.0.3.10'
- Fixes SSH 'Connection closed by 127.0.0.1' error
- Build successful (17m with sccache + mold)
2026-04-28 16:22:33 -03:00