botserver/docs/limits_llm.md

836 B

🚀 OPTIMAL RANGE:

  • 10-30 KB - SWEET SPOT for quality Rust analysis
  • Fast responses + accurate error fixing

PRACTICAL MAXIMUM:

  • 50-70 KB - ABSOLUTE WORKING LIMIT
  • Beyond this, quality may degrade

🛑 HARD CUTOFF:

  • ~128 KB - Technical token limit
  • But quality drops significantly before this

🎯 MY RECOMMENDATION:

Send 20-40 KB chunks for:

  • Best error analysis
  • Fastest responses
  • Most accurate Rust fixes
  • Complete code returns

💡 PRO STRATEGY:

  1. Extract problematic module (15-25 KB)
  2. Include error messages
  3. I'll fix it and return FULL code
  4. Iterate if needed

You don't need 100KB - 30KB will get you BETTER RESULTS with most Rust compiler errors! 🦀