qyyfw/qihuaiflow
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
261 Commits 1 Branch 24 Tags
53bbbf31955b70d871428a551ce4a46f617e3244
Commit Graph
261 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
qihu-bot 53bbbf3195 #957 nginx 容器 root 修复 - ai.qihuyun.com 显示 nginx 默认页 
aiflow.conf 缺 server 级 root 指令导致 SPA fallback 走 nginx 默认 /usr/share/nginx/html. 修复后容器 8080 / host 12888 / 外部 ai.qihuyun.com 全部正确返回 544 bytes 七虎AI 前端页.
 2026-08-11 08:55:49 +08:00
QihuAI Design e58c37ea17 #954 更新扫描器 UA 黑名单加入 Infrawatch + InternetMeasurement (20260810-205514) 
access.log 发现 Infrawatch 探测 /mcp /sse 端点,InternetMeasurement 探测 / 首页. 加入 UA 黑名单 return 444. 验证:两个 UA 均被 444,正常 Mozilla 浏览器 200.
 2026-08-10 20:55:15 +08:00
qihu-bot b415a0b62e #937 LiteLLM 副 key 启用脚本 + 计划 (20260810-154721) 
新增 litellm/apply_secondary_key.sh + rollback + verify + README + docs/observability/litellm-failover-activation.md. 代码层已就绪(commit 84d89ab),等用户提供 SiliconFlow 副 key 后,单次低峰会话完成切换.
 2026-08-10 15:47:21 +08:00
qihu-bot e50d006ef4 #952 alloy traces 配置 bake Dockerfile + 计划 (20260810-154537) 
新增 alloy/Dockerfile + config.alloy + build.sh + README + docs/observability/alloy-bake-plan.md. 当前 bind mount /tmp/alloy 仍稳定,本会话仅交付可执行件,实际 build 待低峰期执行.
 2026-08-10 15:45:37 +08:00
qihu-bot 7e002ac2b5 P1-1 后端核心模块单测 (20260810-154318) 
新增 test_capability_discovery.py (30) + test_llm_router.py (21) 共 51 个哨兵单测,覆盖 #874 双 Claw 能力发现 / #875 LLM 路由熔断 / #876 OTel 桥接关键路径. 套件: 116 -> 165 passed.
 2026-08-10 15:43:19 +08:00
qihu-bot cee260d4bd P1-2 nginx 限流 + 扫描器拦截 (20260810-153624) 
三档限流 (api 30r/s, admin 5r/s, login 1r/s) + UA / path 黑名单 (return 444) + 自动黑名单脚本 (5min cron, 24h TTL). 实测首跑封禁 222.128.55.233 (4xx=31) 和 120.55.61.72 (UA=zgrab).
 2026-08-10 15:36:25 +08:00
SeniorDev bc96a087dd P0-1+P2-1+P2-3: 修 OTel traces pipeline + DROP LangBot 表 + nginx logrotate + cron 2026-08-10 14:31:44 +08:00
SeniorDev 56eb9f1634 #939 应用市场产品计费 webhook 设计 (HMAC 验签 + 幂等去重 + reconcile worker) 2026-08-09 21:42:27 +08:00
SeniorDev 0820d408eb #938 ChatPage UX 打磨 (移动端响应式 + 暗态增强 + 代码块复制按钮) 2026-08-09 21:40:44 +08:00
SeniorDev 84d89ab95a #937 LiteLLM failover 沙箱设计 + 演练脚本 2026-08-09 21:37:39 +08:00
SeniorDev 6e89a37ff7 #936 MCP SDK streamablehttp 稳定性回归 (兼容 mcp 2.0 重命名 + httpx2 fork) 2026-08-09 21:33:28 +08:00
SeniorDev 6d5c2cf2c0 #935 IM Bot Channel Adapter 化 (Telegram POC + im_channel_routes schema) 2026-08-09 21:06:01 +08:00
SeniorDev 048671870a stage3: 技能/应用市场解耦 - 前端拆分 (/marketplace/products + /admin/market-products) 2026-08-09 06:59:29 +08:00
QihuAI Design c1f8b164bb docs+tests: #873 事件契约与双 Claw Adapter 文档及哨兵测试 
- 新增 tests/test_engine_event.py (31 用例: EngineEvent 线格式/to_wire/from_wire,
  SseAdapter 裁剪+帧格式+frames, BufferAdapter 累积/媒体/诊断/截断, Diagnosis,
  test_dual_claw_wiring_source_guard 校验 chat.py/im_llm.py 接线)
- 新增 docs/dual-claw-event-contract.md (#873 契约文档 7 节)
- 全量 pytest 64 用例全绿 (含 test_dual_claw/test_node_registry 无回归)
- 仅文档/测试，非运行时代码，不 push
 2026-08-04 17:28:57 +08:00
QihuAI Design 33d0f9c32e feat(workflow #874): NodeRegistry 统一工作流节点抽象 + 双 Claw 事件对齐 
#874 P3 工作流引擎 NodeRegistry 统一（加速带「工具即节点」思想落地，零源码拷贝重写）：

- app/core/node_registry.py（新增）：把 skill / MCP / Agent / DAG 四套割裂表达收敛为
  单一 Node 抽象。BaseNode(Protocol) 定义 node_type/name/input_schema/output_schema/
  risk_level + async run(ctx)；NodeContext 携带 db/tenant_id/claw_type/trace_id/黑板/emit；
  NodeResult.to_blackboard() 与既有 orchestrator 黑板结构无缝互转。内建八型节点
  llm/reduce/local/external/agent/skill/mcp/loop，均继承 NodeBase 公共生命周期
  （发 start 步骤 -> 执行 -> ok/fail 覆盖同 index），异常统一归一为 NodeError（带结构化
  diagnosis）。SkillNode 用 asyncio.to_thread 包裹同步执行器避免阻塞事件循环；
  LoopNode 硬限流 20 次迭代 / 并发上限 5，子节点经 ctx.child() 复用同一 StepCounter 与
  emit，保证步骤序号全图唯一。CapabilitySnapshot 统一承载 skills/mcp_servers/agents/
  function_definitions/mcp_tool_map，供 _build_system_prompt、run_graph、yaml 校验三处
  共用同一份能力真相。normalize_claw() 将 im_wechat/im_platform 归一为 "im"，避免
  Grafana 维度碎片化。

- app/core/capability_discovery.py：新增 discover_agents()，与 discover_skills 同构的
  三级降级策略（显式安装 -> published 兜底 -> rank_by_query 裁剪），补齐 Agent 维度的
  统一能力发现，杜绝各处内联第二份发现逻辑（#866 回退事故教训）。

- app/core/orchestrator.py：VALID_NODE_TYPES 与 validate_graph 改为运行期读
  registry.node_types()/requires_agent()，注册表成为节点类型的单一真相源；_run_node 改为
  拼装 NodeContext 后委托 registry.get(ntype).run(ctx)，本体只保留调度与拓扑；run_graph
  新增 on_event/claw_type/tenant_id/snapshot 参数，编排全过程以统一 EngineEvent 下发。

- app/core/yaml_workflow.py：valid_node_types() 实时读注册表；validate_yaml 补 skill/mcp/
  loop 必填校验；yaml_to_orchestration / orchestration_to_yaml 双向透传节点扩展字段
  （label/skill_id/func_name/tool/server_id/args/body/items/split/max_iterations/
  concurrency/join），修复配置往返丢字段。

- app/core/engine_event.py：make_step 新增 node 参数，以 step["node"]={id,type,label}
  承载节点身份。设计书原文的 EngineEvent(kind="node") 与前端仅识别 thinking/skill/mcp/
  agent/kb/media 的现状冲突（未知 kind 会被静默丢帧），故映射为已知 kind + 附加字段，
  线格式对旧前端字节兼容。

- app/api/chat_service.py：Web Claw 编排调用点透传 on_event/claw_type/tenant_id，
  租户与通道标签复用 #875 的 ContextVar（get_route_ctx），不再新增一层参数透传。
  IM Claw 经 EngineCore 自动继承同一事件流（单引擎原则，im_llm.py 零改动）。

- tests/test_node_registry.py（新增）：R-NODE-1~11 确定性哨兵，无网络无外部依赖。守卫
  内建八型齐全、注册表为单一真相源（orchestrator 与 yaml 校验实时同源）、describe 契约、
  双 Claw 事件对齐（SseAdapter 与 BufferAdapter 逐键相等且均带 node 身份）、claw 归一与
  tenant 标签、新节点必填校验、YAML 往返不吞字段、Loop 限流聚合、失败结构化诊断两端可见、
  禁止第二份能力发现、register 拒绝非法节点。

验证：容器内 py_compile 全通过；pytest tests/ 退出码 0（85 项 = 83 passed + 2 skipped，
0 FAILED/ERROR），含 R-NODE 16 项与 R-DUAL 双 Claw 哨兵。

safe-align: 仅复制 7 个 git-tracked 文件，未触碰 secrets/.venv/node_modules/dist/caches。
本地提交不 push。
 2026-08-04 15:16:00 +08:00
QihuAI Design 04a0641202 feat(otel #876): 双 Claw 强制标签 + 入口接线 + Grafana 双 Claw 对比看板 
#876 OpenTelemetry 可观测（双 Claw 标签）：
- app/core/otel.py: 新增 set_otel_ctx/get_otel_ctx(ContextVar 三元组 tenant_id+claw_type+
  trace_id)；current_span_cm 自动注入双 Claw 强制标签，全部 13 个 span 调用点零签名侵入带维度；
  record_span_metrics 指标维度补 tenant_id+claw_type（trace_id 因高基数不计入指标标签）。
- app/core/llm_router.py: set_route_ctx 桥接转调 set_otel_ctx（单次入口注入双端共享：
  路由上下文 + OTel 标签），失败安全。
- app/api/chat.py: send_message 与 send_message_stream 入口注入 set_route_ctx(web)，
  stream 经 asyncio.create_task 子协程自动传播 contextvars，使 _send_message_core 内
  所有 span 均带 tenant_id+claw_type。
- app/api/im_llm.py: _call_real_llm 入口最早注入 set_route_ctx(im_wechat)，并显式开启
  im.send_message span（此前 IM Claw 完全无 span，Grafana 无 IM 数据点），finally 关闭。
- tests/test_dual_claw.py: R-DUAL-6 由 skip 转为确定性断言（Web/IM 双 Claw span 必带
  tenant_id+claw_type），作为持续哨兵。
- 交付 Grafana 双 Claw 对比看板 JSON（aiflow_span_* / aiflow_llm_route_total 按 claw_type
  分组：P50/P95 延迟、成功率、QPS、租户健康 Top10）。Alloy OTLP 仅桥接 metrics→Prometheus，
  trace 无 pipeline（#800 已压制 UNIMPLEMENTED 噪声），看板基于 metrics 出图。

safe-align: 仅复制 5 个 git-tracked 文件，未触碰 secrets/venv/node_modules/caches。本地提交不 push。
 2026-08-04 13:49:34 +08:00
QihuAI Design 180409d317 feat(#875): LLM Router shadow mode + consolidate litellm master key 2026-08-04 13:16:30 +08:00
QihuAI Design 037c965c26 feat(engine): #873 dual-Claw event contract + SseAdapter/BufferAdapter + chat.py SSE delegate + im_llm EngineCore thin-shell (gray-gated) 
- app/core/engine_event.py (#880): EngineEvent dataclass + make_* factories, single construction entry, byte-compatible wire with legacy ChatPage.tsx
- app/core/claw_adapters.py (#884): SseAdapter (hot frames zero-metadata, terminal keeps trace_id) + BufferAdapter (assemble() preserves __media__)
- app/api/chat.py (#881): /messages/stream now delegates to SseAdapter; wire bytes unchanged (46B delta / done+message_id)
- app/api/im_llm.py (#883): IM_USE_ENGINE_CORE gray gate; _call_engine_core reuses EngineCore via BufferAdapter (default OFF, preserves media fast-path)
- app/api/chat_service.py: capture 3 container-ahead fixes (stray import asyncio removed, logger.info format, LiteLLM master key)
 2026-08-04 12:25:12 +08:00
QihuAI Design 34648e4810 fix(im_bot): segment long WeChat text replies + enhance send diagnostics (#878)\n\niLink returns HTTP 200 but WeChat silently drops long messages (1698-char\nHTML image link, 3011-char skill list). Add WECHAT_TEXT_MAX_LEN=1500 and\nsegment long text into multiple items. Also log payload item lengths and\nmedia URL lengths for future diagnosis. 2026-08-04 11:14:02 +08:00
QihuAI Design f4e18bafe4 test: add R-DUAL dual-Claw regression sentinel (#873) - always-on guards for IM unified discovery / Web-IM parity / naming single-source; opt-in live MCP reachability; R-DUAL-3/6 pending 2026-08-04 10:42:45 +08:00
QihuAI Design 29a1ce2e54 fix: 双Claw能力对齐 + MCP/LLM代理绕过（P0止血） 
- 新增 app/core/capability_discovery.py：统一能力发现层，Web/IM 双Claw共用单一实现
  （三级降级：用户安装 → 平台published → 相关性裁剪；MCP 自动挂载已启用服务）
- im_llm.py：IM Bot Claw 改用统一发现层，恢复 skills(12) + MCP(26工具) 能力，
  修复 #866 部署回退导致的 agents=[]/mcp=[] 回归；mcp__ 前缀分流到 call_mcp_tool
- mcp_client.py：注入 httpx_client_factory(trust_env=False) 绕过容器 HTTP_PROXY，
  修复外部 MCP(xiaobenyang.com / anysearch.com) tools/list 全部静默失败（mcp_tools 0→26）
- llm_client.py / im_bot_user.py：2026-07-31 代理劫持内部请求 + 媒体断连修复（随镜像已上线）
 2026-08-04 10:21:19 +08:00
QihuAI Design 9a43ee244d fix(im_llm): 代理绕过Docker内部hostname 2026-07-31 08:51:15 +08:00
QihuAI Design 96aabc31f6 feat: mumuainovel app service infrastructure (db+compose+nginx) 2026-07-28 11:41:40 +08:00
QihuAI Design a9d8642db5 phase2-risk-loop-mempalace
CI / gate (push) Has been cancelled
Details
2026-07-28 09:18:16 +08:00
QihuAI Design 88b9a232ce fix-frontend-3-items-complete
CI / gate (push) Has been cancelled
Details
2026-07-28 06:31:48 +08:00
QihuAI Design 1633d5c33e phase1-agent-canvas-done
CI / gate (push) Has been cancelled
Details
2026-07-27 23:20:22 +08:00
QihuAI Design 96be3fdeb3 phase1-final
CI / gate (push) Has been cancelled
Details
2026-07-27 22:27:56 +08:00
QihuAI Design 52f1770515 phase1-complete-billing-skillruntime 2026-07-27 18:16:28 +08:00
QihuAI Design 89ce7d80dc phase1-billing-skillruntime 2026-07-27 18:14:57 +08:00
QihuAI Design 65440d91ee phase1-billing-meilisearch 2026-07-27 17:05:21 +08:00
QihuAI Design 1e0bd6f7a2 phase1-skillmd-v2-schema 2026-07-27 16:55:48 +08:00
QihuAI Design a336ac283d phase0-litellm-deployed-via-hk-proxy 2026-07-27 15:54:28 +08:00
QihuAI Design cf8c955d45 phase0-containers-meilisearch-litellm
CI / gate (push) Has been cancelled
Details
2026-07-27 11:09:49 +08:00
QihuAI Design 245484a0c5 phase0-final-rls-rbac-complete
CI / gate (push) Has been cancelled
Details
2026-07-27 09:57:55 +08:00
QihuAI Design 2068421d41 phase0-fix-auth-order-db-migration 2026-07-27 09:54:03 +08:00
QihuAI Design 7b1941fdaf phase0-multi-tenant-rls-rbac 2026-07-27 09:44:06 +08:00
QihuAI Design f9c8bda6e0 docs-add-iteration-plan
CI / gate (push) Has been cancelled
Details
2026-07-27 09:26:16 +08:00
QihuAI Design ec7de645f4 docs-add-architecture-blueprint
CI / gate (push) Has been cancelled
Details
2026-07-27 09:10:11 +08:00
QihuAI Design efa63f9d25 fix-overflow-x-horizontal-scroll
CI / gate (push) Has been cancelled
Details
2026-07-27 08:54:39 +08:00
QihuAI Design c624d8f37c mimo-token-plan-adapter
CI / gate (push) Has been cancelled
Details
2026-07-26 21:47:48 +08:00
QihuAI Design bb32884ecb p2-mcp-schema-error-step-enhancements
CI / gate (push) Has been cancelled
Details
2026-07-26 20:59:52 +08:00
QihuAI Design df67a298be mcp-tool-naming-fix
CI / gate (push) Has been cancelled
Details
2026-07-26 15:37:17 +08:00
QihuAI Design e1e50e884e feat(chat): align AI tool-use with GPT-4.1/Anthropic standards -- Fix1: AGENT_GUIDE in system prompt (Persistence/Tool-calling/Planning), Fix2: install_app def improved, Fix3: max_tool_rounds 5->15
CI / gate (push) Has been cancelled
Details
2026-07-26 08:35:42 +08:00
QihuAI Design a2504bce34 fix(chat): resolve Auto-route failover event-loop freeze (#812) 
Root cause: ensure_structured_column() executed a synchronous blocking
engine.connect().execute(SELECT information_schema.columns ...) inside the
async request path (_build_chat_history / _maybe_compress_history), freezing
the uvicorn event loop and hanging all endpoints (~200s, recovered only by
docker restart).

Fix:
- chat_context.py: remove per-request ensure_structured_column() calls; run
  once idempotently at app startup (main.py lifespan). Use CURRENT_DATABASE()
  for PostgreSQL compatibility.
- main.py: add startup-only ensure_structured_column() hook (try/except).
- llm_client.py: trust_env=False + bounded httpx.Timeout/wait_for so broken
  endpoints fail fast instead of hanging the event loop.
- chat_service.py: run media generation in a background daemon thread with its
  own event loop (_launch_media_task_bg) so SSE end does not cancel image/video
  tasks (#811); remove TEMP faulthandler diagnostic.

Safe-align: persist accumulated live container changes (admin/*, knowledge,
market, models, config, observability, mcp_client, platform_knowledge,
im_bot_platform, chat_media, capability_registry, requirements) and add
workflow_templates.

Verified: live failover test (model-006 -> conn-refused) returns in ~1.9s with
concurrent login 0.83s/200; event-loop responsiveness restored (sub-second).
 2026-07-26 00:35:35 +08:00
QihuAI Design 394a7786e0 chore: remove MySQL service from docker-compose (PostgreSQL migration complete)\n\n- Drop dead mysql service, mysql_data volume, and aiflow depends_on: mysql\n- Remove unused MYSQL_* env vars from aiflow service\n- Retain DATABASE_URL/POSTGRES_* pointing at qihu-aiflow-pg18\n- Closes the MySQL teardown started in task #802
CI / gate (push) Has been cancelled
Details
2026-07-25 20:59:44 +08:00
dev 019e1151d0 fix(mcp_admin): add module-level import asyncio to fix 500 in test_mcp_connection (#766 root cause)
CI / gate (push) Has been cancelled
Details
2026-07-25 14:03:36 +08:00
QihuAI Design 640edc4970 chore: normalize tsconfig.json line endings (file missed by prior commit)
CI / gate (push) Has been cancelled
Details 
The earlier renormalize commit (771c845) missed frontend/tsconfig.json; this
completes the LF normalization so all tracked text files are LF. .gitattributes
(* text=auto eol=lf) prevents future CRLF.
 2026-07-25 12:33:53 +08:00
QihuAI Design 771c8456b8 chore: normalize line endings to LF via .gitattributes 
Root-cause fix for mixed CRLF/LF in the repo (no .gitattributes previously).
Adds '* text=auto eol=lf' and explicit binary rules so all future checkouts
are LF. Renormalizes all tracked text files (no logical content change).
Backup tags: image qihuaiflow:backup-lineend-20260725-121632, git backup-lineend-pre-20260725-121632.
 2026-07-25 12:16:39 +08:00
QihuAI Design 2a7bb875f9 fix(mcp/chat): root-cause fixes for AnySearch MCP test + URL app install 
- mcp_admin.py: replace get_event_loop().run_until_complete() with asyncio.run() in _test_mcp_server worker-thread path (RuntimeError: no current event loop in thread). Fixes backend AnySearch 'test failed'.
- chat_skill.py: add synchronous _execute_install_app() that auto-detects skill/mcp/agent from a URL and creates MarketApp(+MCPServer is_enabled=True for mcp) + AppInstallation. No running-loop asyncio call (called sync from chat dispatch).
- chat_service.py: register 'install_app' function_definition and dispatch branch so the AI chat can install skills/mcp/agent by URL.
Image already persisted via docker export/import (qihuaiflow:with-deps=aaf6fe67cde8) because base image was pruned and docker commit failed.
 2026-07-25 11:51:19 +08:00
QihuAI Design 256d9f33e6 chore(align): sync Git with running container as authoritative source 
Phase 0 SSE 流式聊天 landed in the running container and captured in Git so
the three sources (container := image := Git) agree.

Phase 0 — SSE 流式聊天（Web 端，IM bot 路径保持不变、共用引擎）:
- app/api/chat.py: 新增独立 SSE 端点
  POST /app/api/chat/conversations/{conv_id}/messages/stream
  基于 asyncio.Queue + create_task 将 _send_message_core 桥接为
  text/event-stream 生成器，吐出 delta / reasoning / done / error 事件
- app/api/chat_service.py: _send_message_core 增加 stream + on_event 参数；
  普通（无工具）聊天 round-0 主调用走 achat_complete(stream=True) 流式；
  done 事件携带 message_id / content / process_steps / used_skills /
  used_mcp / generating
- app/core/llm_client.py: 修复 _create_kwargs 硬编码 stream=False 的根因 bug
  （流式调用传 stream=True 导致 TypeError: multiple values for keyword），
  现 _create_kwargs(request_body, stream=True) 字段随参数变化
- frontend/src/pages/front/ChatPage.tsx + ChatPage.css + types/index.ts:
  发消息改为 fetch SSE 消费，实时增量渲染 AI 回复文本与思考链(reasoning)，
  done 事件用 message_id 定稿并渲染过程步骤；网络/流式失败自动回退非流式

Alignment performed 2026-07-24 18:25:11. No deletions; secrets/venv/node_modules/
caches were not touched (tracked-source-only copy).
 2026-07-24 18:25:15 +08:00