Yansong Zhang
b804c7ed47
fix: restore SandboxExpiredRecordsCleanConfig, remove debug logs
...
- Restore SandboxExpiredRecordsCleanConfig (billing/ops config that
was mistakenly removed with sandbox execution code)
- Remove [DEBUG-AGENT] logging from app_generate_service.py
Made-with: Cursor
2026-04-13 14:39:48 +08:00
Yansong Zhang
90cce7693f
revert: remove all sandbox and skill related code
...
Remove ~12,900 lines of sandbox/skill code that was ported from
feat/support-agent-sandbox. This reverts to direct tool execution
(the original behavior before sandbox integration).
Removed:
- core/sandbox/ (SandboxBuilder, bash tools, providers, initializers)
- core/skill/ (SkillManager, assembler, entities)
- core/virtual_environment/ (5 provider implementations)
- core/zip_sandbox/ (archive operations)
- core/app_assets/ (asset management)
- core/app_bundle/ (bundle management)
- controllers/cli_api/ (DifyCli callback endpoints)
- services/sandbox/ (provider service)
- services/skill_service, app_asset_service, app_bundle_service
- models/sandbox.py, app_asset.py
- bin/dify-cli-* (3 platform binaries)
- web sandbox-provider-page and service
- SandboxLayer, _resolve_sandbox_context, _invoke_tool_in_sandbox
- CliApiConfig, DIFY_SANDBOX_CONTEXT_KEY
- sandbox-related migrations
Preserved: All Agent V2 core functionality (agent-v2 node, strategy
engine, transparent upgrade, LLM remapping, memory, context, tools
via direct execution).
Made-with: Cursor
2026-04-13 10:42:36 +08:00
Yansong Zhang
10bb276e97
fix(api): complete Docker sandbox tool execution pipeline
...
- Add linux/arm64 dify-cli binary for Docker containers
- Add DIFY_PORT config field for Docker socat forwarding
- Fix InvokeFrom.AGENT (doesn't exist) → InvokeFrom.DEBUGGER
in CLI API fetch/tools/batch endpoint
Full pipeline verified: Docker container → dify init → dify execute
→ CLI API callback → plugin invocation → result returned to stdout.
Made-with: Cursor
2026-04-10 11:06:54 +08:00
Yansong Zhang
73fd439541
fix(api): resolve sandbox deadlock under gevent and refine integration
...
- Skip Local sandbox provider under gevent worker (subprocess pipes
cause cooperative threading deadlock with Celery's gevent pool).
- Add non-blocking sandbox readiness check before tool execution.
- Add gevent timeout wrapper for sandbox bash session.
- Fix CLI binary resolution: add SANDBOX_DIFY_CLI_ROOT config field.
- Fix ExecutionContext.node_id propagation.
- Fix SkillInitializer to gracefully handle missing skill bundles.
- Update _invoke_tool_in_sandbox to use correct `dify execute` CLI
subcommand format (not `invoke-tool`).
The full sandbox-in-agent pipeline works end-to-end for network-based
providers (Docker, E2B, SSH). Local provider is skipped under gevent
but works in non-gevent contexts.
Made-with: Cursor
2026-04-10 10:51:40 +08:00
Yansong Zhang
66212e3575
feat(api): implement zero-migration transparent upgrade (Phase 8)
...
Add two feature-flag-controlled upgrade paths that allow existing apps
and LLM nodes to transparently run through the Agent V2 engine without
any database migration:
1. AGENT_V2_TRANSPARENT_UPGRADE (default: off):
When enabled, old apps (chat/completion/agent-chat) bypass legacy
Easy-UI runners. VirtualWorkflowSynthesizer converts AppModelConfig
to an in-memory Workflow (start -> agent-v2 -> answer) at runtime,
then executes via AdvancedChatAppGenerator. Falls back to legacy
path on any synthesis error.
VirtualWorkflowSynthesizer maps:
- model JSON -> ModelConfig
- pre_prompt/chat_prompt_config -> prompt_template
- agent_mode.tools -> ToolMetadata[]
- agent_mode.strategy -> agent_strategy
- dataset_configs -> context
- file_upload -> vision
2. AGENT_V2_REPLACES_LLM (default: off):
When enabled, DifyNodeFactory.create_node() transparently remaps
nodes with type="llm" to type="agent-v2" before class resolution.
Since AgentV2NodeData is a strict superset of LLMNodeData, the
mapping is lossless. With tools=[], Agent V2 behaves identically
to LLM Node.
Both flags default to False for safety. Turn off = instant rollback.
46 existing tests pass. Flask starts successfully.
Made-with: Cursor
2026-04-09 10:30:52 +08:00
Yansong Zhang
0c7e7e0c4e
feat(api): port Sandbox + VirtualEnvironment + Skill system from feat/support-agent-sandbox (Phase 5-6)
...
Port the complete infrastructure for agent sandbox execution and skill system:
Sandbox & Virtual Environment (core/sandbox/, core/virtual_environment/):
- Sandbox entity with lifecycle management (ready/failed/cancelled states)
- SandboxBuilder with fluent API for configuring providers
- 5 VM providers: Local, SSH, Docker, E2B, AWS CodeInterpreter
- VirtualEnvironment base with command execution, file transfer, transport layers
- Channel transport: pipe, queue, socket implementations
- Bash session management and DifyCli binary integration
- Storage: archive storage, file storage, noop storage, presign storage
- Initializers: DifyCli, AppAssets, DraftAppAssets, Skills
- Inspector: file browser, archive/runtime source, script utils
- Security: encryption utils, debug helpers
Skill & App Assets (core/skill/, core/app_assets/, core/app_bundle/):
- Skill entity and manager
- App asset accessor, builder pipeline (file, skill builders)
- App bundle source zip extractor
- Storage and converter utilities
API Endpoints:
- CLI API blueprint (controllers/cli_api/) for sandbox callback
- Sandbox provider management (workspace/sandbox_providers)
- Sandbox file browser (console/sandbox_files)
- App asset management (console/app/app_asset)
- Skill management (console/app/skills)
- Storage file endpoints (controllers/files/storage_files)
Services:
- Sandbox service, provider service, file service
- App asset service, app bundle service
Config:
- CliApiConfig, CreatorsPlatformConfig, CollaborationConfig
- FILES_API_URL for sandbox file access
Note: Controller route registration temporarily commented out (marked TODO)
pending resolution of deep dependency chains (socketio, workflow_comment,
command node, etc.). Core sandbox modules are fully ported and syntax-validated.
110 files changed, 10,549 insertions.
Made-with: Cursor
2026-04-08 17:39:02 +08:00
c0ffb6db2a
feat: support config max size of plugin generated files ( #30887 )
...
Co-authored-by: Copilot <[email protected]
2026-02-13 09:48:27 +08:00
32350f7a04
feat(api): add scheduled cleanup task for specific workflow logs ( #31843 )
...
Co-authored-by: 章润喆 <[email protected] [email protected] [email protected] [email protected] [email protected]
2026-02-11 20:54:36 +08:00
7e0bccbbf0
fix: update index to optimize message clean performance ( #32238 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2026-02-11 16:07:52 +08:00
a1fc280102
feat: Human Input Node ( #32060 )
...
The frontend and backend implementation for the human input node.
Co-authored-by: twwu <[email protected] [email protected] [email protected] [email protected]
2026-02-09 14:57:23 +08:00
2c9430313d
fix: redis for api token ( #31861 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: hj24 <[email protected]
2026-02-06 16:25:27 +08:00
90fe9abab7
revert: revert human input relevant code ( #31766 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2026-01-30 19:18:49 +08:00
QuantumGhost and GitHub
f90fa2b186
fix(api): fix workflow state persistence issue ( #31752 )
...
Ensure workflow pause configuration is correctly set for all entrypoints.
2026-01-30 17:44:29 +08:00
03e3acfc71
feat(api): Human Input Node (backend part) ( #31646 )
...
The backend part of the human in the loop (HITL) feature and relevant architecture / workflow engine changes.
Signed-off-by: yihong0618 <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2026-01-30 10:18:49 +08:00
-LAN- and GitHub
2626e773d9
chore: Set plugin schema cache TTL to 1h ( #31708 )
2026-01-29 16:41:09 +08:00
ceb6914793
refactor(model): Refactor plugin model schema cache to be process-global to prevent redundant Daemon API calls ( #31689 )
...
Signed-off-by: -LAN- <[email protected] [email protected]
2026-01-29 14:31:15 +08:00
515002a8ba
feat: app trial ( #26281 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: hj24 <[email protected]
2026-01-22 15:42:54 +08:00
e80d76af15
feat: add lock for retention jobs ( #31320 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2026-01-21 14:06:35 +08:00
wangxiaolei and GitHub
0ec2b12e65
feat: allow pass hostname in docker env ( #30975 )
2026-01-14 19:30:37 +08:00
51ea87ab85
feat: clear free plan workflow run logs ( #29494 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Copilot <[email protected] [email protected]
2026-01-12 15:57:40 +08:00
fe0802262c
feat: credit pool ( #30720 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-08 13:17:30 +08:00
Byron.wang and GitHub
5362f69083
feat(refactoring): Support Structured Logging (JSON) ( #30170 )
2026-01-04 11:46:46 +08:00
eb5a444d3d
fix: plugin execution timeout not respecting PLUGIN_MAX_EXECUTION_TIMEOUT ( #29785 )
...
Co-authored-by: crazywoola <[email protected]
2025-12-18 15:11:01 +08:00
hj24 and GitHub
46c9a59a31
feat: sandbox retention basic settings ( #29842 )
2025-12-18 14:16:23 +08:00
crazywoola and GitHub
a915b8a584
revert: "security/fix-swagger-info-leak-m02" ( #29721 )
2025-12-16 14:19:33 +08:00
724cd57dbf
fix: dos in annotation import ( #29470 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-12-15 15:22:04 +08:00
355a2356d4
security/fix-swagger-info-leak-m02 ( #29283 )
...
Co-authored-by: crazywoola <[email protected]
2025-12-15 11:24:06 +08:00
9affc546c6
Feat/support multimodal embedding ( #29115 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-12-09 14:41:46 +08:00
wangxiaolei and GitHub
f48522e923
feat: add x-trace-id to http responses and logs ( #29015 )
...
Introduce trace id to http responses and logs to facilitate debugging process.
2025-12-02 17:22:34 +08:00
jiangbo721 and GitHub
2551f6f279
feat: add APP_DEFAULT_ACTIVE_REQUESTS as the default value for APP_AC… ( #26930 )
2025-11-27 10:51:48 +08:00
a1b735a4c0
feat: trigger billing ( #28335 )
...
Signed-off-by: lyzno1 <[email protected] [email protected] [email protected]
2025-11-20 10:15:23 +08:00
-LAN- and GitHub
fe6538b08d
chore: disable workflow logs auto-cleanup by default ( #28136 )
...
This PR changes the default value of `WORKFLOW_LOG_CLEANUP_ENABLED` from `true` to `false` across all configuration files.
## Motivation
Setting the default to `false` provides safer default behavior by:
- Preventing unintended data loss for new installations
- Giving users explicit control over when to enable log cleanup
- Following the opt-in principle for data deletion features
Users who need automatic cleanup can enable it by setting `WORKFLOW_LOG_CLEANUP_ENABLED=true` in their configuration.
2025-11-12 22:55:02 +08:00
+4
b76e17b25d
feat: introduce trigger functionality ( #27644 )
...
Signed-off-by: lyzno1 <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-11-12 17:59:37 +08:00
37903722fe
refactor: implement tenant self queue for rag tasks ( #27559 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: -LAN- <[email protected]
2025-11-06 21:25:50 +08:00
Novice and GitHub
ef1db35f80
feat: implement file extension blacklist for upload security ( #27540 )
2025-11-04 15:45:22 +08:00
Ponder and GitHub
b610cf9a11
feat: add segments max number limit for SegmentApi.post ( #27745 )
2025-11-04 10:27:58 +08:00
Eric Guo and GitHub
ff32dff163
Enabled cross-subdomain console sessions by making the cookie domain configurable and aligning the frontend so it reads the shared CSRF cookie. ( #27190 )
2025-10-28 10:04:24 +08:00
hj24 and GitHub
2382229c7d
fix variable-truncator max size comments ( #27129 )
2025-10-20 14:52:40 +09:00
Eric Guo and GitHub
59ad6e02ce
Add timeout so any plugin daemon call (including the SSE path) that legitimately takes longer than 5s would right. ( #26852 )
2025-10-14 09:23:27 +08:00
Nan LI and GitHub
885dff82e3
feat: update HTTP timeout configurations and enhance timeout input handling in UI ( #26685 )
2025-10-10 09:00:06 +08:00
4a475bf1cd
chore: Raise default string length limits ( #26592 )
...
Signed-off-by: -LAN- <[email protected] [email protected]
2025-10-06 10:40:13 +08:00
915023b809
Chore/remove add node restrict of workflow ( #26218 )
...
Co-authored-by: -LAN- <[email protected]
2025-09-25 18:02:43 +08:00
Blackoutta and GitHub
e937c8c72e
improve: pooling httpx clients for requests to code sandbox and ssrf ( #26052 )
2025-09-24 22:14:50 +08:00
4f45978cd9
fix: remote code execution in email endpoints ( #25753 )
...
Co-authored-by: crazywoola <[email protected]
2025-09-18 16:45:34 +08:00
+10
85cda47c70
feat: knowledge pipeline ( #25360 )
...
Signed-off-by: -LAN- <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-09-18 12:49:10 +08:00
bab4975809
chore: add ast-grep rule to convert Optional[T] to T | None ( #25560 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-15 13:06:33 +08:00
c2fcd2895b
Feat/email register refactor ( #25369 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: crazywoola <[email protected] [email protected]
2025-09-12 10:24:54 +08:00
zyssyz123 and GitHub
ea61420441
Revert "feat: email register refactor" ( #25367 )
2025-09-08 19:20:09 +08:00
kenwoodjw and GitHub
598ec07c91
feat: enable dsl export encrypt dataset id or not ( #25102 )
...
Signed-off-by: kenwoodjw <[email protected]
2025-09-08 18:03:24 +08:00
860ee20c71
feat: email register refactor ( #25344 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: crazywoola <[email protected]
2025-09-08 17:51:43 +08:00
Yansong Zhang