cetdev/dify
0
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
6,014 Commits 643 Branches 176 Tags
8a86a2c81727e3c499fbbd5d6287c8e20c19abab
Commit Graph
777 Commits
Author SHA1 Message Date
QuantumGhostGitHub-LAN-
 		349c3cf7b8 feat(api): Add image multimodal support for LLMNode (#17372) 
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <[email protected]>
Co-authored-by: -LAN- <[email protected]>
 2025-04-30 17:28:02 +08:00
Bowen LiangandGitHub 12c96b93d9 immediately return initialed tiktokenizer instance and remove dead code in usage of tiktokenizer (#17957) 2025-04-30 16:07:20 +08:00
YeuolyandGitHub abafa68647 refactor: rename plugin manager to plugin client and rename path from manager to impl (#18876) 2025-04-27 14:22:25 +08:00
非法操作andGitHub c1559a7c8e fix: LLMResultChunk cause concatenate str and list exception (#18852) 2025-04-27 11:32:14 +08:00
VitorandGitHub defd5520ea fix: invalid new tool call creation logic during response handling in OAI-Compat model (#17781) 2025-04-17 16:52:49 +08:00
-LAN-andGitHub 8e6f6d64a4 feat: re-add prompt messages to result and chunks in llm (#17883) 
Signed-off-by: -LAN- <[email protected]>
 2025-04-11 17:04:49 +08:00
-LAN-GitHubYeuoly
 		d3157b46ee feat(large_language_model): Adds plugin-based token counting configuration option (#17706) 
Signed-off-by: -LAN- <[email protected]>
Co-authored-by: Yeuoly <[email protected]>
 2025-04-09 20:52:58 +08:00
非法操作andGitHub 44f911a0a8 chore: docstring not match the function parameter (#17162) 2025-03-31 13:19:15 +08:00
非法操作andGitHub 8047d08b3b chore: remove third party models (#13885) 2025-03-27 10:22:32 +08:00
jiangbo721GitHub刘江波
 		037f200527 fix: invoke_error is not callable (#15555) 
Co-authored-by: 刘江波 <[email protected]>
 2025-03-12 10:58:44 +08:00
YeuolyandGitHub 4668c4996a feat: Add caching mechanism for plugin model schemas (#14898) 2025-03-04 18:02:06 +08:00
Yingchun LaiandGitHub 7259c0d69f fix: fix a typo of get_customizable_model_schema method name (#14449) 2025-03-01 22:56:13 +08:00
YeuolyandGitHub 490b6d092e Fix/plugin race condition (#14253) 2025-02-25 12:20:47 +08:00
jiangbo721GitHub刘江波
 		f535a2aa71 chore: prompt_message is actually assistant_message which is a bit am… (#13839) 
Co-authored-by: 刘江波 <[email protected]>
 2025-02-19 09:14:10 +08:00
+110
YeuolyGitHubtakatostkurokoboNovice LeezxhlyhAkaraChenYiJoelJzoNgtwwuHiroshi FujitaAkaraChenNFishWu Tianwei非法操作NoviceHiroki NagaiGen Satoeuxhuangzhuo1949huangzhuolotsikcrazywoolanite-kniteJyonggithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>gakkiyomiCN-P5CN-P5ChuehnoneyihongKevin9703-LAN-Boris FeldmbomaboWarren ChenJzoNgKVOjiandanfengzhu-anzhaoqingyu.1075海狸大師Xu Songrayshaw001Ding JiatongBowen LiangJasonVVle0zhzhuxinliangk-zakuluckylhb90hobo.ljiangbo721刘江波Shun MiyazawaEricPancrazywoolasinoJhvcclowellBoris PolonskyAdemílson TonatoAdemílson TonatoIWAI, Masaharu <[email protected]>Yueh-Po PengJasonXin Zhangyjc980121heysztAbdullah AlOsaimiAbdullah AlOsaimiYingchun LaiHash BrownzuodongxuMasashi TomookaaplioObada KhaliliNam VuKei YAMAZAKITechnoHouseRiddhimaan-SenapatiMaFee921te-chanHQideaJoshblyxheweiwenyan-devex_wenyan.weiengchinaengchinadependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>呆萌闷油瓶KemalLazy_FrogYi XiaoSteven sunstevenKalo ChinKaty Taodepy胡春东Junjie.MMuYuNaoki TakashimaSummer-GuFei Heybalbert001Yuanbo LidouxcliuzhenghuaWu JiayangYour NamekimjionAugNSollinvokerlliusurong.lsrVasu NegiHundredwzXiyuan Chen
 		403e2d58b9 Introduce Plugins (#13836) 
Signed-off-by: yihong0618 <[email protected]>
Signed-off-by: -LAN- <[email protected]>
Signed-off-by: xhe <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: takatost <[email protected]>
Co-authored-by: kurokobo <[email protected]>
Co-authored-by: Novice Lee <[email protected]>
Co-authored-by: zxhlyh <[email protected]>
Co-authored-by: AkaraChen <[email protected]>
Co-authored-by: Yi <[email protected]>
Co-authored-by: Joel <[email protected]>
Co-authored-by: JzoNg <[email protected]>
Co-authored-by: twwu <[email protected]>
Co-authored-by: Hiroshi Fujita <[email protected]>
Co-authored-by: AkaraChen <[email protected]>
Co-authored-by: NFish <[email protected]>
Co-authored-by: Wu Tianwei <[email protected]>
Co-authored-by: 非法操作 <[email protected]>
Co-authored-by: Novice <[email protected]>
Co-authored-by: Hiroki Nagai <[email protected]>
Co-authored-by: Gen Sato <[email protected]>
Co-authored-by: eux <[email protected]>
Co-authored-by: huangzhuo1949 <[email protected]>
Co-authored-by: huangzhuo <[email protected]>
Co-authored-by: lotsik <[email protected]>
Co-authored-by: crazywoola <[email protected]>
Co-authored-by: nite-knite <[email protected]>
Co-authored-by: Jyong <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: gakkiyomi <[email protected]>
Co-authored-by: CN-P5 <[email protected]>
Co-authored-by: CN-P5 <[email protected]>
Co-authored-by: Chuehnone <[email protected]>
Co-authored-by: yihong <[email protected]>
Co-authored-by: Kevin9703 <[email protected]>
Co-authored-by: -LAN- <[email protected]>
Co-authored-by: Boris Feld <[email protected]>
Co-authored-by: mbo <[email protected]>
Co-authored-by: mabo <[email protected]>
Co-authored-by: Warren Chen <[email protected]>
Co-authored-by: JzoNgKVO <[email protected]>
Co-authored-by: jiandanfeng <[email protected]>
Co-authored-by: zhu-an <[email protected]>
Co-authored-by: zhaoqingyu.1075 <[email protected]>
Co-authored-by: 海狸大師 <[email protected]>
Co-authored-by: Xu Song <[email protected]>
Co-authored-by: rayshaw001 <[email protected]>
Co-authored-by: Ding Jiatong <[email protected]>
Co-authored-by: Bowen Liang <[email protected]>
Co-authored-by: JasonVV <[email protected]>
Co-authored-by: le0zh <[email protected]>
Co-authored-by: zhuxinliang <[email protected]>
Co-authored-by: k-zaku <[email protected]>
Co-authored-by: luckylhb90 <[email protected]>
Co-authored-by: hobo.l <[email protected]>
Co-authored-by: jiangbo721 <[email protected]>
Co-authored-by: 刘江波 <[email protected]>
Co-authored-by: Shun Miyazawa <[email protected]>
Co-authored-by: EricPan <[email protected]>
Co-authored-by: crazywoola <[email protected]>
Co-authored-by: sino <[email protected]>
Co-authored-by: Jhvcc <[email protected]>
Co-authored-by: lowell <[email protected]>
Co-authored-by: Boris Polonsky <[email protected]>
Co-authored-by: Ademílson Tonato <[email protected]>
Co-authored-by: Ademílson Tonato <[email protected]>
Co-authored-by: IWAI, Masaharu <[email protected]>
Co-authored-by: Yueh-Po Peng (Yabi) <[email protected]>
Co-authored-by: Jason <[email protected]>
Co-authored-by: Xin Zhang <[email protected]>
Co-authored-by: yjc980121 <[email protected]>
Co-authored-by: heyszt <[email protected]>
Co-authored-by: Abdullah AlOsaimi <[email protected]>
Co-authored-by: Abdullah AlOsaimi <[email protected]>
Co-authored-by: Yingchun Lai <[email protected]>
Co-authored-by: Hash Brown <[email protected]>
Co-authored-by: zuodongxu <[email protected]>
Co-authored-by: Masashi Tomooka <[email protected]>
Co-authored-by: aplio <[email protected]>
Co-authored-by: Obada Khalili <[email protected]>
Co-authored-by: Nam Vu <[email protected]>
Co-authored-by: Kei YAMAZAKI <[email protected]>
Co-authored-by: TechnoHouse <[email protected]>
Co-authored-by: Riddhimaan-Senapati <[email protected]>
Co-authored-by: MaFee921 <[email protected]>
Co-authored-by: te-chan <[email protected]>
Co-authored-by: HQidea <[email protected]>
Co-authored-by: Joshbly <[email protected]>
Co-authored-by: xhe <[email protected]>
Co-authored-by: weiwenyan-dev <[email protected]>
Co-authored-by: ex_wenyan.wei <[email protected]>
Co-authored-by: engchina <[email protected]>
Co-authored-by: engchina <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: 呆萌闷油瓶 <[email protected]>
Co-authored-by: Kemal <[email protected]>
Co-authored-by: Lazy_Frog <[email protected]>
Co-authored-by: Yi Xiao <[email protected]>
Co-authored-by: Steven sun <[email protected]>
Co-authored-by: steven <[email protected]>
Co-authored-by: Kalo Chin <[email protected]>
Co-authored-by: Katy Tao <[email protected]>
Co-authored-by: depy <[email protected]>
Co-authored-by: 胡春东 <[email protected]>
Co-authored-by: Junjie.M <[email protected]>
Co-authored-by: MuYu <[email protected]>
Co-authored-by: Naoki Takashima <[email protected]>
Co-authored-by: Summer-Gu <[email protected]>
Co-authored-by: Fei He <[email protected]>
Co-authored-by: ybalbert001 <[email protected]>
Co-authored-by: Yuanbo Li <[email protected]>
Co-authored-by: douxc <[email protected]>
Co-authored-by: liuzhenghua <[email protected]>
Co-authored-by: Wu Jiayang <[email protected]>
Co-authored-by: Your Name <[email protected]>
Co-authored-by: kimjion <[email protected]>
Co-authored-by: AugNSo <[email protected]>
Co-authored-by: llinvokerl <[email protected]>
Co-authored-by: liusurong.lsr <[email protected]>
Co-authored-by: Vasu Negi <[email protected]>
Co-authored-by: Hundredwz <[email protected]>
Co-authored-by: Xiyuan Chen <[email protected]>
 2025-02-17 17:05:13 +08:00
Yingchun LaiandGitHub a3d3e30e3a fix: fix tongyi models blocking mode with incremental_output=stream (#13620) 2025-02-13 10:24:05 +08:00
yihongandGitHub 1f38d4846b fix: issue #13483 and #13434 (#13518) 
Signed-off-by: yihong0618 <[email protected]>
 2025-02-11 12:45:49 +08:00
ybalbert001GitHubYuanbo Li
 		c8357da13b [Fix] Sagemaker LLM Provider can't adjust context size, it'a always 2… (#13462) 
Co-authored-by: Yuanbo Li <[email protected]>
 2025-02-10 12:25:04 +08:00
Fei HeandGitHub 7796984444 Fix: Removed model params except max_token for deepseek r1 in volcengine (#13446) 2025-02-10 10:26:26 +08:00
Fei HeandGitHub 75113c26c6 Feat : add deepseek support for tongyi (#13445) 2025-02-10 10:26:03 +08:00
xheandGitHub 939a9ecd21 chore: use the wrap thinking api for volcengine (#13432) 
Signed-off-by: xhe <[email protected]>
 2025-02-10 10:25:07 +08:00
Riddhimaan-SenapatiandGitHub 811d72a727 feat: added a _position.yaml for vertex ai provider (#13367) 2025-02-09 10:29:07 +08:00
Naoki TakashimaandGitHub 37117c22d4 feat(model): support Gemini 2.0 Flash Lite Preview model (02-05) in Google's model provider (#13399) 2025-02-09 10:22:33 +08:00
Junjie.MGitHubcrazywoola
 		286cdc41ab reasoning model unified think tag is <think></think> (#13392) 
Co-authored-by: crazywoola <[email protected]>
 2025-02-08 16:19:41 +08:00
Kalo ChinandGitHub c8dcde6cd0 fix: Gemini 2.0 Flash 001 model yaml file naming (#13372) 2025-02-08 09:12:42 +08:00
Riddhimaan-SenapatiandGitHub 8f9db61688 feat: added new silicon flow models (#13369) 2025-02-08 09:12:22 +08:00
Steven sunGitHubsteven
 		38c31e64db add enable_search parameter to qwen_max, plus, turbo (#13335) 
Co-authored-by: steven <[email protected]>
 2025-02-07 22:16:26 +08:00
-LAN-andGitHub 413dfd5628 feat: add completion mode and context size options for LLM configuration (#13325) 
Signed-off-by: -LAN- <[email protected]>
 2025-02-07 15:08:53 +08:00
呆萌闷油瓶andGitHub 3f42fabff8 chore:improve thinking display for llm from xinference and ollama pro… (#13318) 2025-02-07 14:29:29 +08:00
-LAN-andGitHub 1caa578771 chore(*): Update style of thinking (#13319) 
Signed-off-by: -LAN- <[email protected]>
 2025-02-07 14:06:35 +08:00
非法操作andGitHub 3eb3db0663 chore: refactor the OpenAICompatible and improve thinking display (#13299) 2025-02-07 13:28:46 +08:00
sinoandGitHub 6e5c915f96 feat(model): add deepseek-r1 for openrouter (#13312) 2025-02-07 12:39:13 +08:00
Riddhimaan-SenapatiandGitHub 2348abe4bf feat: added a couple of models not defined in vertex ai, that were already … (#13296) 2025-02-07 09:11:25 +08:00
呆萌闷油瓶andGitHub f7e7a399d9 feat:add think tag display for xinference deepseek r1 (#13291) 2025-02-06 22:04:58 +08:00
zhu-anGitHubzhaoqingyu.1075
 		16865d43a8 feat: add deepseek models for volcengine provider (#13283) 
Co-authored-by: zhaoqingyu.1075 <[email protected]>
 2025-02-06 18:20:03 +08:00
呆萌闷油瓶andGitHub 0d13aee15c feat:add deepseek r1 think display for ollama provider (#13272) 2025-02-06 15:32:10 +08:00
engchinaGitHubengchina
 		40dd63ecef Upgrade oracle models (#13174) 
Co-authored-by: engchina <[email protected]>
 2025-02-06 13:24:27 +08:00
-LAN-andGitHub 6d66d6da15 feat(model_providers): Support deepseek-r1 for Nvidia Catalog (#13269) 
Signed-off-by: -LAN- <[email protected]>
 2025-02-06 13:03:19 +08:00
-LAN-andGitHub 87763fc234 feat(model_providers): Support deepseek for Azure AI Foundry (#13267) 
Signed-off-by: -LAN- <[email protected]>
 2025-02-06 12:45:48 +08:00
JasonVVandGitHub f6c44cae2e feat(model): add gemini-2.0 model (#13266) 2025-02-06 12:28:59 +08:00
xheandGitHub da2ee04fce fix: correct linewrap think display in generic openai api (#13260) 
Signed-off-by: xhe <[email protected]>
 2025-02-06 10:53:08 +08:00
JasonVVandGitHub 7673c36af3 feat(model): add gemini-2.0-flash-thinking-exp-01-21 (#13230) 2025-02-06 10:01:00 +08:00
Riddhimaan-SenapatiandGitHub 9457b2af2f feat: added models :gemini 2.0 flash 001 and gemini 2.0 pro exp 02-05 (#13247) 2025-02-06 09:58:39 +08:00
k-zakuandGitHub 7203991032 feat: add parameter "reasoning_effort" and Openai o3-mini (#13243) 2025-02-06 09:29:48 +08:00
xheandGitHub 5a685f7156 feat: add think display for volcengine and generic openapi (#13234) 
Signed-off-by: xhe <[email protected]>
 2025-02-06 09:24:40 +08:00
Riddhimaan-SenapatiandGitHub a6a25030ad fix: updated _position.yaml to include the latest model already integ… (#13245) 2025-02-06 09:21:51 +08:00
Riddhimaan-SenapatiandGitHub 00458a31d5 feat: added deepseek r1 and v3 to siliconflow (#13238) 2025-02-05 21:59:18 +08:00
-LAN-andGitHub c6ddf6d6cc feat(model_providers): Add Groq DeepSeek-R1-Distill-Llama-70b (#13229) 
Signed-off-by: -LAN- <[email protected]>
 2025-02-05 19:15:29 +08:00
JoshblyGitHubcrazywoola
 		34b21b3065 feat: Add o3-mini and o3-mini-2025-01-31 model variants (#13129) 
Co-authored-by: crazywoola <[email protected]>
 2025-02-05 17:04:45 +08:00
-LAN-andGitHub 59ca44f493 chore(model_runtime): Move deepseek ahead in the providers list. (#13197) 
Signed-off-by: -LAN- <[email protected]>
 2025-02-05 16:08:28 +08:00