47 Commits
Author SHA1 Message Date
ulleo 3fd6fa867d feat: implement LLM keyword extraction and fusion scoring for table matching
- Add extract_keywords() to LLMService with conversation context support,
  using process_stream + start_log/end_log for logging consistency
- Add expand_with_terminology() to expand keywords with synonym matching
- Add fusion scoring in calc_table_embedding(): α * vec_score + (1-α) * keyword_score
- Add calc_keyword_score() with multi-level matching:
  table name exact (1.0), comment exact (0.9), comment substring (0.7),
  table name partial (0.25-0.5), field comment exact (0.5),
  field comment substring (0.4), field name partial (0.3)
- Scoring considers keyword coverage rate to differentiate tables
  with different numbers of matched keywords
- Extracted keywords persisted to ChatRecord for reuse across endpoints
- get_terminology_template() supports comma-separated keyword input
  with per-keyword matching for higher precision
- Add TABLE_EMBEDDING_ALPHA and TABLE_EMBEDDING_KEYWORD_ENABLED config
2026-09-14 17:51:45 +08:00
ulleo 6518701913 fix: Prevent Authorization Bypass Through User-Controlled Key problem (CWE-639) 2026-08-28 18:22:35 +08:00
ulleo a2a7591d0f feat: switch search filters from OR to AND logic 2026-08-11 18:22:44 +08:00
Sebastion a520fda25e fix: prevent path traversal in terminology excel upload (CWE-22) 2026-07-27 14:37:54 +08:00
ulleo 9726db544d refactor: replace dicttoxml with stdlib implementation to avoid GPL license risk 2026-07-24 18:09:00 +08:00
ulleo 9656efad06 feat: support export with filter 2026-07-24 17:03:02 +08:00
ulleo 8e97a6b962 feat: support filter search in SQL sample and terminology list
#1281
2026-07-24 11:27:02 +08:00
ulleo d7261dabd6 feat: support configuring terminology for specified advanced applications 2026-07-10 17:22:42 +08:00
ulleo 4af99e0c45 feat: support configuring terminology for specified advanced applications 2026-06-16 17:23:50 +08:00
jackieya 4feb553c42 refactor: optimize decorator order and fix HTTPException imports per review 2026-03-16 10:37:37 +08:00
jackieya 2772cde16e security: fix RCE via terminology poisoning and restrict upload access 2026-03-16 10:37:37 +08:00
fit2cloud-chenyw d640ac31d1 perf: Optimize datasource-related API permission validation 2026-01-28 17:03:58 +08:00
ulleo 37afb2da21 feat: add more chat log operation steps 2026-01-28 11:10:41 +08:00
fit2cloud-chenyw e791eedd38 fix: API security weakness 2025-12-30 14:41:09 +08:00
wangjiahao 1df98cec0f refactor: Add logs to the system operation method 2025-12-26 17:14:34 +08:00
王嘉豪 5c88ff8054 refactor: Add logs to the system operation method (#692) 2025-12-26 11:49:25 +08:00
ulleo 69f3003758 feat: Add Api Docs 2025-12-15 16:30:07 +08:00
ulleo dcceb1e55d fix: handle empty terminology descriptions in chat 2025-12-01 11:45:35 +08:00
ulleo 06a869f624 feat: import Sample SQL / Terminologies 2025-11-28 18:40:55 +08:00
ulleo 8023ce2907 fix: improve error message when uploading Excel file with incorrect column count 2025-11-27 14:56:51 +08:00
王嘉豪 46f0ca3f36 feat:Terminology supports data source filtering. (#498) 2025-11-26 19:50:36 +08:00
ulleo f3ffb96351 feat: import Sample SQL / Terminologies 2025-11-19 18:18:31 +08:00
ulleo d53f3716b9 feat: import Sample SQL / Terminologies 2025-11-19 15:59:55 +08:00
ulleo e321abde0b feat: import Terminologies 2025-11-18 17:00:55 +08:00
ulleo 57ee918920 feat(X-Pack): add export Custom Prompt 2025-11-14 19:52:08 +08:00
ulleo bd5015c335 feat: add export terminologies 2025-11-13 19:37:42 +08:00
ulleo d27b96e83d feat: Terminology / SQL Sample Management add enabled control 2025-11-06 15:39:26 +08:00
ulleo c9bfebfa08 feat: Terminology / SQL Sample Management add enabled control 2025-11-06 15:11:24 +08:00
ulleo 451e843473 feat: Terminology / SQL Sample Management add enabled control 2025-11-06 14:55:59 +08:00
junjun f59bc962e3 refactor: Service initiation vectorization task 2025-10-10 10:03:57 +08:00
ulleo 61f06e35a0 fix: check exists terminology 2025-09-29 21:59:29 +08:00
ulleo d213de3eda fix: transaction error after run assistant chat 2025-09-29 19:14:27 +08:00
ulleo a4f9dfc8d4 fix: transaction error after run assistant chat 2025-09-29 19:08:36 +08:00
ulleo 75bd13a54f feat(X-Pack): add custom prompt
#213
2025-09-28 19:19:48 +08:00
ulleo 53d9d4af50 feat: terminology settings add datasource
#127
2025-09-25 18:19:44 +08:00
ulleo e5b9dc9e4c feat: terminology settings add datasource
#127
2025-09-25 17:43:10 +08:00
ulleo 4ecfb5b116 feat: terminology settings add datasource
#127
2025-09-25 15:43:40 +08:00
ulleo 7405c48fd6 feat: add SQL examples in prompt 2025-09-17 15:03:21 +08:00
ulleo f86b2f60cf feat: add SQL examples in prompt 2025-09-16 18:08:53 +08:00
ulleo 0ca725be77 fix: wrong total count in terminology management page 2025-09-03 14:53:44 +08:00
ulleo c6f7e6f407 feat: support select terminology in chat by using assistant 2025-09-02 15:08:15 +08:00
ulleo 4b7d27057d fix(Terminology Configuration): Term name, synonyms cannot be repeated 2025-08-29 17:18:57 +08:00
ulleo 5de59f5669 fix: terminology page query may return empty list 2025-08-28 19:27:21 +08:00
ulleo dc4a7380ba feat: terminology add oid 2025-08-28 19:01:05 +08:00
ulleo 4faa2bd689 feat: use terminology during chat 2025-08-27 14:29:18 +08:00
ulleo cc4662fc49 feat: terminology management 2025-08-25 18:13:01 +08:00
ulleo 393fd8c5b5 feat: add terminology management 2025-08-25 16:34:44 +08:00