Commit Graph
138 Commits
Author SHA1 Message Date
ulleo 3fd6fa867d feat: implement LLM keyword extraction and fusion scoring for table matching
- Add extract_keywords() to LLMService with conversation context support,
  using process_stream + start_log/end_log for logging consistency
- Add expand_with_terminology() to expand keywords with synonym matching
- Add fusion scoring in calc_table_embedding(): α * vec_score + (1-α) * keyword_score
- Add calc_keyword_score() with multi-level matching:
  table name exact (1.0), comment exact (0.9), comment substring (0.7),
  table name partial (0.25-0.5), field comment exact (0.5),
  field comment substring (0.4), field name partial (0.3)
- Scoring considers keyword coverage rate to differentiate tables
  with different numbers of matched keywords
- Extracted keywords persisted to ChatRecord for reuse across endpoints
- get_terminology_template() supports comma-separated keyword input
  with per-keyword matching for higher precision
- Add TABLE_EMBEDDING_ALPHA and TABLE_EMBEDDING_KEYWORD_ENABLED config
2026-09-14 17:51:45 +08:00
wangjiahao 1bc83867e5 fix: Cross-Workspace Recommended-Problem Read and Overwrite (IDOR) 2026-09-09 16:26:39 +08:00
junjun c8a2dd89bb feat: system param support key-value #1310 2026-08-10 14:09:02 +08:00
junjun 959285cfd0 feat: system param support key-value #1310 2026-08-07 11:31:28 +08:00
junjun fe65f3e2cc refactor: Optimize connection pool #1256 2026-07-20 17:32:54 +08:00
junjun 1e130223a3 refactor: Optimize the type of permission field 2026-07-16 17:09:08 +08:00
Sebastion dd9627b682 fix: escape SQL values in row permission filter to prevent injection (CWE-89)
All user-controlled values interpolated into SQL WHERE clause fragments
in transTreeItem() and getSysVariableValue() are now passed through
_escape_sql_value() which doubles single quotes (standard SQL escaping)
and escapes backslashes. The logic operator in transTreeToWhere() is
also validated against a whitelist.

Affected injection vectors:
- item["enum_value"] list (enum filter)
- item["value"] string (normal filter)
- user variable values (variable filter)
- current_user name/account/email (system variable filter)
- tree["logic"] operator (tree structure)
2026-06-11 11:21:37 +08:00
junjun 348346d97b fix: remove sqlite datasource 2026-06-04 11:40:31 +08:00
junjun 76b5176b0e fix: Fix SQL injection vulnerability 2026-06-03 12:18:49 +08:00
ulleo e72c0bedda fix: Fix the data source-related issues in the PR 2026-05-11 15:07:15 +08:00
junjun 37b4eb65eb fix: Fix the data source-related issues in the PR 2026-05-08 12:45:11 +08:00
yymandClaude Opus 4.6 348fd3850f feat: Add SQLite and Hive database support with sample data for AI
- Add SQLite support to data sources (file-based connection)
- Add Hive support to data sources
- Add SSL toggle option for MySQL and Doris databases
- Add sample data (3 rows JSON format) to help AI better understand table schema
- Fix SQLite schema table name issue (empty schema prefix)
- Add SQLite.yaml template for SQL generation
- Add Hive to haveSchema list in frontend

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-05-08 11:53:08 +08:00
junjun 11d1affa29 feat: MCP supports selecting workspaces #926 2026-03-24 15:40:56 +08:00
junjun b9594285e8 feat: support system variable 2026-03-17 10:57:02 +08:00
junjun 527b18fa82 feat: support system variable 2026-03-17 10:36:05 +08:00
junjun 606949af67 feat: support system variable 2026-03-16 18:20:33 +08:00
junjun 15c75365ae refactor: The data table supports enabling and disabling 2026-03-13 14:06:25 +08:00
junjun 5105f8b51c feat: support system variable 2026-02-05 10:37:55 +08:00
junjun d9129073b9 feat: support system variable 2026-02-05 10:15:46 +08:00
junjun 4135aa3b1b refactor: Optimize row permission logic 2026-02-04 17:59:50 +08:00
fit2cloud-chenyw bbadc49759 perf: Cache clearance error in datasource deletion API 2026-01-29 10:55:53 +08:00
fit2cloud-chenyw d640ac31d1 perf: Optimize datasource-related API permission validation 2026-01-28 17:03:58 +08:00
ulleo 0dc289956b feat: improve chart field name matching with original table structure 2026-01-22 14:30:58 +08:00
junjun 9a36830042 feat: Add table field update functionality 2025-12-26 20:29:45 +08:00
junjun 4aaa2f8aad refactor: fields sort 2025-12-25 16:55:54 +08:00
junjun a611289bfa feat: Add table field update functionality 2025-12-09 10:41:37 +08:00
junjun 71e9f1fe38 feat: Datasource table structure supports field retrieval #447 2025-12-08 10:09:06 +08:00
王嘉豪 92a19a3e94 fix: Fix the issue of custom data source recommendation not displaying (#587) 2025-12-05 12:23:35 +08:00
王嘉豪 a5ba14275e refactor:update recommended questions custom config. (#491) 2025-11-25 18:40:04 +08:00
王嘉豪 9d494345b2 feat:Recommended questions support user configuration. (#487) 2025-11-25 13:54:40 +08:00
junjun b389e860f2 feat: add oracle instant client to support oracle version 11 2025-10-24 16:01:47 +08:00
junjun 6ae32a8fb7 feat: support starrocks datasource 2025-10-14 14:07:56 +08:00
junjun f4682b3fe1 feat: Vector retrieval matches tables 2025-10-13 14:48:22 +08:00
junjun b1dda8b454 feat: Vector retrieval matches tables 2025-10-10 12:39:37 +08:00
junjun f59bc962e3 refactor: Service initiation vectorization task 2025-10-10 10:03:57 +08:00
junjun 162d480e15 feat: Vector retrieval matches tables 2025-10-09 16:46:46 +08:00
junjun 56c0359ee4 feat: Vector retrieval matches tables 2025-10-09 16:12:24 +08:00
junjun 8e29511e3c feat: Vector retrieval matches tables 2025-10-09 14:27:49 +08:00
junjun 1ac0b74366 feat: Vector retrieval matches tables 2025-10-09 14:18:10 +08:00
junjun c1364302ae feat: Vector retrieval matches tables 2025-10-09 14:17:38 +08:00
junjun c54902e15c feat: Vector retrieval matches tables 2025-10-09 14:06:19 +08:00
junjun d0ab37afba feat: Vector retrieval matches tables 2025-10-09 13:43:17 +08:00
junjun cc076244f1 feat: Vector retrieval matches tables 2025-10-09 13:00:33 +08:00
junjun 090df35b48 feat: Vector retrieval matches tables 2025-10-09 12:51:32 +08:00
junjun 86b4d381e1 feat: Vector retrieval matches tables 2025-10-09 12:27:17 +08:00
junjun 24b9c9afac feat: Vector retrieval matches tables 2025-10-09 11:46:40 +08:00
junjun c5466459e9 feat: Vector retrieval matches tables 2025-10-09 10:05:10 +08:00
Junjun f76f87504e revert settings 2025-09-29 10:24:05 +08:00
ParkMinsu c2531c33f0 korean update 2025-09-29 10:24:05 +08:00
junjun 330fd2ddfd feat: support kingbase datasource 2025-09-28 14:20:16 +08:00