Commit Graph
180 Commits
Author SHA1 Message Date
ulleo 3fd6fa867d feat: implement LLM keyword extraction and fusion scoring for table matching
- Add extract_keywords() to LLMService with conversation context support,
  using process_stream + start_log/end_log for logging consistency
- Add expand_with_terminology() to expand keywords with synonym matching
- Add fusion scoring in calc_table_embedding(): α * vec_score + (1-α) * keyword_score
- Add calc_keyword_score() with multi-level matching:
  table name exact (1.0), comment exact (0.9), comment substring (0.7),
  table name partial (0.25-0.5), field comment exact (0.5),
  field comment substring (0.4), field name partial (0.3)
- Scoring considers keyword coverage rate to differentiate tables
  with different numbers of matched keywords
- Extracted keywords persisted to ChatRecord for reuse across endpoints
- get_terminology_template() supports comma-separated keyword input
  with per-keyword matching for higher precision
- Add TABLE_EMBEDDING_ALPHA and TABLE_EMBEDDING_KEYWORD_ENABLED config
2026-09-14 17:51:45 +08:00
fit2cloud-chenyw aac200aef5 fix(X-Pack): Assistant API call timeout issue #1288 2026-09-14 14:39:17 +08:00
junjun d33e42004c feat: MCP support model 2026-08-19 10:20:40 +08:00
junjun 743750305d feat: MCP support model 2026-08-18 15:43:28 +08:00
ulleo 7118b401a7 fix: extract_tables_from_sql incorrectly includes CTE names as table names
#1278
2026-07-17 16:33:02 +08:00
ulleo aa594a5681 feat: Adjust the organizational attribution logic of dialogues in MCP
#1221
2026-07-09 18:17:03 +08:00
ulleo 2fc646ce3c feat: Adjust the organizational attribution logic of dialogues in MCP
#1221
2026-06-29 16:00:42 +08:00
ulleo 4af99e0c45 feat: support configuring terminology for specified advanced applications 2026-06-16 17:23:50 +08:00
ulleo 5b94406c3a fix: Fix SQL injection / LLM Prompt Injection vulnerability causing unauthorized queries
Security hardening:
- Add SQLBOT_ALLOW_METADATA_QUERIES config option, disable SHOW/DESCRIBE/EXPLAIN by default
- Add table whitelist check, use sqlglot to parse actual SQL table names and compare with authorized table list
- Add dangerous function check, block LOAD_FILE, INTO OUTFILE, EXEC etc. by database type
- Improve check_sql_read to return specific error reasons for better debugging
2026-06-11 17:29:38 +08:00
ulleo 23ca654bc4 feat(Application): Application can configure specified model 2026-06-02 16:24:44 +08:00
ulleo e72c0bedda fix: Fix the data source-related issues in the PR 2026-05-11 15:07:15 +08:00
ulleo afbb3d7981 feat: Support configure SQLBot name in chat template 2026-05-08 17:11:16 +08:00
yym 1cf4f249ed feat/fix(charts): Normalize qualified SQL column names for display
- Add DataFormat.normalize_qualified_sql_column_keys* so driver keys like
  "_u2.table_name" also expose "table_name", matching chart columns[].value.
- Apply after SQL execution (LLM save path), format_json_list_data (API/history),
  and get_chart_data_ds (live refresh).

Hive prompts: Document explicit table aliases for duplicate column names in JOINs.

Frontend: Add datasource form i18n key "file_path" (en/zh-CN/zh-TW/ko-KR).
Update Hive/SQLite datasource icons. Remove hive from haveSchema list.
2026-05-08 11:53:08 +08:00
yymandClaude Opus 4.6 348fd3850f feat: Add SQLite and Hive database support with sample data for AI
- Add SQLite support to data sources (file-based connection)
- Add Hive support to data sources
- Add SSL toggle option for MySQL and Doris databases
- Add sample data (3 rows JSON format) to help AI better understand table schema
- Fix SQLite schema table name issue (empty schema prefix)
- Add SQLite.yaml template for SQL generation
- Add Hive to haveSchema list in frontend

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-05-08 11:53:08 +08:00
ulleo 387731236e feat(Application): Application can configure specified model 2026-04-30 15:23:32 +08:00
ulleo 22dc17baf8 feat(System): Language switch, supports Traditional Chinese. 2026-04-17 18:06:02 +08:00
ulleo 882d0e6e89 feat: improve generate sql/chart quality 2026-04-08 16:57:10 +08:00
ulleo 594df91235 feat: improve generate sql quality 2026-04-07 19:06:17 +08:00
junjun b05d90c6c8 feat: MCP supports configuration to disable rendering charts 2026-03-30 10:47:12 +08:00
ulleo 0ff44b4d94 fix: fix log persistence issues with concurrent question requests
#940
2026-03-04 18:04:18 +08:00
王嘉豪 9dccaf12d1 feat(dashboard): The dashboard supports displaying real-time data (#930) 2026-02-28 14:53:51 +08:00
ulleo 204a3df78c feat: add chat log step display 2026-02-02 16:58:24 +08:00
ulleo 8a1a9e01d3 feat: add chat log step display
#324
#742
2026-01-29 16:53:47 +08:00
fit2cloud-chenyw bca72fc96d perf: Assistant uses workspace-level Q&A configuration 2026-01-28 14:15:46 +08:00
ulleo 37afb2da21 feat: add more chat log operation steps 2026-01-28 11:10:41 +08:00
ulleo 5cdfc07169 feat: add context record count configuration to chat
#773
2026-01-26 17:21:56 +08:00
ulleo 0dc289956b feat: improve chart field name matching with original table structure 2026-01-22 14:30:58 +08:00
ulleo 3184b6629e feat: support specifying datasource ID in MCP question 2026-01-21 16:36:26 +08:00
ulleo 3cc03dc0fa feat: support multiple metrics in line, column, and bar charts 2026-01-08 16:27:12 +08:00
ulleo 1cd7f743f2 feat: support multiple metrics in line, column, and bar charts 2026-01-08 16:27:12 +08:00
wangjiahao 2fa1a94892 fix: No need to call the model to recommend problems during each session switch 2025-12-29 20:14:10 +08:00
ulleo 19997cf2d4 improve: add lang parameter in mcp chat 2025-12-25 17:22:03 +08:00
ulleo b9b3376396 feat: support command in mcp 2025-12-22 16:46:41 +08:00
ulleo 37bf819b29 feat: support command in mcp 2025-12-18 19:01:11 +08:00
ulleo 3812d5308f feat: implement parameter configuration in chat 2025-12-16 16:13:50 +08:00
ulleo 4d49819533 feat: improve regenerate SQL chat feature 2025-12-11 16:22:33 +08:00
王嘉豪 e86c0d6225 fix: Fixed the issue where the conversation title was not adjusted when the first sentence failed (#543) 2025-12-02 15:39:37 +08:00
wangjiahao 2b13dc7f93 refactor: Recommended questions display ten by default. 2025-12-01 16:52:41 +08:00
王嘉豪 e881b3ef47 feat:The generation of dialogue titles is intelligently generated by LLM (#494) 2025-11-26 10:37:44 +08:00
ulleo 88c885aaa9 fix: "Object of type datetime is not JSON serializable" error in mcp chat 2025-11-25 18:21:06 +08:00
ulleo 57ee918920 feat(X-Pack): add export Custom Prompt 2025-11-14 19:52:08 +08:00
ulleo 58f43271ea fix(mcp-chat): prevent bigint/float data from displaying in scientific notation
Add zero-width space (\u200b) prefix to all numeric values in Markdown tables to maintain formatting.
2025-11-14 11:55:24 +08:00
jinghuan-Chen 6b5bdc1563 Use and logic. 2025-11-13 10:50:05 +08:00
ulleo 45951b0902 fix: prevent bigint data from displaying in scientific notation in chat 2025-11-11 18:03:17 +08:00
ulleo 00b9813f7f feat: Advanced Application support to use SQL Examples 2025-11-11 11:49:58 +08:00
ulleo 3fa2bae3b5 improve: improve chart data export 2025-11-07 10:27:00 +08:00
ulleo b91402d2ff fix: wrong bigint data display in MCP chart picture 2025-11-05 17:23:06 +08:00
ulleo 4dbb6cf80e fix: prevent bigint data from displaying in scientific notation in MCP chat 2025-11-05 16:45:21 +08:00
ulleo dc4595b193 fix: GENERATE_SQL_QUERY_LIMIT_ENABLED not work while saving data 2025-11-04 17:11:50 +08:00
junjun 7ad8d82e13 feat: Vector retrieval matches datasource 2025-10-22 18:25:30 +08:00