145 Commits
Author SHA1 Message Date
junjun 9a407ea9b8 feat(datasource): Hive data source supports adapting to SparkThriftServer metadata parsing #1391 2026-10-10 16:07:54 +08:00
sunlishuo d8d600c6c2 fix(db): avoid duplicate Doris and StarRocks connection parameters 2026-10-08 10:04:04 +08:00
junjun b06348e71a fix(db): convert SQL Server varchar fields from latin-1 to gbk in exec_sql 2026-09-24 16:39:09 +08:00
junjun 2f2326aaa8 fix: hive config 2026-09-23 10:27:39 +08:00
junjun aa41fc1033 fix: hive config 2026-09-22 16:10:12 +08:00
junjun 2ce3fc71ef refactor: optimize code 2026-09-20 17:50:45 +08:00
xuwei-fit2cloud 518403e2b4 fix(db): avoid detached datasource in SQL Server pool creator (#1330) 2026-09-20 11:14:24 +08:00
kris tan 67601e6494 fix(datasource): filter Hive partition metadata from table fields
Ignore blank names and DESCRIBE metadata headers. Retain partition columns once in their original order, preserve valid hash-prefixed column names, and keep support for extra driver columns.

Refs dataease/SQLBot#1250.
2026-09-15 16:09:52 +08:00
master_lin b744ca6c28 fix(datasource): dispose SQLAlchemy engine when removing pool 2026-09-14 10:32:05 +08:00
junjun ba9aa5db66 fix: Oracle timeout #1360 2026-09-11 14:13:28 +08:00
junjun 273171b8d1 fix: Kingbase SQL inject 2026-08-27 15:04:39 +08:00
junjun bfe3fc4dc9 fix: The number of columns returned by Hive DESCRIBE does not match the ColumnSchema constructor #1210 2026-08-20 14:17:11 +08:00
junjun 7a32b139f7 feat: Hive datasource supports LDAP authentication #1209 2026-08-20 11:26:46 +08:00
junjun d31e6a0277 feat: Hive datasource supports LDAP authentication 2026-08-20 10:05:49 +08:00
junjun ec4717e1f1 fix: connect pool pre ping 2026-08-03 17:05:35 +08:00
junjun fe65f3e2cc refactor: Optimize connection pool #1256 2026-07-20 17:32:54 +08:00
junjun 634d7e898c refactor: Optimize connection pool #1256 2026-07-16 15:51:20 +08:00
ulleo deff40b884 feat: add thousands separator settings 2026-07-13 19:03:23 +08:00
ulleo f56f65905a feat: add thousands separator settings 2026-07-13 18:33:58 +08:00
ulleo a5e57c1d60 feat: add thousands separator settings 2026-07-13 18:09:37 +08:00
ulleo ccbc65d549 feat: add thousands separator settings 2026-07-13 16:57:11 +08:00
junjun 8a18ed6513 refactor: Optimize connection pool 2026-07-13 16:45:09 +08:00
ulleo 42d8c82ffc feat: add thousands separator settings 2026-07-13 15:55:41 +08:00
ulleo b947cf2476 feat: add thousands separator settings 2026-07-09 17:45:21 +08:00
ulleo 5b94406c3a fix: Fix SQL injection / LLM Prompt Injection vulnerability causing unauthorized queries
Security hardening:
- Add SQLBOT_ALLOW_METADATA_QUERIES config option, disable SHOW/DESCRIBE/EXPLAIN by default
- Add table whitelist check, use sqlglot to parse actual SQL table names and compare with authorized table list
- Add dangerous function check, block LOAD_FILE, INTO OUTFILE, EXEC etc. by database type
- Improve check_sql_read to return specific error reasons for better debugging
2026-06-11 17:29:38 +08:00
junjun 0c4f0c72c4 fix: Fix the issue where obtaining schema from DM data source may require a high privilege account 2026-06-05 09:58:37 +08:00
junjun 348346d97b fix: remove sqlite datasource 2026-06-04 11:40:31 +08:00
junjun d12f3609b5 fix: Fix the data source-related issues in the PR 2026-05-08 16:32:22 +08:00
junjun 33c6b7b944 fix: Fix the data source-related issues in the PR 2026-05-08 16:26:28 +08:00
junjun 37b4eb65eb fix: Fix the data source-related issues in the PR 2026-05-08 12:45:11 +08:00
yym eb587fce7b fix(Hive): normalize identifier quoting and stabilize metadata/query paths
Use Hive-compatible identifier handling and template defaults so generated SQL returns real column values, while also fixing table schema parsing and adding required Hive runtime dependencies.

Made-with: Cursor
2026-05-08 11:53:08 +08:00
yymandClaude Opus 4.6 348fd3850f feat: Add SQLite and Hive database support with sample data for AI
- Add SQLite support to data sources (file-based connection)
- Add Hive support to data sources
- Add SSL toggle option for MySQL and Doris databases
- Add sample data (3 rows JSON format) to help AI better understand table schema
- Fix SQLite schema table name issue (empty schema prefix)
- Add SQLite.yaml template for SQL generation
- Add Hive to haveSchema list in frontend

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-05-08 11:53:08 +08:00
junjun a1fbb05795 fix: The remarks of the DM datasource fields cannot be synchronized #1079 2026-04-29 10:12:06 +08:00
junjun ed919c9c49 fix: Fix es self signed certificate 2026-04-20 13:33:40 +08:00
junjun e5e9e535ea fix: MySQL adds SSL configuration 2026-03-24 10:17:49 +08:00
junjun 0315e27fd0 feat: Support SSL for MySQL 2026-03-17 15:12:49 +08:00
jackieya 2772cde16e security: fix RCE via terminology poisoning and restrict upload access 2026-03-16 10:37:37 +08:00
junjun bb30a3a545 fix: Fix SSRF causing arbitrary file read vulnerability 2026-03-13 18:21:24 +08:00
junjun ff98514827 fix: Fix SSRF causing arbitrary file read vulnerability 2026-03-10 10:48:33 +08:00
junjun 28ff1c9a0b fix: Fix the issue of incorrect data source connection pool recycling 2026-02-10 17:01:24 +08:00
ulleo e2e4459a7c pref: improve date format display while querying data 2026-02-04 16:29:55 +08:00
ulleo d0bc870cc2 fix: fix encoding issues when querying BIT type fields 2026-02-04 16:13:54 +08:00
junjun 989eef51d6 fix: assistant support oracle connection mode 2026-02-04 14:25:20 +08:00
junjun fa0b13b06e fix: check sql only contain read operation 2026-02-02 17:42:00 +08:00
junjun 19c38321c0 refactor: sql server support selecting compatibility with lower versions 2026-02-02 14:07:06 +08:00
junjun e8508681a3 fix: check sql only contain read operation 2026-02-02 10:07:39 +08:00
junjun 07af6d0066 fix: check sql only contain read operation #814 2026-01-29 14:44:58 +08:00
junjun bf56c3e486 fix: check sql only contain read operation #814 2026-01-29 14:22:16 +08:00
junjun 184e76ebc2 fix: check sql only contain read operation #814 2026-01-29 14:09:12 +08:00
junjun f33188a545 fix: check sql only contain read operation #814 2026-01-29 13:53:28 +08:00