- GreatSQL 社区原创内容未经受权不得随便应用,转载请分割小编并注明起源。
- GreatSQL 是 MySQL 的国产分支版本,应用上与 MySQL 统一。
一、MySQL 的 dd 表介绍
二、代码跟踪
三、常识利用
四、总结
一、MySQL 的 dd 表介绍
MySQL 的 dd 表是用来寄存表构造和各种建表信息的,客户端建的表都存在 mysql.table 和 mysql.columns 表里,还有一个表 mysql.column_type_elements 比拟非凡,用来寄存 SET 和 ENUM 类型的字段汇合值信息。看一下上面这张表的 mysql.columns 表和 mysql.column_type_elements 信息。为了缩短显示长度,这里只展现几个重要的值。
# 建表:CREATE TABLE t1(id int not null auto_increment primary key,col1 number,col2 VARCHAR(100),col3 pls_integer,
col4 enum('x','y') default 'x',col5 set('x1','y1')) partition by hash(id) partitions 3;
SET SESSION debug='+d,skip_dd_table_access_check';
mysql> select name,ordinal_position,type,default_value_utf8,options,column_type_utf8 from mysql.columns where table_id=383;
+-------------+------------------+-----------------------+--------------------+-------------------+------------------+
| name | ordinal_position | type | default_value_utf8 | options | column_type_utf8 |
+-------------+------------------+-----------------------+--------------------+-------------------+------------------+
| col1 | 2 | MYSQL_TYPE_NEWDECIMAL | NULL | interval_count=0; | decimal(65,0) |
| col2 | 3 | MYSQL_TYPE_VARCHAR | NULL | interval_count=0; | varchar(100) |
| col3 | 4 | MYSQL_TYPE_LONG | NULL | interval_count=0; | int |
| col4 | 5 | MYSQL_TYPE_ENUM | x | interval_count=2; | enum('x','y') |
| col5 | 6 | MYSQL_TYPE_SET | NULL | interval_count=2; | set('x1','y1') |
| DB_ROLL_PTR | 8 | MYSQL_TYPE_LONGLONG | NULL | NULL | |
| DB_TRX_ID | 7 | MYSQL_TYPE_INT24 | NULL | NULL | |
| id | 1 | MYSQL_TYPE_LONG | NULL | interval_count=0; | int |
+-------------+------------------+-----------------------+--------------------+-------------------+------------------+
8 rows in set (0.00 sec)
mysql.columns 表阐明如下:
ordinal_position
是该字段在表里的偏移量,这里多了 3 个字段,DB_ROLL_PTR
、DB_TRX_ID
、id
是用来执行 undo 的,记录了字段的版本信息。-
default_value_utf8
是用来保留默认值的。options 外面有 interval_count 用来保留汇合类型的数值数的。columns 表的 options 的 key 一共有如下几种:static const std::set<String_type> default_valid_option_keys = { "column_format", "geom_type", "interval_count", "not_secondary", "storage", "treat_bit_as_char", "zip_dict_id", "is_array"};
mysql> select * from mysql.column_type_elements where column_id=4286;
+-----------+---------------+------+
| column_id | element_index | name |
+-----------+---------------+------+
| 4286 | 1 | x |
| 4286 | 2 | y |
+-----------+---------------+------+
2 rows in set (0.01 sec)
#这里的 column_id=4286 是 col4 的 id 值,x 和 y 别离对应了 set 定义时候的 2 个汇合值。
二、代码跟踪
当初重新启动数据库,跟踪一下这个 columns 表怎么转为代码外面的 TABLE 的 field 对象。首先找到表的 dd 信息而后关上表获取 field 信息。
mysql> select * from t1;
输出该命令后找到 columns 表转为 field 的代码:
#0 fill_column_from_dd (thd=0x555558b35a06 <std::char_traits<char>::compare(char const*, char const*, unsigned long)+61>,
share=0x7fffe83f1b60,
col_obj=0x555558bb0a5e <std::__cxx11::basic_string<char, std::char_traits<char>, Stateless_allocator<char, dd::String_type_alloc, My_free_functor> >::compare(std::__cxx11::basic_string<char, std::char_traits<char>, Stateless_allocator<char, dd::String_type_alloc, My_free_functor> > const&) const+142>,
null_pos=0x7fffe83f1880 "\005", null_bit_pos=32767, rec_pos=0x7fff2c05ac10 "explicit_encryption",
field_nr=0) at /mysql/sql/dd_table_share.cc:955
#1 0x00005555593c4c17 in fill_columns_from_dd (thd=0x7fff2c006890, share=0x7fff2cbf19e8,
tab_obj=0x7fff2cbb9b38) at /mysql/sql/dd_table_share.cc:1235
#2 0x00005555593c9e54 in open_table_def (thd=0x7fff2c006890, share=0x7fff2cbf19e8, table_def=...)
at /mysql/sql/dd_table_share.cc:2408
#3 0x0000555558e76a13 in get_table_share (thd=0x7fff2c006890, db=0x7fff2cbeeff0 "db1",
table_name=0x7fff2cc03210 "t1", key=0x7fff2cbeed87 "db1", key_length=7, open_view=true,
open_secondary=false) at /mysql/sql/sql_base.cc:801
#4 0x0000555558e76f08 in get_table_share_with_discover (thd=0x7fff2c006890, table_list=0x7fff2cbee9b8,
key=0x7fff2cbeed87 "db1", key_length=7, open_secondary=false, error=0x7fffe83f1ea4)
at /mysql/sql/sql_base.cc:889
#5 0x0000555558e7cd34 in open_table (thd=0x7fff2c006890, table_list=0x7fff2cbee9b8,
ot_ctx=0x7fffe83f2380) at /mysql/sql/sql_base.cc:3230
#6 0x0000555558e81769 in open_and_process_table (thd=0x7fff2c006890, lex=0x7fff2c01bdf0,
tables=0x7fff2cbee9b8, counter=0x7fff2c01be48, prelocking_strategy=0x7fffe83f2408,
has_prelocking_list=false, ot_ctx=0x7fffe83f2380)
at /mysql/sql/sql_base.cc:5118
#7 0x0000555558e833bd in open_tables (thd=0x7fff2c006890, start=0x7fffe83f23f0, counter=0x7fff2c01be48,
flags=0, prelocking_strategy=0x7fffe83f2408)
at /mysql/sql/sql_base.cc:5928
#8 0x0000555558e85626 in open_tables_for_query (thd=0x7fff2c006890, tables=0x7fff2cbee9b8, flags=0)
at /mysql/sql/sql_base.cc:6904
#9 0x0000555559075720 in Sql_cmd_dml::prepare (this=0x7fff2cbef400, thd=0x7fff2c006890)
at /mysql/sql/sql_select.cc:372
#10 0x00005555590760bf in Sql_cmd_dml::execute (this=0x7fff2cbef400, thd=0x7fff2c006890)
at /mysql/sql/sql_select.cc:527
#11 0x0000555558fedc8e in mysql_execute_command (thd=0x7fff2c006890, first_level=true)
at /mysql/sql/sql_parse.cc:4794
#12 0x0000555558fefe25 in dispatch_sql_command (thd=0x7fff2c006890, parser_state=0x7fffe83f3990,
update_userstat=false) at /mysql/sql/sql_parse.cc:5399
#13 0x0000555558fe52d3 in dispatch_command (thd=0x7fff2c006890, com_data=0x7fffe83f4b70,
command=COM_QUERY) at /mysql/sql/sql_parse.cc:2000
#14 0x0000555558fe3643 in do_command (thd=0x7fff2c006890)
at /mysql/sql/sql_parse.cc:1448
#15 0x000055555920e200 in handle_connection (arg=0x555560a65790)
at /mysql/sql/conn_handler/connection_handler_per_thread.cc:307
#16 0x000055555ae36375 in pfs_spawn_thread (arg=0x5555608a2e20)
at /mysql/storage/perfschema/pfs.cc:2899
#17 0x00007ffff77a6609 in start_thread (arg=<optimized out>) at pthread_create.c:477
#18 0x00007ffff76cb163 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
#fill_column_from_dd 函数外面最重要的是 make_field 函数,把字段从 dd::Column 转为 table 的 field 而后赋值给 TABLE_SHARE。reg_field = make_field(*col_obj, charset, share, rec_pos, null_pos, null_bit_pos);
三、常识利用
session 每次获取表的信息都是在第一次关上表的时候就做好了,下次如果表没有变动就从 Table_cache 间接获取表信息。当初假如咱们要改 col4 字段的汇合值又不想通过 alter 语句来执行,那就能够间接对 dd 表进行操作。留神,该操作对生产环境有很大危险,这里只用来进行常识实际,不能用来在生产环境实际操作。
把 col4 的 x,y 值改为 a,b:
首先试着插入 col4= x 的记录,当初还没改 dd 表插入胜利。
mysql> insert into t1 values(1,1,'aa',1,'x','x1');
Query OK, 1 row affected (0.03 sec)
接着开始改 col4 的汇合值:
mysql> SET SESSION debug='+d,skip_dd_table_access_check';
Query OK, 0 rows affected (0.02 sec)
mysql> update mysql.columns set default_value_utf8='a' ,column_type_utf8='enum(\'a\',\'b\'))' where table_id=383 and name='col4';
Query OK, 1 row affected (0.03 sec)
Rows matched: 1 Changed: 1 Warnings: 0
mysql> select name,ordinal_position,type,default_value_utf8,options,column_type_utf8 from mysql.columns where table_id=383;
+-------------+------------------+-----------------------+--------------------+-------------------+------------------+
| name | ordinal_position | type | default_value_utf8 | options | column_type_utf8 |
+-------------+------------------+-----------------------+--------------------+-------------------+------------------+
| col1 | 2 | MYSQL_TYPE_NEWDECIMAL | NULL | interval_count=0; | decimal(65,0) |
| col2 | 3 | MYSQL_TYPE_VARCHAR | NULL | interval_count=0; | varchar(100) |
| col3 | 4 | MYSQL_TYPE_LONG | NULL | interval_count=0; | int |
| col4 | 5 | MYSQL_TYPE_ENUM | a | interval_count=2; | enum('a','b')) | 汇合值已改
| col5 | 6 | MYSQL_TYPE_SET | NULL | interval_count=2; | set('x1','y1') |
| DB_ROLL_PTR | 8 | MYSQL_TYPE_LONGLONG | NULL | NULL | |
| DB_TRX_ID | 7 | MYSQL_TYPE_INT24 | NULL | NULL | |
| id | 1 | MYSQL_TYPE_LONG | NULL | interval_count=0; | int |
+-------------+------------------+-----------------------+--------------------+-------------------+------------------+
8 rows in set (0.00 sec)
mysql> update mysql.column_type_elements set name='a' where column_id=4286 and element_index=1;
Query OK, 1 row affected (0.03 sec)
Rows matched: 1 Changed: 1 Warnings: 0
mysql> update mysql.column_type_elements set name='b' where column_id=4286 and element_index=2;
Query OK, 1 row affected (0.03 sec)
Rows matched: 1 Changed: 1 Warnings: 0
mysql> select * from mysql.column_type_elements where column_id=4286;
+-----------+---------------+------+
| column_id | element_index | name |
+-----------+---------------+------+
| 4286 | 1 | a | 汇合值已改
| 4286 | 2 | b | 汇合值已改
+-----------+---------------+------+
2 rows in set (0.00 sec)
当初再插入一条 col4= x 的记录发现还是胜利的,这是因为 t1 没有从新从 dd 表转为 TABLE 信息,须要重启后再试。
mysql> insert into t1 values(2,1,'aa',1,'x','x1');
Query OK, 1 row affected (0.02 sec)
重启数据库,而后登录。再次插入 col4= x 发现报错了,因为这时候的 TABLE 信息是从新从 dd 表转化的。
mysql> insert into t1 values(2,1,'aa',1,'x','x1');
ERROR 1265 (01000): Data truncated for column 'col4' at row 1
插入 col4= a 的记录胜利,阐明更改胜利。
mysql> insert into t1 values(3,1,'aa',1,'a','x1');
Query OK, 1 row affected (0.02 sec)
查看建表信息, 发现曾经胜利更改。
mysql> show create table t1;
+-------+-------------------------+
| Table | Create Table |
+-------+-------------------------+
| t1 | CREATE TABLE `t1` (
`id` int NOT NULL AUTO_INCREMENT,
`col1` decimal(65,0) DEFAULT NULL,
`col2` varchar(100) DEFAULT NULL,
`col3` int DEFAULT NULL,
`col4` enum('a','b') DEFAULT 'a', 更改胜利
`col5` set('x1','y1') DEFAULT NULL,
PRIMARY KEY (`id`)
) ENGINE=InnoDB AUTO_INCREMENT=4 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_0900_ai_ci
/*!50100 PARTITION BY HASH (`id`)
PARTITIONS 3 */
+-------+-------------------------+
四、总结
实际上更改表构造如果通过 alter 命令来改流程跟下面也是一样的,也是通过更新 dd 表来实现表构造的变更,这里只是从更底层来介绍。以上的操作在理论生产中不能间接操作,危险很大,会影响现有的记录和相干的性能。这里只是作为一个案例来更好的阐明 dd 的工作流程,帮忙大家遇到问题晓得怎么从底层排查。
Enjoy GreatSQL :)
## 对于 GreatSQL
GreatSQL 是由万里数据库保护的 MySQL 分支,专一于晋升 MGR 可靠性及性能,反对 InnoDB 并行查问个性,是实用于金融级利用的 MySQL 分支版本。
相干链接:GreatSQL 社区 Gitee GitHub Bilibili
GreatSQL 社区:
欢送来 GreatSQL 社区发帖发问
https://greatsql.cn/
技术交换群:
微信:扫码增加
GreatSQL 社区助手
微信好友,发送验证信息加群
。