写点什么

TiDB 升级利器(参数对比)——TiDBA

  • 2023-06-30
    北京
  • 本文字数:31618 字

    阅读完需:约 104 分钟

作者: 啦啦啦啦啦原文来源:https://tidb.net/blog/299f0bdc

一. 背景

针对 LTS 版本,PingCAP 会提供最多至 3 年时间的常规版本更新,以解决版本运行过程中遇到的问题,以及安全相关的漏洞修复。而对于已经结束维护周期的版本,官方不会提供支持。那么如果想要跟紧 TiDB 的脚步,可能最多 3 年就要做一次大版本的升级,下面是目前最新的版本支持时间表。



TiDB 虽然有使用 tiup 进行原地升级的方式,但是目前暂不支持版本降级或升级后回退,还要考虑停机时间等问题,风险还是比较高的。而且如果版本跨度较大可能要进行多次升级才能到目标版本,操作也比较复杂。因此,条件允许的话还是建议尽量使用新旧集群之间做实时同步然后割接的方案来达到升级的目的。TiDB 作为分布式数据库有 tidb,pd 和 tikv 等多个组件,每个组件都有自己的参数,每次版本的升级可能都会有参数的变化,比如新增或者废弃的参数,或者参数的默认值可能会发生变化。如果不进行测试直接进行升级可能会由于参数变动发生预期之外的影响。

二. 什么是 TiDBA

TiDBA 可以对比 2 个集群之间的参数,来识别新旧版本或者不同参数的变化。


从 toolkit 离线包中可以看到有几个我们平时不常用的压缩包,dba-v1.0.4-linux-amd64.tar.gz 就是其中之一,解压后无需编译可以直接得到 tidba 这个可执行文件,使用非常方便。


[root@cctest tidb-community-toolkit-v7.1.0-linux-amd64]# ls1535.dmctl.json           3729.prometheus.json                          dba-v1.0.4-linux-amd64.tar.gz            pump-v7.1.0-linux-amd64.tar.gz1542.dm-worker.json       3752.cdc.json                                 dmctl-v7.1.0-linux-amd64.tar.gz          reparo1546.dm-master.json       3.package.json                                dm-master-v7.1.0-linux-amd64.tar.gz      root.json17.tispark.json           3.PCC.json                                    dm-v1.12.2-linux-amd64.tar.gz            server-v1.12.2-linux-amd64.tar.gz1.dba.json                487.bench.json                                dm-worker-v7.1.0-linux-amd64.tar.gz      snapshot.json1.index.json              5.alertmanager.json                           drainer-v7.1.0-linux-amd64.tar.gz        spark-v2.4.3-any-any.tar.gz1.root.json               7.blackbox_exporter.json                      dumpling-v7.1.0-linux-amd64.tar.gz       sync_diff_inspector239.dm.json               7.node_exporter.json                          errdoc-v4.0.7-linux-amd64.tar.gz         tidba241.server.json           80.tikv-importer.json                         etcdctl                                  tidb-lightning-ctl281.tiup.json             9.errdoc.json                                 grafana-v7.1.0-linux-amd64.tar.gz        tidb-lightning-v7.1.0-linux-amd64.tar.gz2.spark.json              alertmanager-v0.17.0-linux-amd64.tar.gz       keys                                     tikv-importer-v4.0.2-linux-amd64.tar.gz3541.drainer.json         arbiter                                       local_install.sh                         timestamp.json3562.pump.json            bench-v1.12.0-linux-amd64.tar.gz              mydumper                                 tispark-v2.4.1-any-any.tar.gz3569.pd-recover.json      bin                                           node_exporter-v1.3.1-linux-amd64.tar.gz  tiup-linux-amd64.tar.gz3586.dumpling.json        binlogctl                                     package-v0.0.9-linux-amd64.tar.gz        tiup-v1.12.2-linux-amd64.tar.gz3657.tidb-lightning.json  blackbox_exporter-v0.21.1-linux-amd64.tar.gz  PCC-1.0.1-linux-amd64.tar.gz3660.br.json              br-v7.1.0-linux-amd64.tar.gz                  pd-recover-v7.1.0-linux-amd64.tar.gz3678.grafana.json         cdc-v7.1.0-linux-amd64.tar.gz                 prometheus-v7.1.0-linux-amd64.tar.gz
复制代码

三. 环境准备

本次测试仅用于参数对比,因此采用最简单省时的 tiup playground 来创建集群。


准备 2 套集群,源端为 v6.1.6


[root@cctest ~]# tiup playground v6.1.6tiup is checking updates for component playground ...Starting component `playground`: /root/.tiup/components/playground/v1.12.3/tiup-playground v6.1.6Start pd instance:v6.1.6Start tikv instance:v6.1.6Start tidb instance:v6.1.6Waiting for tidb instances ready127.0.0.1:42240 ... DoneStart tiflash instance:v6.1.6Waiting for tiflash instances ready127.0.0.1:3930 ... Done
🎉 TiDB Playground Cluster is started, enjoy!
Connect TiDB: mysql --comments --host 127.0.0.1 --port 42240 -u rootTiDB Dashboard: http://127.0.0.1:38754/dashboardGrafana: http://127.0.0.1:3000
复制代码


目标端为 7.1.0


[root@cctest ~]# tiup playground v7.1.0tiup is checking updates for component playground ...Starting component playground: /root/.tiup/components/playground/v1.12.3/tiup-playground v7.1.0Start pd instance:v7.1.0Start tikv instance:v7.1.0Start tidb instance:v7.1.0Waiting for tidb instances ready127.0.0.1:4000 ... DoneStart tiflash instance:v7.1.0Waiting for tiflash instances ready127.0.0.1:41072 ... Done
🎉 TiDB Playground Cluster is started, enjoy!
Connect TiDB: mysql --comments --host 127.0.0.1 --port 4000 -u rootTiDB Dashboard: http://127.0.0.1:2379/dashboardGrafana: http://127.0.0.1:43315
复制代码

四. 参数对比测试

1.tidb 系统变量对比

tidba diff tidb –diff-type variable –base-tidb-addr 127.0.0.1:42240 –base-tidb-user root –new-tidb-addr 127.0.0.1:4000 –new-tidb-user root


[root@cctest tidb-community-toolkit-v7.1.0-linux-amd64]# ./tidba diff tidb --diff-type variable --base-tidb-addr 127.0.0.1:42240 --base-tidb-user root  --new-tidb-addr 127.0.0.1:4000 --new-tidb-user root--- 127.0.0.1:42240+++ 127.0.0.1:4000 {   "tidb_allow_batch_cop": "1",   "tidb_allow_fallback_to_tikv": "",-  "tidb_allow_function_for_expression_index": "lower, md5, reverse, tidb_shard, upper, vitess_hash",+  "tidb_allow_function_for_expression_index": "json_array, json_array_append, json_array_insert, json_contains, json_contains_path, json_depth, json_extract, json_insert, json_keys, json_length, json_merge_patch, json_merge_preserve, json_object, json_pretty, json_quote, json_remove, json_replace, json_search, json_set, json_storage_size, json_type, json_unquote, json_valid, lower, md5, reverse, tidb_shard, upper, vitess_hash",   "tidb_allow_mpp": "ON",   "tidb_allow_remove_auto_inc": "OFF",   "tidb_analyze_version": "2",   "tidb_auto_analyze_end_time": "23:59 +0000",   "tidb_auto_analyze_ratio": "0.5",   "tidb_auto_analyze_start_time": "00:00 +0000",   "tidb_backoff_lock_fast": "10",   "tidb_backoff_weight": "2",   "tidb_batch_commit": "OFF",   "tidb_batch_delete": "OFF",   "tidb_batch_insert": "OFF",   "tidb_batch_pending_tiflash_count": "4000",   "tidb_broadcast_join_threshold_count": "10240",   "tidb_broadcast_join_threshold_size": "104857600",   "tidb_build_stats_concurrency": "4",   "tidb_capture_plan_baselines": "OFF",   "tidb_check_mb4_value_in_utf8": "ON",   "tidb_checksum_table_concurrency": "4",   "tidb_committer_concurrency": "128",   "tidb_constraint_check_in_place": "OFF",-  "tidb_current_ts": "442484779120328706",+  "tidb_current_ts": "442484779124785154",   "tidb_ddl_error_count_limit": "512",   "tidb_ddl_reorg_batch_size": "256",   "tidb_ddl_reorg_priority": "PRIORITY_LOW",   "tidb_ddl_reorg_worker_cnt": "4",   "tidb_disable_txn_auto_retry": "ON",   "tidb_distsql_scan_concurrency": "15",   "tidb_dml_batch_size": "0",   "tidb_enable_1pc": "ON",-  "tidb_enable_amend_pessimistic_txn": "OFF",   "tidb_enable_analyze_snapshot": "OFF",   "tidb_enable_async_commit": "ON",   "tidb_enable_auto_analyze": "ON",   "tidb_enable_auto_increment_in_generated": "OFF",   "tidb_enable_batch_dml": "OFF",   "tidb_enable_cascades_planner": "OFF",-  "tidb_enable_change_multi_schema": "OFF",-  "tidb_enable_chunk_rpc": "1",+  "tidb_enable_chunk_rpc": "ON",-  "tidb_enable_clustered_index": "INT_ONLY",+  "tidb_enable_clustered_index": "ON",   "tidb_enable_collect_execution_info": "ON",   "tidb_enable_column_tracking": "OFF",   "tidb_enable_enhanced_security": "OFF",-  "tidb_enable_exchange_partition": "OFF",+  "tidb_enable_exchange_partition": "ON",   "tidb_enable_extended_stats": "OFF",   "tidb_enable_fast_analyze": "OFF",-  "tidb_enable_historical_stats": "OFF",+  "tidb_enable_historical_stats": "ON",   "tidb_enable_index_merge": "ON",   "tidb_enable_index_merge_join": "OFF",   "tidb_enable_inl_join_inner_multi_pattern": "OFF",   "tidb_enable_legacy_instance_scope": "ON",   "tidb_enable_list_partition": "ON",   "tidb_enable_local_txn": "OFF",   "tidb_enable_mutation_checker": "ON",-  "tidb_enable_new_cost_interface": "OFF",+  "tidb_enable_new_cost_interface": "ON",   "tidb_enable_new_only_full_group_by_check": "OFF",   "tidb_enable_noop_functions": "OFF",   "tidb_enable_ordered_result_mode": "OFF",-  "tidb_enable_outer_join_reorder": "OFF",+  "tidb_enable_outer_join_reorder": "ON",-  "tidb_enable_paging": "OFF",+  "tidb_enable_paging": "ON",   "tidb_enable_parallel_apply": "OFF",   "tidb_enable_pipelined_window_function": "ON",-  "tidb_enable_point_get_cache": "OFF",   "tidb_enable_prepared_plan_cache": "ON",-  "tidb_enable_pseudo_for_outdated_stats": "ON",+  "tidb_enable_pseudo_for_outdated_stats": "OFF",-  "tidb_enable_rate_limit_action": "ON",+  "tidb_enable_rate_limit_action": "OFF",   "tidb_enable_slow_log": "ON",   "tidb_enable_stmt_summary": "ON",   "tidb_enable_strict_double_type_check": "ON",   "tidb_enable_table_partition": "ON",   "tidb_enable_telemetry": "OFF",   "tidb_enable_top_sql": "OFF",   "tidb_enable_tso_follower_proxy": "OFF",   "tidb_enable_vectorized_expression": "ON",   "tidb_enable_window_function": "ON",   "tidb_enforce_mpp": "OFF",   "tidb_evolve_plan_baselines": "OFF",   "tidb_evolve_plan_task_end_time": "23:59 +0000",   "tidb_evolve_plan_task_max_time": "600",   "tidb_evolve_plan_task_start_time": "00:00 +0000",   "tidb_executor_concurrency": "5",   "tidb_expensive_query_time_threshold": "60",   "tidb_force_priority": "NO_PRIORITY",   "tidb_gc_concurrency": "-1",   "tidb_gc_enable": "ON",   "tidb_gc_life_time": "10m0s",   "tidb_gc_max_wait_time": "86400",   "tidb_gc_run_interval": "10m0s",   "tidb_gc_scan_lock_mode": "LEGACY",   "tidb_general_log": "OFF",   "tidb_guarantee_linearizability": "ON",   "tidb_hash_exchange_with_new_collation": "ON",   "tidb_hash_join_concurrency": "-1",   "tidb_hashagg_final_concurrency": "-1",   "tidb_hashagg_partial_concurrency": "-1",   "tidb_ignore_prepared_cache_close_stmt": "OFF",   "tidb_index_join_batch_size": "25000",   "tidb_index_lookup_concurrency": "-1",   "tidb_index_lookup_join_concurrency": "-1",   "tidb_index_lookup_size": "20000",   "tidb_index_serial_scan_concurrency": "1",   "tidb_init_chunk_size": "32",   "tidb_isolation_read_engines": "tikv,tiflash,tidb",   "tidb_last_ddl_info": "{"query":"","seq_num":0}",-  "tidb_last_query_info": "{"txn_scope":"global","start_ts":442484779120328706,"for_update_ts":442484779120328706}",+  "tidb_last_query_info": "{"txn_scope":"global","start_ts":442484779124785154,"for_update_ts":442484779124785154}",   "tidb_last_txn_info": "",   "tidb_log_file_max_days": "0",   "tidb_low_resolution_tso": "OFF",   "tidb_max_auto_analyze_time": "43200",   "tidb_max_chunk_size": "1024",   "tidb_max_delta_schema_count": "1024",   "tidb_max_tiflash_threads": "-1",   "tidb_mem_oom_action": "CANCEL",   "tidb_mem_quota_analyze": "-1",   "tidb_mem_quota_apply_cache": "33554432",   "tidb_mem_quota_binding_cache": "67108864",   "tidb_mem_quota_query": "1073741824",-  "tidb_memory_usage_alarm_ratio": "0.8",+  "tidb_memory_usage_alarm_ratio": "0.7",   "tidb_merge_join_concurrency": "1",   "tidb_metric_query_range_duration": "60",   "tidb_metric_query_step": "60",   "tidb_mpp_store_fail_ttl": "60s",   "tidb_multi_statement_mode": "OFF",   "tidb_nontransactional_ignore_error": "OFF",   "tidb_opt_agg_push_down": "OFF",   "tidb_opt_broadcast_cartesian_join": "1",   "tidb_opt_concurrency_factor": "3",   "tidb_opt_copcpu_factor": "3",   "tidb_opt_correlation_exp_factor": "1",   "tidb_opt_correlation_threshold": "0.9",   "tidb_opt_cpu_factor": "3",   "tidb_opt_desc_factor": "3",   "tidb_opt_disk_factor": "1.5",   "tidb_opt_distinct_agg_push_down": "OFF",   "tidb_opt_enable_correlation_adjustment": "ON",   "tidb_opt_insubq_to_join_and_agg": "ON",   "tidb_opt_join_reorder_threshold": "0",   "tidb_opt_limit_push_down_threshold": "100",   "tidb_opt_memory_factor": "0.001",   "tidb_opt_mpp_outer_join_fixed_build_side": "OFF",   "tidb_opt_network_factor": "1",   "tidb_opt_prefer_range_scan": "OFF",   "tidb_opt_projection_push_down": "OFF",   "tidb_opt_scan_factor": "1.5",   "tidb_opt_seek_factor": "20",   "tidb_opt_tiflash_concurrency_factor": "24",   "tidb_opt_write_row_id": "OFF",   "tidb_optimizer_selectivity_level": "0",-  "tidb_partition_prune_mode": "static",+  "tidb_partition_prune_mode": "dynamic",   "tidb_persist_analyze_options": "ON",   "tidb_placement_mode": "STRICT",   "tidb_pprof_sql_cpu": "0",   "tidb_prepared_plan_cache_memory_guard_ratio": "0.1",   "tidb_prepared_plan_cache_size": "100",   "tidb_projection_concurrency": "-1",   "tidb_query_log_max_len": "4096",   "tidb_rc_read_check_ts": "OFF",   "tidb_read_consistency": "strict",   "tidb_read_staleness": "0",   "tidb_record_plan_in_slow_log": "ON",   "tidb_redact_log": "OFF",   "tidb_regard_null_as_point": "ON",   "tidb_remove_orderby_in_subquery": "OFF",   "tidb_replica_read": "leader",   "tidb_restricted_read_only": "OFF",   "tidb_retry_limit": "10",   "tidb_row_format_version": "2",   "tidb_scatter_region": "OFF",   "tidb_shard_allocate_step": "9223372036854775807",   "tidb_skip_ascii_check": "OFF",   "tidb_skip_isolation_level_check": "OFF",   "tidb_skip_utf8_check": "OFF",   "tidb_slow_log_threshold": "300",   "tidb_slow_query_file": "tidb-slow.log",   "tidb_snapshot": "",   "tidb_stats_cache_mem_quota": "0",-  "tidb_stats_load_pseudo_timeout": "false",+  "tidb_stats_load_pseudo_timeout": "ON",-  "tidb_stats_load_sync_wait": "0",+  "tidb_stats_load_sync_wait": "100",   "tidb_stmt_summary_history_size": "24",   "tidb_stmt_summary_internal_query": "OFF",   "tidb_stmt_summary_max_sql_length": "4096",   "tidb_stmt_summary_max_stmt_count": "3000",   "tidb_stmt_summary_refresh_interval": "1800",   "tidb_store_limit": "0",   "tidb_streamagg_concurrency": "1",   "tidb_super_read_only": "OFF",   "tidb_sysdate_is_now": "OFF",   "tidb_table_cache_lease": "3",   "tidb_tmp_table_max_size": "67108864",   "tidb_top_sql_max_meta_count": "5000",   "tidb_top_sql_max_time_series_count": "100",   "tidb_track_aggregate_memory_usage": "ON",   "tidb_tso_client_batch_max_wait_time": "0",   "tidb_txn_assertion_level": "FAST",   "tidb_txn_commit_batch_size": "16384",   "tidb_txn_mode": "pessimistic",   "tidb_use_plan_baselines": "ON",   "tidb_wait_split_region_finish": "ON",   "tidb_wait_split_region_timeout": "300",   "tidb_window_concurrency": "-1"+  "tidb_adaptive_closest_read_threshold": "4096"+  "tidb_analyze_partition_concurrency": "1"+  "tidb_auto_analyze_partition_batch_size": "1"+  "tidb_auto_build_stats_concurrency": "1"+  "tidb_cdc_write_source": "0"+  "tidb_constraint_check_in_place_pessimistic": "ON"+  "tidb_cost_model_version": "2"+  "tidb_ddl_disk_quota": "107374182400"+  "tidb_ddl_enable_fast_reorg": "ON"+  "tidb_ddl_flashback_concurrency": "64"+  "tidb_default_string_match_selectivity": "0.8"+  "tidb_enable_ddl": "ON"+  "tidb_enable_dist_task": "OFF"+  "tidb_enable_external_ts_read": "OFF"+  "tidb_enable_foreign_key": "ON"+  "tidb_enable_gc_aware_memory_track": "OFF"+  "tidb_enable_gogc_tuner": "ON"+  "tidb_enable_historical_stats_for_capture": "OFF"+  "tidb_enable_metadata_lock": "ON"+  "tidb_enable_non_prepared_plan_cache": "OFF"+  "tidb_enable_non_prepared_plan_cache_for_dml": "OFF"+  "tidb_enable_noop_variables": "ON"+  "tidb_enable_null_aware_anti_join": "ON"+  "tidb_enable_plan_cache_for_param_limit": "ON"+  "tidb_enable_plan_cache_for_subquery": "ON"+  "tidb_enable_plan_replayer_capture": "ON"+  "tidb_enable_plan_replayer_continuous_capture": "OFF"+  "tidb_enable_prepared_plan_cache_memory_monitor": "ON"+  "tidb_enable_resource_control": "ON"+  "tidb_enable_reuse_chunk": "ON"+  "tidb_enable_row_level_checksum": "OFF"+  "tidb_enable_tiflash_read_for_write_stmt": "ON"+  "tidb_enable_tmp_storage_on_oom": "ON"+  "tidb_enable_unsafe_substitute": "OFF"+  "tidb_external_ts": "0"+  "tidb_generate_binary_plan": "ON"+  "tidb_gogc_tuner_threshold": "0.6"+  "tidb_historical_stats_duration": "168h0m0s"+  "tidb_index_join_double_read_penalty_cost_rate": "0"+  "tidb_index_merge_intersection_concurrency": "-1"+  "tidb_last_plan_replayer_token": ""+  "tidb_load_based_replica_read_threshold": "1s"+  "tidb_max_bytes_before_tiflash_external_group_by": "-1"+  "tidb_max_bytes_before_tiflash_external_join": "-1"+  "tidb_max_bytes_before_tiflash_external_sort": "-1"+  "tidb_max_paging_size": "50000"+  "tidb_memory_debug_mode_alarm_ratio": "0"+  "tidb_memory_debug_mode_min_heap_inuse": "0"+  "tidb_memory_usage_alarm_keep_record_num": "5"+  "tidb_merge_partition_stats_concurrency": "1"+  "tidb_min_paging_size": "128"+  "tidb_non_prepared_plan_cache_size": "100"+  "tidb_opt_advanced_join_hint": "ON"+  "tidb_opt_derive_topn": "OFF"+  "tidb_opt_enable_late_materialization": "ON"+  "tidb_opt_enable_three_stage_multi_distinct_agg": "OFF"+  "tidb_opt_fix_control": ""+  "tidb_opt_force_inline_cte": "OFF"+  "tidb_opt_ordering_index_selectivity_threshold": "0"+  "tidb_opt_prefix_index_single_scan": "ON"+  "tidb_opt_range_max_size": "67108864"+  "tidb_opt_skew_distinct_agg": "OFF"+  "tidb_opt_three_stage_distinct_agg": "ON"+  "tidb_pessimistic_txn_fair_locking": "ON"+  "tidb_plan_cache_invalidation_on_fresh_stats": "ON"+  "tidb_plan_cache_max_plan_size": "2097152"+  "tidb_prefer_broadcast_join_by_exchange_data_size": "OFF"+  "tidb_rc_write_check_ts": "OFF"+  "tidb_server_memory_limit": "80%"+  "tidb_server_memory_limit_gc_trigger": "0.7"+  "tidb_server_memory_limit_sess_min_size": "134217728"+  "tidb_session_plan_cache_size": "100"+  "tidb_simplified_metrics": "OFF"+  "tidb_slow_txn_log_threshold": "0"+  "tidb_source_id": "1"+  "tidb_stmt_summary_enable_persistent": "OFF"+  "tidb_stmt_summary_file_max_backups": "0"+  "tidb_stmt_summary_file_max_days": "3"+  "tidb_stmt_summary_file_max_size": "64"+  "tidb_stmt_summary_filename": "tidb-statements.log"+  "tidb_store_batch_size": "4"+  "tidb_sysproc_scan_concurrency": "1"+  "tidb_ttl_delete_batch_size": "100"+  "tidb_ttl_delete_rate_limit": "0"+  "tidb_ttl_delete_worker_count": "4"+  "tidb_ttl_job_enable": "ON"+  "tidb_ttl_job_schedule_window_end_time": "23:59 +0000"+  "tidb_ttl_job_schedule_window_start_time": "00:00 +0000"+  "tidb_ttl_running_tasks": "-1"+  "tidb_ttl_scan_batch_size": "500"+  "tidb_ttl_scan_worker_count": "4" }
复制代码

2.tidb config 对比

tidba diff tidb –diff-type config –base-tidb-addr 127.0.0.1:42240 –base-tidb-user root –new-tidb-addr 127.0.0.1:4000 –new-tidb-user root


[root@cctest tidb-community-toolkit-v7.1.0-linux-amd64]# ./tidba diff tidb --diff-type config --base-tidb-addr 127.0.0.1:42240 --base-tidb-user root  --new-tidb-addr 127.0.0.1:4000 --new-tidb-user root--- 127.0.0.1:42240+++ 127.0.0.1:4000 {   "advertise-address": "127.0.0.1",   "alter-primary-key": false,   "ballast-object-size": 0,   "binlog": {     "binlog-socket": "",     "enable": false,     "ignore-error": false,     "strategy": "range",     "write-timeout": "15s"   },-  "check-mb4-value-in-utf8": true,   "compatible-kill-query": false,   "cors": "",   "delay-clean-table-lock": 0,   "deprecate-integer-display-length": false,-  "enable-batch-dml": false,-  "enable-collect-execution-info": true,   "enable-enum-length-limit": true,   "enable-forwarding": false,   "enable-global-index": false,   "enable-global-kill": true,   "enable-table-lock": false,   "enable-tcp4-only": false,   "enable-telemetry": false,   "experimental": {     "allow-expression-index": false   },   "graceful-wait-before-shutdown": 0,   "host": "127.0.0.1",   "index-limit": 64,   "instance": {     "ddl_slow_threshold": 300,     "plugin_dir": "/data/deploy/plugin",     "plugin_load": "",     "tidb_check_mb4_value_in_utf8": true,     "tidb_enable_collect_execution_info": true,     "tidb_enable_slow_log": true,     "tidb_expensive_query_time_threshold": 60,     "tidb_force_priority": "NO_PRIORITY",     "tidb_general_log": false,-    "tidb_memory_usage_alarm_ratio": 0.8,     "tidb_pprof_sql_cpu": false,     "tidb_record_plan_in_slow_log": 1,     "tidb_slow_log_threshold": 300+    "max_connections": 0+    "tidb_enable_ddl": true+    "tidb_rc_read_check_ts": false+    "tidb_stmt_summary_enable_persistent": false+    "tidb_stmt_summary_file_max_backups": 0+    "tidb_stmt_summary_file_max_days": 3+    "tidb_stmt_summary_file_max_size": 64+    "tidb_stmt_summary_filename": "tidb-statements.log"   },   "isolation-read": {     "engines": [       : "tikv",       : "tiflash",       : "tidb"     ]   },   "labels": {   },   "lease": "45s",   "log": {     "disable-error-stack": null,     "disable-timestamp": null,     "enable-error-stack": null,-    "enable-slow-log": true,     "enable-timestamp": null,-    "expensive-threshold": 10000,     "file": {-      "filename": "/root/.tiup/data/TiSzfi6/tidb-0/tidb.log",+      "filename": "/root/.tiup/data/TiSzmGl/tidb-0/tidb.log",       "max-backups": 0,       "max-days": 0,       "max-size": 300     },     "format": "text",     "level": "info",-    "query-log-max-len": 4096,-    "record-plan-in-slow-log": 1,     "slow-query-file": "tidb-slow.log",-    "slow-threshold": 300+    "timeout": 0   },   "max-ballast-object-size": 0,   "max-index-length": 3072,-  "max-server-connections": 0,-  "mem-quota-query": 1.073741824e+09,   "new_collations_enabled_on_first_bootstrap": true,-  "oom-action": "cancel",-  "oom-use-tmp-storage": true,   "opentracing": {     "enable": false,     "reporter": {       "buffer-flush-interval": 0,       "local-agent-host-port": "",       "log-spans": false,       "queue-size": 0     },     "rpc-metrics": false,     "sampler": {       "max-operations": 0,       "param": 1,       "sampling-refresh-interval": 0,       "sampling-server-url": "",       "type": "const"     }   },-  "path": "127.0.0.1:38754",+  "path": "127.0.0.1:2379",   "pd-client": {     "pd-server-timeout": 3   },   "performance": {     "bind-info-lease": "3s",-    "committer-concurrency": 128,     "cross-join": true,     "distinct-agg-push-down": false,     "enable-stats-cache-mem-quota": false,     "enforce-mpp": false,-    "feedback-probability": 0,-    "force-priority": "NO_PRIORITY",     "gogc": 100,-    "max-memory": 0,     "max-procs": 0,     "max-txn-ttl": 3.6e+06,-    "memory-usage-alarm-ratio": 0.8,     "plan-replayer-gc-lease": "10m",     "projection-push-down": false,     "pseudo-estimate-ratio": 0.8,-    "query-feedback-limit": 512,-    "run-auto-analyze": true,     "server-memory-quota": 0,     "stats-lease": "3s",     "stats-load-concurrency": 5,     "stats-load-queue-size": 1000,     "stmt-count-limit": 5000,     "tcp-keep-alive": true,     "tcp-no-delay": true,     "txn-entry-size-limit": 6.291456e+06,     "txn-total-size-limit": 1.048576e+08+    "analyze-partition-concurrency-quota": 16+    "enable-load-fmsketch": false+    "force-init-stats": false+    "lite-init-stats": false+    "plan-replayer-dump-worker-concurrency": 1   },   "pessimistic-txn": {     "deadlock-history-capacity": 10,     "deadlock-history-collect-retryable": false,     "max-retry-count": 256,     "pessimistic-auto-commit": false+    "constraint-check-in-place-pessimistic": true   },   "plugin": {-    "dir": "/data/deploy/plugin",-    "load": ""   },-  "port": 42240,+  "port": 4000,   "prepared-plan-cache": {-    "capacity": 100,-    "enabled": true,-    "memory-guard-ratio": 0.1   },   "proxy-protocol": {     "header-timeout": 5,     "networks": ""+    "fallbackable": false   },   "repair-mode": false,   "repair-table-list": [   ],-  "run-ddl": true,   "security": {     "auto-tls": true,     "cluster-ssl-ca": "",     "cluster-ssl-cert": "",     "cluster-ssl-key": "",     "cluster-verify-cn": null,     "enable-sem": false,     "rsa-key-size": 4096,     "secure-bootstrap": false,     "skip-grant-table": false,     "spilled-file-encryption-method": "plaintext",     "ssl-ca": "",     "ssl-cert": "",     "ssl-key": "",     "tls-version": ""+    "auth-token-jwks": ""+    "auth-token-refresh-interval": "1h0m0s"+    "disconnect-on-expired-password": true+    "session-token-signing-cert": ""+    "session-token-signing-key": ""   },   "server-version": "",   "skip-register-to-dashboard": false,-  "socket": "/tmp/tidb-42240.sock",+  "socket": "/tmp/tidb-4000.sock",   "split-region-max-num": 1000,   "split-table": true,   "status": {     "grpc-concurrent-streams": 1024,     "grpc-initial-window-size": 2.097152e+06,     "grpc-keepalive-time": 10,     "grpc-keepalive-timeout": 3,     "grpc-max-send-msg-size": 2.147483647e+09,     "metrics-addr": "",     "metrics-interval": 15,     "record-db-qps": false,     "report-status": true,     "status-host": "0.0.0.0",-    "status-port": 42773+    "status-port": 10080+    "record-db-label": false   },   "store": "tikv",   "stores-refresh-interval": 60,   "table-column-count-limit": 1017,   "tidb-edition": "",   "tidb-release-version": "",   "tikv-client": {     "async-commit": {       "allowed-clock-drift": 5e+08,       "keys-limit": 256,       "safe-window": 2e+09,       "total-key-size-limit": 4096     },     "batch-wait-size": 8,     "commit-timeout": "41s",     "copr-cache": {       "capacity-mb": 1000     },     "enable-chunk-rpc": true,     "grpc-compression-type": "none",     "grpc-connection-count": 4,     "grpc-keepalive-time": 10,     "grpc-keepalive-timeout": 3,     "max-batch-size": 128,     "max-batch-wait-time": 0,     "overload-threshold": 200,     "region-cache-ttl": 600,     "resolve-lock-lite-threshold": 16,     "store-limit": 0,     "store-liveness-timeout": "1s",     "ttl-refreshed-txn-size": 3.3554432e+07   },-  "tmp-storage-path": "/tmp/0_tidb/MTI3LjAuMC4xOjQyMjQwLzAuMC4wLjA6NDI3NzM=/tmp-storage",+  "tmp-storage-path": "/tmp/0_tidb/MTI3LjAuMC4xOjQwMDAvMC4wLjAuMDoxMDA4MA==/tmp-storage",   "tmp-storage-quota": -1,   "token-limit": 1000,   "top-sql": {     "receiver-address": ""   },   "treat-old-version-utf8-as-utf8mb4": true,   "version-comment": ""+  "autoscaler-addr": "tiflash-autoscale-lb.tiflash-autoscale.svc.cluster.local:8081"+  "autoscaler-cluster-id": ""+  "autoscaler-type": "aws"+  "disaggregated-tiflash": false+  "initialize-sql-file": ""+  "is-tiflashcompute-fixed-pool": false+  "keyspace-name": ""+  "temp-dir": "/tmp/tidb"+  "tidb-enable-exit-check": false+  "tidb-max-reuse-chunk": 64+  "tidb-max-reuse-column": 256+  "transaction-summary": {+    "transaction-id-digest-min-duration": 2.147483647e+09,+    "transaction-summary-capacity": 500+  }+  "use-autoscaler": false }
复制代码

3.pd 参数对比

tidba diff pd –base-pd-addr 127.0.0.1:38754 –new-pd-addr 127.0.0.1:2379


[root@cctest tidb-community-toolkit-v7.1.0-linux-amd64]# ./tidba diff pd --base-pd-addr 127.0.0.1:38754 --new-pd-addr 127.0.0.1:2379--- 127.0.0.1:38754+++ 127.0.0.1:2379 {   "DisableStrictReconfigCheck": false,   "ElectionInterval": "3s",   "HeartbeatStreamBindInterval": "1m0s",   "LeaderPriorityCheckInterval": "1m0s",   "PreVote": true,   "TickInterval": "500ms",   "WarningMsgs": null,-  "advertise-client-urls": "http://127.0.0.1:38754",+  "advertise-client-urls": "http://127.0.0.1:2379",-  "advertise-peer-urls": "http://127.0.0.1:35297",+  "advertise-peer-urls": "http://127.0.0.1:2380",   "auto-compaction-mode": "periodic",   "auto-compaction-retention-v2": "1h",-  "client-urls": "http://127.0.0.1:38754",+  "client-urls": "http://127.0.0.1:2379",-  "cluster-version": "6.1.6",+  "cluster-version": "7.1.0",   "dashboard": {     "enable-experimental": false,     "enable-telemetry": false,     "internal-proxy": false,     "public-path-prefix": "",     "tidb-cacert-path": "",     "tidb-cert-path": "",     "tidb-key-path": ""   },-  "data-dir": "/root/.tiup/data/TiSzfi6/pd-0/data",+  "data-dir": "/root/.tiup/data/TiSzmGl/pd-0/data",   "enable-grpc-gateway": true,   "enable-local-tso": false,   "force-new-cluster": false,-  "initial-cluster": "pd-0=http://127.0.0.1:35297",+  "initial-cluster": "pd-0=http://127.0.0.1:2380",   "initial-cluster-state": "new",   "initial-cluster-token": "pd-cluster",   "join": "",   "label-property": {   },   "labels": {   },   "lease": 3,   "log": {     "development": false,     "disable-caller": false,     "disable-error-verbose": true,     "disable-stacktrace": false,     "disable-timestamp": false,     "file": {-      "filename": "/root/.tiup/data/TiSzfi6/pd-0/pd.log",+      "filename": "/root/.tiup/data/TiSzmGl/pd-0/pd.log",       "max-backups": 0,       "max-days": 0,-      "max-size": 300+      "max-size": 0     },     "format": "text",     "level": "info",     "sampling": null+    "error-output-path": ""   },   "max-request-bytes": 1.572864e+08,   "metric": {     "address": "",     "interval": "15s",     "job": "pd-0"   },   "name": "pd-0",   "pd-server": {-    "dashboard-address": "http://127.0.0.1:38754",+    "dashboard-address": "http://127.0.0.1:2379",     "flow-round-by-digit": 3,     "key-type": "table",     "max-gap-reset-ts": "24h0m0s",     "metric-storage": "",-    "min-resolved-ts-persistence-interval": "0s",+    "min-resolved-ts-persistence-interval": "1s",     "runtime-services": "",     "use-region-storage": "true"+    "enable-gogc-tuner": "false"+    "gc-tuner-threshold": 0.6+    "server-memory-limit": 0+    "server-memory-limit-gc-trigger": 0.7+    "trace-region-flow": "true"   },-  "peer-urls": "http://127.0.0.1:35297",+  "peer-urls": "http://127.0.0.1:2380",   "quota-backend-bytes": "8GiB",   "replication": {     "enable-placement-rules": "true",     "enable-placement-rules-cache": "false",     "isolation-level": "",     "location-labels": "",-    "max-replicas": 1,+    "max-replicas": 3,     "strictly-match-label": "false"   },   "replication-mode": {     "dr-auto-sync": {       "dr": "",       "dr-replicas": 0,       "label-key": "",       "pause-region-split": "false",       "primary": "",       "primary-replicas": 0,-      "wait-async-timeout": "2m0s",       "wait-store-timeout": "1m0s",-      "wait-sync-timeout": "1m0s"     },     "replication-mode": "majority"   },   "schedule": {     "enable-cross-table-merge": "true",     "enable-debug-metrics": "false",     "enable-joint-consensus": "true",     "enable-location-replacement": "true",     "enable-make-up-replica": "true",     "enable-one-way-merge": "false",     "enable-remove-down-replica": "true",     "enable-remove-extra-replica": "true",     "enable-replace-offline-replica": "true",     "high-space-ratio": 0.7,     "hot-region-cache-hits-threshold": 3,     "hot-region-schedule-limit": 4,     "hot-regions-reserved-days": 7,     "hot-regions-write-interval": "10m0s",     "leader-schedule-limit": 4,     "leader-schedule-policy": "count",-    "low-space-ratio": 0.99,+    "low-space-ratio": 0.8,     "max-merge-region-keys": 200000,     "max-merge-region-size": 20,     "max-pending-peer-count": 64,     "max-snapshot-count": 64,     "max-store-down-time": "30m0s",     "max-store-preparing-time": "48h0m0s",     "merge-schedule-limit": 8,     "patrol-region-interval": "10ms",     "region-schedule-limit": 2048,     "region-score-formula-version": "v2",     "replica-schedule-limit": 64,     "scheduler-max-waiting-operator": 5,     "schedulers-payload": {-      "balance-hot-region-scheduler": null,+      "balance-hot-region-scheduler": {+        "byte-rate-rank-step-ratio": 0.05,+        "count-rank-step-ratio": 0.01,+        "dst-tolerance-ratio": 1.05,+        "enable-for-tiflash": "true",+        "forbid-rw-type": "none",+        "great-dec-ratio": 0.95,+        "key-rate-rank-step-ratio": 0.05,+        "max-peer-number": 1000,+        "max-zombie-rounds": 3,+        "min-hot-byte-rate": 100,+        "min-hot-key-rate": 10,+        "min-hot-query-rate": 10,+        "minor-dec-ratio": 0.99,+        "query-rate-rank-step-ratio": 0.05,+        "rank-formula-version": "v2",+        "read-priorities": [+          : "query",+          : "byte"+        ],+        "src-tolerance-ratio": 1.05,+        "strict-picking-store": "true",+        "write-leader-priorities": [+          : "query",+          : "byte"+        ],+        "write-peer-priorities": [+          : "byte",+          : "key"+        ]+      },       "balance-leader-scheduler": {         "batch": 4,         "ranges": [           : {             "end-key": "",             "start-key": ""           }         ]       },       "balance-region-scheduler": {         "name": "balance-region-scheduler",         "ranges": [           : {             "end-key": "",             "start-key": ""           }         ]       },-      "split-bucket-scheduler": null+      "balance-witness-scheduler": {+        "batch": 4,+        "ranges": [+          : {+            "end-key": "",+            "start-key": ""+          }+        ]+      }+      "transfer-witness-leader-scheduler": null     },     "schedulers-v2": [       0: {         "args": null,         "args-payload": "",         "disable": false,         "type": "balance-region"       },       1: {         "args": null,         "args-payload": "",         "disable": false,         "type": "balance-leader"       },+      2: {+        "args": null,+        "args-payload": "",+        "disable": false,+        "type": "balance-witness"+      },       3: {         "args": null,         "args-payload": "",         "disable": false,         "type": "split-bucket"       },     ],     "split-merge-interval": "1h0m0s",     "store-limit": {       "1": {         "add-peer": 15,         "remove-peer": 15       },-      "68": {-        "add-peer": 30,-        "remove-peer": 30-      }     },     "store-limit-mode": "manual",     "tolerant-size-ratio": 0+    "enable-diagnostic": "true"+    "enable-tikv-split-region": "true"+    "enable-witness": "false"+    "slow-store-evicting-affected-store-ratio-threshold": 0.3+    "store-limit-version": "v1"+    "swtich-witness-interval": "1h0m0s"+    "witness-schedule-limit": 4   },   "security": {     "SSLCABytes": null,     "SSLCertBytes": null,     "SSLKEYBytes": null,     "cacert-path": "",     "cert-allowed-cn": null,     "cert-path": "",     "encryption": {       "data-encryption-method": "plaintext",       "data-key-rotation-period": "168h0m0s",       "master-key": {         "endpoint": "",         "key-id": "",         "path": "",         "region": "",         "type": "plaintext"       }     },     "key-path": "",     "redact-info-log": false   },   "tso-save-interval": "3s",   "tso-update-physical-interval": "50ms"+  "controller": {+    "degraded-mode-wait-duration": "0s",+    "request-unit": {+      "read-base-cost": 0.25,+      "read-cost-per-byte": 1.52587890625e-05,+      "read-cpu-ms-cost": 0.3333333333333333,+      "write-base-cost": 1,+      "write-cost-per-byte": 0.0009765625+    }+  }+  "keyspace": {+    "pre-alloc": null+  } }
复制代码

4.tikv 参数对比

tidba diff tikv –base-tikv-addr 127.0.0.1:20180 –new-tikv-addr 127.0.0.1:35014


```markdown[root@cctest tidb-community-toolkit-v7.1.0-linux-amd64]# ./tidba diff tikv –base-tikv-addr 127.0.0.1:20180 –new-tikv-addr 127.0.0.1:35014— 127.0.0.1:20180+++ 127.0.0.1:35014 { “abort-on-panic”: false, “backup”: { “auto-tune-refresh-interval”: “1m”, “auto-tune-remain-threads”: 3, “batch-size”: 8, “enable-auto-tune”: true, “hadoop”: { “home”: “”, “linux-user”: “” }, “io-thread-size”: 2, “num-threads”: 8, “s3-multi-part-size”: “5MiB”, “sst-max-size”: “144MiB” }, “causal-ts”: { “renew-batch-min-size”: 100, “renew-interval”: “100ms”+ “alloc-ahead-buffer”: “3s”+ “renew-batch-max-size”: 8192 }, “cdc”: { “hibernate-regions-compatible”: true, “incremental-scan-concurrency”: 6, “incremental-scan-speed-limit”: “128MiB”, “incremental-scan-threads”: 4, “incremental-scan-ts-filter-ratio”: 0.2, “min-ts-interval”: “1s”, “old-value-cache-memory-quota”: “512MiB”, “sink-memory-quota”: “512MiB”+ “tso-worker-threads”: 1 }, “coprocessor”: { “batch-split-limit”: 10, “consistency-check-method”: “mvcc”, “enable-region-bucket”: false, “prefer-approximate-bucket”: true, “region-bucket-merge-size-ratio”: 0.33, “region-bucket-size”: “96MiB”, “region-max-keys”: 1.44e+06, “region-max-size”: “144MiB”, “region-size-threshold-for-approximate”: “1440MiB”, “region-split-keys”: 960000, “region-split-size”: “96MiB”, “split-region-on-table”: false }, “coprocessor-v2”: { “coprocessor-plugin-directory”: null }, “gc”: { “batch-keys”: 512, “compaction-filter-skip-version-check”: false, “enable-compaction-filter”: true, “max-write-bytes-per-sec”: “0KiB”, “ratio-threshold”: 1.1 }, “import”: { “import-mode-timeout”: “10m”, “num-threads”: 8, “stream-channel-window”: 128+ “memory-use-ratio”: 0.3 }, “log”: { “enable-timestamp”: true, “file”: {- “filename”: “/root/.tiup/data/TiSzfi6/tikv-0/tikv.log”,+ “filename”: “/root/.tiup/data/TiSzmGl/tikv-0/tikv.log”, “max-backups”: 0, “max-days”: 0, “max-size”: 300 }, “format”: “text”, “level”: “info” }, “log-backup”: {- “enable”: false,+ “enable”: true, “initial-scan-pending-memory-quota”: “512MiB”,- “io-threads”: 2,- “max-flush-interval”: “5m”,+ “max-flush-interval”: “3m”, “num-threads”: 8,- “temp-file-size-limit-per-task”: “128MiB”,- “temp-path”: “/root/.tiup/data/TiSzfi6/tikv-0/data/log-backup-tmp”+ “temp-path”: “/root/.tiup/data/TiSzmGl/tikv-0/data/log-backup-temp”+ “file-size-limit”: “256MiB”+ “initial-scan-rate-limit”: “60MiB”+ “min-ts-interval”: “10s” }, “log-file”: “”, “log-format”: “text”, “log-level”: “info”, “log-rotation-size”: “300MiB”, “log-rotation-timespan”: “0s”, “memory-usage-high-water”: 0.9,- “memory-usage-limit”: “24155MiB”,+ “memory-usage-limit”: “23590MiB”, “pd”: { “enable-forwarding”: false, “endpoints”: [- 0: “http://127.0.0.1:38754"+ 0: “http://127.0.0.1:2379" ], “retry-interval”: “300ms”, “retry-log-every”: 10, “retry-max-count”: 9.223372036854776e+18, “update-interval”: “10m” }, “pessimistic-txn”: { “in-memory”: true, “pipelined”: true, “wait-for-lock-timeout”: “1s”, “wake-up-delay-duration”: “20ms” }, “quota”: { “background-cpu-time”: 0, “background-read-bandwidth”: “0KiB”, “background-write-bandwidth”: “0KiB”, “enable-auto-tune”: false, “foreground-cpu-time”: 0, “foreground-read-bandwidth”: “0KiB”, “foreground-write-bandwidth”: “0KiB”, “max-delay-duration”: “500ms” }, “raft-engine”: { “batch-compression-threshold”: “8KiB”,- “bytes-per-sync”: “4MiB”,+ “bytes-per-sync”: null,- “dir”: “/root/.tiup/data/TiSzfi6/tikv-0/data/raft-engine”,+ “dir”: “/root/.tiup/data/TiSzmGl/tikv-0/data/raft-engine”, “enable”: true,- “memory-limit”: 5.181667584e+09,+ “memory-limit”: 5.060222361e+09, “purge-rewrite-garbage-ratio”: 0.6, “purge-rewrite-threshold”: “1GiB”, “purge-threshold”: “10GiB”, “recovery-mode”: “tolerate-corrupted-tail-records”, “recovery-read-block-size”: “16KiB”, “recovery-threads”: 4, “target-file-size”: “128MiB”+ “enable-log-recycle”: true+ “format-version”: 2+ “prefill-for-recycle”: false+ “prefill-limit”: null+ “spill-dir”: null }, “raftdb”: { “allow-concurrent-memtable-write”: true, “bytes-per-sync”: “1MiB”, “compaction-readahead-size”: “0KiB”, “create-if-missing”: true, “defaultcf”: { “block-based-bloom-filter”: false,- “block-cache-size”: “658MiB”,+ “block-cache-size”: “643MiB”, “block-size”: “64KiB”, “bloom-filter-bits-per-key”: 10, “bottommost-level-compression”: “disable”, “bottommost-zstd-compression-dict-size”: 0, “bottommost-zstd-compression-sample-size”: 0, “cache-index-and-filter-blocks”: true, “compaction-guard-max-output-file-size”: “128MiB”, “compaction-guard-min-output-file-size”: “8MiB”, “compaction-pri”: 0, “compaction-style”: 0, “compression-per-level”: [ : “no”, : “no”, : “lz4”, : “lz4”, : “lz4”, : “zstd”, : “zstd” ], “disable-auto-compactions”: false, “disable-block-cache”: false, “disable-write-stall”: false, “dynamic-level-bytes”: true,- “enable-compaction-guard”: false,+ “enable-compaction-guard”: null, “enable-doubly-skiplist”: true, “force-consistency-checks”: false, “hard-pending-compaction-bytes-limit”: “1TiB”, “level0-file-num-compaction-trigger”: 4, “level0-slowdown-writes-trigger”: 20, “level0-stop-writes-trigger”: 20, “max-bytes-for-level-base”: “512MiB”, “max-bytes-for-level-multiplier”: 10, “max-compaction-bytes”: “2GiB”, “max-write-buffer-number”: 5, “min-write-buffer-number-to-merge”: 1, “num-levels”: 7, “optimize-filters-for-hits”: true, “pin-l0-filter-and-index-blocks”: true, “prop-keys-index-distance”: 40960, “prop-size-index-distance”: 4.194304e+06, “read-amp-bytes-per-bit”: 0, “soft-pending-compaction-bytes-limit”: “192GiB”,- “target-file-size-base”: “8MiB”,+ “target-file-size-base”: null, “titan”: { “blob-cache-size”: “0KiB”, “blob-file-compression”: “lz4”, “blob-run-mode”: “normal”, “discardable-ratio”: 0.5, “level-merge”: false, “max-gc-batch-size”: “64MiB”, “max-sorted-runs”: 20, “merge-small-file-threshold”: “8MiB”, “min-blob-size”: “1KiB”, “min-gc-batch-size”: “16MiB”, “range-merge”: true }, “use-bloom-filter”: false, “whole-key-filtering”: true, “write-buffer-size”: “128MiB”+ “checksum”: “crc32c”+ “format-version”: 2+ “max-compactions”: 0+ “prepopulate-block-cache”: “disabled” }, “enable-pipelined-write”: true,- “enable-statistics”: true, “enable-unordered-write”: false, “info-log-dir”: “”, “info-log-keep-log-file-num”: 10, “info-log-level”: “info”, “info-log-max-size”: “1GiB”, “info-log-roll-time”: “0s”, “max-background-flushes”: 1, “max-background-jobs”: 4, “max-manifest-file-size”: “20MiB”, “max-open-files”: 256, “max-sub-compactions”: 2, “max-total-wal-size”: “4GiB”, “stats-dump-period”: “10m”, “titan”: { “dirname”: “”, “disable-gc”: false, “enabled”: false, “max-background-gc”: 4, “purge-obsolete-files-period”: “10s” }, “use-direct-io-for-flush-and-compaction”: false, “wal-bytes-per-sync”: “512KiB”, “wal-dir”: “”, “wal-recovery-mode”: 2, “wal-size-limit”: “0KiB”, “wal-ttl-seconds”: 0, “writable-file-max-buffer-size”: “1MiB” }, “raftstore”: { “abnormal-leader-missing-duration”: “10m”, “apply-low-priority-pool-size”: 1, “apply-max-batch-size”: 256, “apply-pool-size”: 2, “apply-reschedule-duration”: “5s”, “capacity”: “0KiB”, “check-leader-lease-interval”: “2s250ms”, “cleanup-import-sst-interval”: “10m”, “cmd-batch”: true, “cmd-batch-concurrent-ready-max-count”: 1, “consistency-check-interval”: “0s”, “evict-cache-on-memory-ratio”: 0, “future-poll-size”: 1, “hibernate-regions”: true, “inspect-interval”: “500ms”, “io-reschedule-concurrent-max-count”: 4, “io-reschedule-hotpot-duration”: “5s”, “local-read-batch-size”: 1024, “lock-cf-compact-bytes-threshold”: “256MiB”, “lock-cf-compact-interval”: “10m”, “max-leader-missing-duration”: “2h”, “max-peer-down-duration”: “10m”, “max-snapshot-file-raw-size”: “100MiB”, “merge-check-tick-interval”: “2s”, “messages-per-tick”: 4096, “notify-capacity”: 40960, “pd-heartbeat-tick-interval”: “1m”, “pd-store-heartbeat-tick-interval”: “10s”, “peer-stale-state-check-interval”: “5m”, “perf-level”: 0, “prevote”: true, “raft-engine-purge-interval”: “10s”, “raft-entry-cache-life-time”: “30s”, “raft-entry-max-size”: “8MiB”, “raft-log-compact-sync-interval”: “2s”, “raft-log-gc-count-limit”: 73728, “raft-log-gc-size-limit”: “72MiB”, “raft-log-gc-threshold”: 50, “raft-log-gc-tick-interval”: “3s”, “raft-max-inflight-msgs”: 256, “raft-max-size-per-msg”: “1MiB”, “raft-store-max-leader-lease”: “9s”, “raft-write-size-limit”: “1MiB”,- “raftdb-path”: “/root/.tiup/data/TiSzfi6/tikv-0/data/raft”,+ “raftdb-path”: “/root/.tiup/data/TiSzmGl/tikv-0/data/raft”, “reactive-memory-lock-tick-interval”: “2s”, “reactive-memory-lock-timeout-tick”: 5, “region-compact-check-interval”: “5m”, “region-compact-check-step”: 100, “region-compact-min-tombstones”: 10000, “region-compact-tombstones-percent”: 30, “region-split-check-diff”: “6MiB”, “renew-leader-lease-advance-duration”: “2s250ms”,- “report-min-resolved-ts-interval”: “0s”,+ “report-min-resolved-ts-interval”: “1s”, “report-region-buckets-tick-interval”: “10s”, “snap-apply-batch-size”: “10MiB”, “snap-gc-timeout”: “4h”, “snap-generator-pool-size”: 2, “snap-mgr-gc-tick-interval”: “1m”, “split-region-check-tick-interval”: “10s”, “store-io-notify-capacity”: 40960, “store-io-pool-size”: 0, “store-low-priority-pool-size”: 0, “store-max-batch-size”: 256, “store-pool-size”: 2, “store-reschedule-duration”: “5s”, “unreachable-backoff”: “10s”, “waterfall-metrics”: true+ “apply-yield-write-size”: “32KiB”+ “check-long-uncommitted-interval”: “10s”+ “clean-stale-ranges-tick”: 10+ “long-uncommitted-base-threshold”: “20s”+ “max-entry-cache-warmup-duration”: “1s”+ “region-compact-min-redundant-rows”: 50000+ “region-compact-redundant-rows-percent”: 20+ “region-worker-tick-interval”: “1s”+ “request-voter-replicated-index-interval”: “5m”+ “slow-trend-unsensitive-cause”: 10+ “slow-trend-unsensitive-result”: 0.5 }, “readpool”: { “coprocessor”: { “high-concurrency”: 12, “low-concurrency”: 12, “max-tasks-per-worker-high”: 2000, “max-tasks-per-worker-low”: 2000, “max-tasks-per-worker-normal”: 2000, “normal-concurrency”: 12, “stack-size”: “10MiB”, “use-unified-pool”: true }, “storage”: { “high-concurrency”: 8, “low-concurrency”: 8, “max-tasks-per-worker-high”: 2000, “max-tasks-per-worker-low”: 2000, “max-tasks-per-worker-normal”: 2000, “normal-concurrency”: 8, “stack-size”: “10MiB”, “use-unified-pool”: true }, “unified”: { “max-tasks-per-worker”: 2000, “max-thread-count”: 12, “min-thread-count”: 1, “stack-size”: “10MiB”+ “auto-adjust-pool-size”: false } }, “resolved-ts”: {- “advance-ts-interval”: “1s”,+ “advance-ts-interval”: “20s”, “enable”: true, “scan-lock-pool-size”: 2 }, “resource-metering”: { “max-resource-groups”: 100, “precision”: “1s”, “receiver-address”: “”, “report-receiver-interval”: “1m” }, “rocksdb”: { “bytes-per-sync”: “1MiB”, “compaction-readahead-size”: “0KiB”, “create-if-missing”: true, “defaultcf”: { “block-based-bloom-filter”: false,- “block-cache-size”: “8236MiB”,+ “block-cache-size”: “8043MiB”,- “block-size”: “64KiB”,+ “block-size”: “32KiB”, “bloom-filter-bits-per-key”: 10, “bottommost-level-compression”: “zstd”, “bottommost-zstd-compression-dict-size”: 0, “bottommost-zstd-compression-sample-size”: 0, “cache-index-and-filter-blocks”: true, “compaction-guard-max-output-file-size”: “128MiB”, “compaction-guard-min-output-file-size”: “8MiB”, “compaction-pri”: 3, “compaction-style”: 0, “compression-per-level”: [ : “no”, : “no”, : “lz4”, : “lz4”, : “lz4”, : “zstd”, : “zstd” ], “disable-auto-compactions”: false, “disable-block-cache”: false, “disable-write-stall”: true, “dynamic-level-bytes”: true, “enable-compaction-guard”: true, “enable-doubly-skiplist”: true, “force-consistency-checks”: false, “hard-pending-compaction-bytes-limit”: “1TiB”, “level0-file-num-compaction-trigger”: 4, “level0-slowdown-writes-trigger”: 20, “level0-stop-writes-trigger”: 20, “max-bytes-for-level-base”: “512MiB”, “max-bytes-for-level-multiplier”: 10, “max-compaction-bytes”: “2GiB”, “max-write-buffer-number”: 5, “min-write-buffer-number-to-merge”: 1, “num-levels”: 7, “optimize-filters-for-hits”: true, “pin-l0-filter-and-index-blocks”: true, “prop-keys-index-distance”: 40960, “prop-size-index-distance”: 4.194304e+06, “read-amp-bytes-per-bit”: 0, “soft-pending-compaction-bytes-limit”: “192GiB”,- “target-file-size-base”: “8MiB”,+ “target-file-size-base”: null, “titan”: { “blob-cache-size”: “0KiB”, “blob-file-compression”: “lz4”, “blob-run-mode”: “normal”, “discardable-ratio”: 0.5, “level-merge”: false, “max-gc-batch-size”: “64MiB”, “max-sorted-runs”: 20, “merge-small-file-threshold”: “8MiB”, “min-blob-size”: “1KiB”, “min-gc-batch-size”: “16MiB”, “range-merge”: true }, “use-bloom-filter”: true, “whole-key-filtering”: true, “write-buffer-size”: “128MiB”+ “checksum”: “crc32c”+ “format-version”: 2+ “max-compactions”: 0+ “prepopulate-block-cache”: “disabled” },- “enable-multi-batch-write”: true,+ “enable-multi-batch-write”: null, “enable-pipelined-write”: false,- “enable-statistics”: true, “enable-unordered-write”: false, “info-log-dir”: “”, “info-log-keep-log-file-num”: 10, “info-log-level”: “info”, “info-log-max-size”: “1GiB”, “info-log-roll-time”: “0s”, “lockcf”: { “block-based-bloom-filter”: false,- “block-cache-size”: “658MiB”,+ “block-cache-size”: “643MiB”, “block-size”: “16KiB”, “bloom-filter-bits-per-key”: 10, “bottommost-level-compression”: “disable”, “bottommost-zstd-compression-dict-size”: 0, “bottommost-zstd-compression-sample-size”: 0, “cache-index-and-filter-blocks”: true, “compaction-guard-max-output-file-size”: “128MiB”, “compaction-guard-min-output-file-size”: “8MiB”, “compaction-pri”: 0, “compaction-style”: 0, “compression-per-level”: [ : “no”, : “no”, : “no”, : “no”, : “no”, : “no”, : “no” ], “disable-auto-compactions”: false, “disable-block-cache”: false, “disable-write-stall”: true, “dynamic-level-bytes”: true,- “enable-compaction-guard”: false,+ “enable-compaction-guard”: null, “enable-doubly-skiplist”: true, “force-consistency-checks”: false, “hard-pending-compaction-bytes-limit”: “1TiB”, “level0-file-num-compaction-trigger”: 1, “level0-slowdown-writes-trigger”: 20, “level0-stop-writes-trigger”: 20, “max-bytes-for-level-base”: “128MiB”, “max-bytes-for-level-multiplier”: 10, “max-compaction-bytes”: “2GiB”, “max-write-buffer-number”: 5, “min-write-buffer-number-to-merge”: 1, “num-levels”: 7, “optimize-filters-for-hits”: false, “pin-l0-filter-and-index-blocks”: true, “prop-keys-index-distance”: 40960, “prop-size-index-distance”: 4.194304e+06, “read-amp-bytes-per-bit”: 0, “soft-pending-compaction-bytes-limit”: “192GiB”,- “target-file-size-base”: “8MiB”,+ “target-file-size-base”: null, “titan”: { “blob-cache-size”: “0KiB”, “blob-file-compression”: “lz4”, “blob-run-mode”: “read-only”, “discardable-ratio”: 0.5, “level-merge”: false, “max-gc-batch-size”: “64MiB”, “max-sorted-runs”: 20, “merge-small-file-threshold”: “8MiB”, “min-blob-size”: “1KiB”, “min-gc-batch-size”: “16MiB”, “range-merge”: true }, “use-bloom-filter”: true, “whole-key-filtering”: true, “write-buffer-size”: “32MiB”+ “checksum”: “crc32c”+ “format-version”: 2+ “max-compactions”: 0+ “prepopulate-block-cache”: “disabled” }, “max-background-flushes”: 3, “max-background-jobs”: 9, “max-manifest-file-size”: “128MiB”, “max-open-files”: 256, “max-sub-compactions”: 3, “max-total-wal-size”: “4GiB”, “raftcf”: { “block-based-bloom-filter”: false, “block-cache-size”: “128MiB”, “block-size”: “16KiB”, “bloom-filter-bits-per-key”: 10, “bottommost-level-compression”: “disable”, “bottommost-zstd-compression-dict-size”: 0, “bottommost-zstd-compression-sample-size”: 0, “cache-index-and-filter-blocks”: true, “compaction-guard-max-output-file-size”: “128MiB”, “compaction-guard-min-output-file-size”: “8MiB”, “compaction-pri”: 0, “compaction-style”: 0, “compression-per-level”: [ : “no”, : “no”, : “no”, : “no”, : “no”, : “no”, : “no” ], “disable-auto-compactions”: false, “disable-block-cache”: false, “disable-write-stall”: true, “dynamic-level-bytes”: true,- “enable-compaction-guard”: false,+ “enable-compaction-guard”: null, “enable-doubly-skiplist”: true, “force-consistency-checks”: false, “hard-pending-compaction-bytes-limit”: “1TiB”, “level0-file-num-compaction-trigger”: 1, “level0-slowdown-writes-trigger”: 20, “level0-stop-writes-trigger”: 20, “max-bytes-for-level-base”: “128MiB”, “max-bytes-for-level-multiplier”: 10, “max-compaction-bytes”: “2GiB”, “max-write-buffer-number”: 5, “min-write-buffer-number-to-merge”: 1, “num-levels”: 7, “optimize-filters-for-hits”: true, “pin-l0-filter-and-index-blocks”: true, “prop-keys-index-distance”: 40960, “prop-size-index-distance”: 4.194304e+06, “read-amp-bytes-per-bit”: 0, “soft-pending-compaction-bytes-limit”: “192GiB”,- “target-file-size-base”: “8MiB”,+ “target-file-size-base”: null, “titan”: { “blob-cache-size”: “0KiB”, “blob-file-compression”: “lz4”, “blob-run-mode”: “read-only”, “discardable-ratio”: 0.5, “level-merge”: false, “max-gc-batch-size”: “64MiB”, “max-sorted-runs”: 20, “merge-small-file-threshold”: “8MiB”, “min-blob-size”: “1KiB”, “min-gc-batch-size”: “16MiB”, “range-merge”: true }, “use-bloom-filter”: true, “whole-key-filtering”: true, “write-buffer-size”: “128MiB”+ “checksum”: “crc32c”+ “format-version”: 2+ “max-compactions”: 0+ “prepopulate-block-cache”: “disabled” }, “rate-bytes-per-sec”: “10GiB”, “rate-limiter-auto-tuned”: true, “rate-limiter-mode”: 2, “rate-limiter-refill-period”: “100ms”, “stats-dump-period”: “10m”, “titan”: { “dirname”: “”, “disable-gc”: false, “enabled”: false, “max-background-gc”: 4, “purge-obsolete-files-period”: “10s” }, “use-direct-io-for-flush-and-compaction”: false, “wal-bytes-per-sync”: “512KiB”, “wal-dir”: “”, “wal-recovery-mode”: 2, “wal-size-limit”: “0KiB”, “wal-ttl-seconds”: 0, “writable-file-max-buffer-size”: “1MiB”, “writecf”: { “block-based-bloom-filter”: false,- “block-cache-size”: “4941MiB”,+ “block-cache-size”: “4825MiB”,- “block-size”: “64KiB”,+ “block-size”: “32KiB”, “bloom-filter-bits-per-key”: 10, “bottommost-level-compression”: “zstd”, “bottommost-zstd-compression-dict-size”: 0, “bottommost-zstd-compression-sample-size”: 0, “cache-index-and-filter-blocks”: true, “compaction-guard-max-output-file-size”: “128MiB”, “compaction-guard-min-output-file-size”: “8MiB”, “compaction-pri”: 3, “compaction-style”: 0, “compression-per-level”: [ : “no”, : “no”, : “lz4”, : “lz4”, : “lz4”, : “zstd”, : “zstd” ], “disable-auto-compactions”: false, “disable-block-cache”: false, “disable-write-stall”: true, “dynamic-level-bytes”: true, “enable-compaction-guard”: true, “enable-doubly-skiplist”: true, “force-consistency-checks”: false, “hard-pending-compaction-bytes-limit”: “1TiB”, “level0-file-num-compaction-trigger”: 4, “level0-slowdown-writes-trigger”: 20, “level0-stop-writes-trigger”: 20, “max-bytes-for-level-base”: “512MiB”, “max-bytes-for-level-multiplier”: 10, “max-compaction-bytes”: “2GiB”, “max-write-buffer-number”: 5, “min-write-buffer-number-to-merge”: 1, “num-levels”: 7, “optimize-filters-for-hits”: false, “pin-l0-filter-and-index-blocks”: true, “prop-keys-index-distance”: 40960, “prop-size-index-distance”: 4.194304e+06, “read-amp-bytes-per-bit”: 0, “soft-pending-compaction-bytes-limit”: “192GiB”,- “target-file-size-base”: “8MiB”,+ “target-file-size-base”: null, “titan”: { “blob-cache-size”: “0KiB”, “blob-file-compression”: “lz4”, “blob-run-mode”: “read-only”, “discardable-ratio”: 0.5, “level-merge”: false, “max-gc-batch-size”: “64MiB”, “max-sorted-runs”: 20, “merge-small-file-threshold”: “8MiB”, “min-blob-size”: “1KiB”, “min-gc-batch-size”: “16MiB”, “range-merge”: true }, “use-bloom-filter”: true, “whole-key-filtering”: false, “write-buffer-size”: “128MiB”+ “checksum”: “crc32c”+ “format-version”: 2+ “max-compactions”: 0+ “prepopulate-block-cache”: “disabled” }+ “allow-concurrent-memtable-write”: true+ “write-buffer-limit”: null }, “security”: { “ca-path”: “”, “cert-allowed-cn”: [ ], “cert-path”: “”, “encryption”: { “data-encryption-method”: “plaintext”, “data-key-rotation-period”: “7d”, “enable-file-dictionary-log”: true, “file-dictionary-rewrite-threshold”: 1e+06, “master-key”: { “type”: “plaintext” }, “previous-master-key”: { “type”: “plaintext” } }, “key-path”: “”, “redact-info-log”: null }, “server”: {- “addr”: “127.0.0.1:20160”,+ “addr”: “127.0.0.1:33200”,- “advertise-addr”: “127.0.0.1:20160”,+ “advertise-addr”: “127.0.0.1:33200”,- “advertise-status-addr”: “127.0.0.1:20180”,+ “advertise-status-addr”: “127.0.0.1:35014”, “background-thread-count”: 2, “concurrent-recv-snap-limit”: 32, “concurrent-send-snap-limit”: 32, “enable-request-batch”: true, “end-point-batch-row-limit”: 64, “end-point-enable-batch-if-possible”: true, “end-point-max-concurrency”: 16, “end-point-perf-level”: 0, “end-point-recursion-limit”: 1000, “end-point-request-max-handle-duration”: “1m”, “end-point-slow-log-threshold”: “1s”, “end-point-stream-batch-row-limit”: 128, “end-point-stream-channel-size”: 8, “forward-max-connections-per-address”: 4, “grpc-compression-type”: “none”, “grpc-concurrency”: 5, “grpc-concurrent-stream”: 1024, “grpc-keepalive-time”: “10s”, “grpc-keepalive-timeout”: “3s”, “grpc-memory-pool-quota”: “9223372036854775807B”, “grpc-raft-conn-num”: 1, “grpc-stream-initial-window-size”: “2MiB”, “heavy-load-threshold”: 75, “heavy-load-wait-duration”: null, “labels”: { }, “max-grpc-send-msg-len”: 1.048576e+07, “raft-client-grpc-send-msg-buffer”: 524288, “raft-client-queue-size”: 8192, “raft-msg-max-batch-size”: 128, “reject-messages-on-memory-ratio”: 0.2, “simplify-metrics”: false, “snap-max-total-size”: “0KiB”,- “snap-max-write-bytes-per-sec”: “100MiB”, “stats-concurrency”: 1,- “status-addr”: “127.0.0.1:20180”,+ “status-addr”: “127.0.0.1:35014”, “status-thread-pool-size”: 1+ “grpc-gzip-compression-level”: 2+ “grpc-min-message-size-to-compress”: 4096+ “snap-io-max-bytes-per-sec”: “100MiB” }, “slow-log-file”: “”, “slow-log-threshold”: “1s”, “split”: { “byte-threshold”: 3.145728e+07, “detect-ti


发布于: 刚刚阅读数: 3
用户头像

TiDB 社区官网:https://tidb.net/ 2021-12-15 加入

TiDB 社区干货传送门是由 TiDB 社区中布道师组委会自发组织的 TiDB 社区优质内容对外宣布的栏目,旨在加深 TiDBer 之间的交流和学习。一起构建有爱、互助、共创共建的 TiDB 社区 https://tidb.net/

评论

发布
暂无评论
TiDB 升级利器(参数对比)——TiDBA_7.x 实践_TiDB 社区干货传送门_InfoQ写作社区