一个 39.3T 的集群从 TiDB v3.1.0 迁移升级到 TiDB v7.1.2 的实践

作者：TiDB 社区干货传送门

2023-12-29
北京
本文字数：3161 字
阅读完需：约 10 分钟

作者： xingzhenxiang 原文来源：https://tidb.net/blog/0629c299

集群目前情况

数据 39.3T

tidb 版本

数据导出方式选择

1、BR 这个版本刚开始支持，不知道有什么未知 bug，暂时没有选择

2、逻辑导出，首先考虑同版本发行对应的 mydumper，出现 tidb server 内存耗尽，放弃

3、最后选择 dumpling v7.1.2，看文档说事兼容以前版本

导出命令

./dumpling -u root -ppassword -h 10.10.110.47 -P3306 -f 'mydatabase.*' --tidb-mem-quota-query=1073741824  --filetype sql -t 24 -o /data/backup -r 200000 -F256MiB  -L  /tmp/dumplinglog.txt

复制代码

注意密码需要显示配置，否则会报如下错

Release version: v7.1.2Git commit hash: aa6ed99ae63191bc98e883fd4c369ae7482cccb7Git branch:      heads/refs/tags/v7.1.2Build timestamp: 2023-10-21 07:38:45ZGo version:      go version go1.20.10 linux/amd64meet some unparsed arguments, please check again: [10.10.110.47]

复制代码

导入测试

1、逻辑导入

导入配置文件

[lightning]region-concurrency = 14# 日志level = "info"file = "tidb-lightning.log"max-size = 256 # MBmax-days = 28max-backups = 14
# 启动之前检查集群是否满足最低需求。check-requirements = true
[mydumper]# 本地源数据目录或外部存储 URLdata-source-dir = "/data/backup"
[checkpoint]# 是否启用断点续传。# 导入数据时，TiDB Lightning 会记录当前表导入的进度。# 所以即使 TiDB Lightning 或其他组件异常退出，在重启时也可以避免重复再导入已完成的数据。enable = true# 存储断点的数据库名称。schema = "tidb_lightning_checkpoint"# 存储断点的方式。#  - file：存放在本地文件系统。#  - mysql：存放在兼容 MySQL 的数据库服务器。driver = "file"
# dsn 是数据源名称 (data source name)，表示断点的存放位置。# 若 driver = "file"，则 dsn 为断点信息存放的文件路径。#若不设置该路径，则默认存储路径为“/tmp/CHECKPOINT_SCHEMA.pb”。# 若 driver = "mysql"，则 dsn 为“用户:密码@tcp(地址:端口)/”格式的 URL。# 若不设置该 URL，则默认会使用 [tidb] 部分指定的 TiDB 服务器来存储断点。# 为减少目标 TiDB 集群的压力，建议指定另一台兼容 MySQL 的数据库服务器来存储断点。# dsn = "/tmp/tidb_lightning_checkpoint.pb"
# 所有数据导入成功后是否保留断点。设置为 false 时为删除断点。# 保留断点有利于进行调试，但会泄漏关于数据源的元数据。# keep-after-success = false
[tikv-importer]# 导入模式配置，设为 tidb 即使用 Logical Import Modebackend = "tidb"
# Logical Import Mode 插入重复数据时执行的操作。# - replace：新数据替代已有数据# - ignore：保留已有数据，忽略新数据# - error：中止导入并报错on-duplicate = "replace"
[tidb]# 目标集群的信息。tidb-server 的地址，填一个即可。host = "10.21.109.11"port = 3306user = "root"# 设置连接 TiDB 的密码，可为明文或 Base64 编码。password = ""# tidb-lightning 引用了 TiDB 库，并生成产生一些日志。# 设置 TiDB 库的日志等级。log-level = "error"sql-mode = "ONLY_FULL_GROUP_BY,NO_ENGINE_SUBSTITUTION"

复制代码

遇到问题

报错内容，考虑导入并发参数过大，所以修改并发参数为 cpu 的 75%（region-concurrency = 42，第三次调整为 32, 第四次调整为 24，第五次调整为 14 就不报错了）

[2023/11/23 10:59:05.172 +08:00] [ERROR] [tidb.go:708] [“execute statement failed”] [rows=“[”] [error=“Error 9005 (HY000): Region is unavailable”][2023/11/23 10:59:05.172 +08:00] [ERROR] [tidb.go:708] [“execute statement failed”] [rows=“[)]”] [stmt=“REPLACE INTO db.table VALUES()”] [error=“Error 9005 (HY000): Region is unavailable”]

复制代码

2、物理导入

物理导入配置文件（只有一个 lightning 导入）

[lightning]# 日志level = "info"file = "tidb-lightning.log"max-size = 256 # MBmax-days = 28max-backups = 14
# 启动之前检查集群是否满足最低需求。check-requirements = true
[mydumper]# 本地源数据目录或外部存储 URI。关于外部存储 URI 详情可参考 https://docs.pingcap.com/zh/tidb/v6.6/backup-and-restore-storages#uri-%E6%A0%BC%E5%BC%8F。data-source-dir = "/data/backup"
[tikv-importer]# 导入模式配置，设为 local 即使用物理导入模式incremental-import = truedisk-quota = "200GB"backend = "local"
# 冲突数据处理方式duplicate-resolution = 'remove'
# 本地进行 KV 排序的路径。sorted-kv-dir = "/localimport/tempdata"
# 限制 TiDB Lightning 向每个 TiKV 节点写入的带宽大小，默认为 0，表示不限制。# store-write-bwlimit = "128MiB"
# 物理导入模式是否通过 SQL 方式添加索引。默认为 `false`，表示 TiDB Lightning 会将行数据以及索引数据都编码成 KV pairs 后一同导入 TiKV，实现机制和历史版本保持一致。如果设置为 `true`，即 TiDB Lightning 会导完数据后，再使用 add index 的 SQL 来添加索引。# 通过 SQL 方式添加索引的优点是将导入数据与导入索引分开，可以快速导入数据，即使导入数据后，索引添加失败，也不会影响数据的一致性。# add-index-by-sql = false
[tidb]# 目标集群的信息。tidb-server 的地址，填一个即可。host = "10.21.109.11"port = 3306user = "root"# 设置连接 TiDB 的密码，可为明文或 Base64 编码。password = ""# 必须配置。表结构信息从 TiDB 的“status-port”获取。status-port = 10080# 必须配置。pd-server 的地址，填一个即可。pd-addr = "10.21.109.11:2379"# tidb-lightning 引用了 TiDB 库，并生成产生一些日志。# 设置 TiDB 库的日志等级。log-level = "error"
[post-restore]# 配置是否在导入完成后对每一个表执行 `ADMIN CHECKSUM TABLE <table>` 操作来验证数据的完整性。# 可选的配置项：# - "required"（默认）。在导入完成后执行 CHECKSUM 检查，如果 CHECKSUM 检查失败，则会报错退出。# - "optional"。在导入完成后执行 CHECKSUM 检查，如果报错，会输出一条 WARN 日志并忽略错误。# - "off"。导入结束后不执行 CHECKSUM 检查。# 默认值为 "required"。从 v4.0.8 开始，checksum 的默认值由此前的 "true" 改为 "required"。## 注意：# 1. Checksum 对比失败通常表示导入异常（数据丢失或数据不一致），因此建议总是开启 Checksum。# 2. 考虑到与旧版本的兼容性，依然可以在本配置项设置 `true` 和 `false` 两个布尔值，其效果与 `required` 和 `off` 相同。checksum = "required"# 配置是否在 CHECKSUM 结束后对所有表逐个执行 `ANALYZE TABLE <table>` 操作。# 此配置的可选配置项与 `checksum` 相同，但默认值为 "optional"。analyze = "optional"

复制代码

遇到问题

正常现象相关解释（https://asktug.com/t/topic/1018802/1）

meet error and handle the job laterput job back to jobCh to retry laterBR:Restore:ErrRestoreSplitFailed]fail to split region

复制代码

导入测试结果对比

逻辑导入（导入时长 14 天）

物理导入（导入时长 4 天）

数据记录 count(*) 两种方式是一样的

物理导入压缩比更高，导入时长更短，为啥不直接使用物理导入，因为官网限制说明有歧义，一个说单表一个说单实例，只能自己测试验证一下，还有一个原因就是我这是单库数据量为 17.30T（sql 文件）

正式导入

配置 mysql 二进制日志周期为 30 天，采用 lighting 物理导入方式导入，导入完后同步增量数据到最新。

版本信息

验证数据

select count（*）from table_xxx where create_date_time<‘2012-12-25’

所有重要表验证完毕，任务完成

发布于: 刚刚阅读数: 2

原文链接:【http://xie.infoq.cn/article/cf53746c1dd20cddae7d82be3】。文章转载请联系作者。

TiDB 社区干货传送门

关注

TiDB 社区官网:https://tidb.net/ 2021-12-15 加入

TiDB 社区干货传送门是由 TiDB 社区中布道师组委会自发组织的 TiDB 社区优质内容对外宣布的栏目，旨在加深 TiDBer 之间的交流和学习。一起构建有爱、互助、共创共建的 TiDB 社区 https://tidb.net/

发布

暂无评论

{ "code": 0, "data": { "list": [ { "icon": "", "id": 0, "link": "https://xie.infoq.cn/square/10", "name": "活动🔥", "type": 2 }, { "icon": "", "id": 3, "link": "", "name": "Java", "type": 1 }, { "icon": "", "id": 211, "link": "", "name": "开源", "type": 1 }, { "icon": "", "id": 238, "link": "", "name": "架构", "type": 1 }, { "icon": "", "id": 9434, "link": "", "name": "OpenHarmony", "type": 1 }, { "icon": "", "id": 303, "link": "", "name": "算法", "type": 1 }, { "icon": "", "id": 14135, "link": "", "name": "元宇宙", "type": 1 }, { "icon": "", "id": 84, "link": "", "name": "MySQL", "type": 1 }, { "icon": "", "id": 5237, "link": "", "name": "移动开发", "type": 1 }, { "icon": "", "id": 221, "link": "", "name": "学习方法", "type": 1 }, { "icon": "", "id": 221, "link": "", "name": "学习方法", "type": 1 }, { "icon": "", "id": 17178, "link": "", "name": "Web3.0", "type": 1 }, { "icon": "", "id": 203, "link": "", "name": "高效工作", "type": 1 }, { "icon": "", "id": 92, "link": "", "name": "数据库", "type": 1 }, { "icon": "", "id": 8, "link": "", "name": "Python", "type": 1 }, { "icon": "", "id": 661, "link": "", "name": "音视频", "type": 1 }, { "icon": "", "id": 371, "link": "", "name": "前端", "type": 1 }, { "icon": "", "id": 242, "link": "", "name": "AI", "type": 1 }, { "icon": "", "id": 143, "link": "", "name": "大数据", "type": 1 }, { "icon": "", "id": 204, "link": "", "name": "团队管理", "type": 1 }, { "icon": "", "id": 232, "link": "", "name": "程序员", "type": 1 }, { "icon": "", "id": 317, "link": "", "name": "运维", "type": 1 }, { "icon": "", "id": 200, "link": "", "name": "深度思考", "type": 1 }, { "icon": "", "id": 1081, "link": "", "name": "低代码", "type": 1 }, { "icon": "", "id": 97, "link": "", "name": "redis", "type": 1 }, { "icon": "", "id": 19, "link": "", "name": "golang", "type": 1 }, { "icon": "", "id": 294, "link": "", "name": "微服务架构", "type": 1 }, { "icon": "", "id": 21, "link": "", "name": "flutter", "type": 1 } ] }, "error": { }, "extra": { "cost": 0.000625478, "request-id": "1dfc18ea9bbe427f9b9f11f1f9672c1f@3@xie" } }

{ "code": 0, "data": { "bot": [ { "list": [ { "name": "关于我们", "link": "https://www.infoq.cn/about", "image": "" }, { "name": "我要投稿", "link": "https://www.infoq.cn/contribute", "image": "" }, { "name": "合作伙伴", "link": "https://www.geekbang.org/partner", "image": "" }, { "name": "加入我们", "link": "https://www.lagou.com/gongsi/j43775.html", "image": "" }, { "name": "关注我们", "link": "https://infoq.cn/official/account", "image": "" } ], "name": "InfoQ" }, { "list": [ { "name": "内容投稿：editors@geekbang.com", "link": "mailto:editors@geekbang.com", "image": "" }, { "name": "业务合作：hezuo@geekbang.com", "link": "mailto:hezuo@geekbang.com", "image": "" }, { "name": "反馈投诉：feedback@geekbang.com", "link": "mailto:feedback@geekbang.com", "image": "" }, { "name": "加入我们：zhaopin@geekbang.com", "link": "mailto:zhaopin@geekbang.com", "image": "" }, { "name": "联系电话：18600430890", "link": "", "image": "" }, { "name": "地址：北京市朝阳区望京北路9号2幢7层A701", "link": "", "image": "" } ], "name": "联系我们" }, { "list": [ { "name": "ArchSummit全球架构师峰会 2023年3月17-18日", "link": "https://archsummit.infoq.cn/202303/beijing/?utm_source=infoq&utm_medium=footer", "image": "https://static001.infoq.cn/resource/image/62/f5/628b5e750e918f52cda61a19fdc186f5.png" }, { "name": "ArchSummit全球架构师峰会 2023年4月21-22日", "link": "https://archsummit.infoq.cn/2023/shanghai/?utm_source=infoq&utm_medium=footer", "image": "https://static001.infoq.cn/resource/image/68/86/682e88b72d998d472686410a05c67986.png" }, { "name": "QCon全球软件开发大会 2023年5月26-27日", "link": "https://qcon.infoq.cn/2023/guangzhou/?utm_source=infoq&utm_medium=footer", "image": "https://static001.infoq.cn/resource/image/b5/8c/b5214dd411ae938ab2ddfb504e7d078c.png" } ], "name": "InfoQ 近期会议" }, { "list": [ { "name": "InfoQ En", "link": "https://www.infoq.com/", "image": "https://static001.infoq.cn/resource/image/55/38/55cd81623e36f5ab7a7db74d60b74838.png" }, { "name": "InfoQ Jp", "link": "https://www.infoq.com/jp/", "image": "https://static001.infoq.cn/resource/image/95/13/95fe851c02c86120e9037eada6a36d13.png" }, { "name": "InfoQ Fr", "link": "http://www.infoq.com/fr/", "image": "https://static001.infoq.cn/resource/image/2a/3e/2aa440b6d94e94f64c508f16da38933e.png" }, { "name": "InfoQ Br", "link": "http://www.infoq.com/br/", "image": "https://static001.infoq.cn/resource/image/4e/1e/4e737ce82bc7c8a1c2f2307bcea9a11e.png" } ], "name": "全球 InfoQ" } ], "bus": [ { "end_time": 1703865599, "img": "https://static001.infoq.cn/resource/image/db/3c/db58e00a7fc616fcdd32c777726b6c3c.jpg", "link": "https://qcon.infoq.cn/2023/shanghai?utm_source=infoqweb&utm_medium=huodongdabenying", "location": "上海", "name": "QCon 上海 2023", "start_time": 1703692800 }, { "end_time": 1702483200, "img": "https://static001.infoq.cn/resource/image/06/ff/06730d2377fa0677cd103e11f3409dff.png", "link": "https://www.infoq.cn/form/?id=1862&utm_source=1&sign=iq_652681f86704a", "location": "线上", "name": "《云上新视界》火山引擎视频云系列公开课", "start_time": 1701273600 }, { "end_time": 1703952000, "img": "https://static001.infoq.cn/resource/image/8b/ed/8b130ca27d9c71d61e3f766eff44d1ed.jpeg", "link": "https://github.com/orgs/secretflow/discussions/1007", "location": "线上", "name": "隐语开源共建计划 OSCP 第三期", "start_time": 1700064000 }, { "end_time": 1703260799, "img": "https://static001.infoq.cn/resource/image/3a/b8/3a54e625d4c5bef52ee34822dcf09eb8.jpg", "link": "https://aistudio.baidu.com/competition/detail/1073/0/introduction", "location": "线上", "name": "飞桨黑客马拉松第五期", "start_time": 1695571200 }, { "end_time": 1702137599, "img": "https://static001.infoq.cn/resource/image/b6/af/b6f6e813aae99c579c1617b41274e5af.jpg", "link": "https://www.infoq.cn/form/?id=1928&utm_source=web&sign=iq_655ec0806c6d5", "location": "线下", "name": "2023全球AI前沿科技大会", "start_time": 1702051200 }, { "end_time": 1701273600, "img": "https://static001.infoq.cn/resource/image/fa/2e/fa9e3975a19e07e20684ce166116ec2e.png", "link": "https://www.infoq.cn/event/?id=276&utm_source=hddby&sign=iq_654dacd3d53a5", "location": "线上", "name": "【有奖征文】赢取丰厚稿酬 11-30 线上", "start_time": 1699545600 }, { "end_time": 1702742400, "img": "https://static001.infoq.cn/resource/image/20/db/206b8a3dyyf45d3b9d2b25d8d66d83db.jpg", "link": "https://aistudio.baidu.com/competition/detail/1103/0/introduction", "location": "首钢园创新中心D座", "name": "飞桨 x 文心大模型大模型黑客松", "start_time": 1700496000 }, { "end_time": 1697903999, "img": "https://static001.infoq.cn/resource/image/6f/91/6fa11c8f3550ccf09bd47c32da187a91.jpg", "link": "https://doris-summit.org.cn/?utm_source=InfoQ&utm_medium=banner&utm_id=2023", "location": "北京·丽亭华苑酒店", "name": "Doris Summit Asia 2023：与创新者同行", "start_time": 1697817600 }, { "end_time": 1695311999, "img": "https://static001.infoq.cn/resource/image/21/55/21e55fc4b6775544e13f7683a8118f55.png", "link": "https://www.infoq.cn/minibook/Iwk2LLuMFSV4AisWG8jR", "location": "线上", "name": "互联网行业再进化——云上AI时代", "start_time": 1695225600 }, { "end_time": 1701359999, "img": "https://static001.infoq.cn/resource/image/0d/ab/0dc1c972f72decab4eaea377238e7dab.jpg", "link": "https://cloud.baidu.com/qianfandev/bac?track=infoq", "location": "线上", "name": "百度智能云千帆大模型平台应用开发挑战赛", "start_time": 1694966400 }, { "end_time": 1695657599, "img": "https://static001.infoq.cn/resource/image/47/20/472634d97a6a5e980f9d3e3261cd9520.jpg", "link": "https://cn.selectdb.com/events/1", "location": "线上", "name": "新内核新图景 - 飞轮科技全系产品发布会", "start_time": 1695571200 }, { "end_time": 1695571199, "img": "https://static001.infoq.cn/resource/image/65/bf/657e16d927a221653d2c9cd7byy11fbf.png", "link": "https://hdxu.cn/c1Jg6", "location": "上海", "name": "MatrixOne Meetup", "start_time": 1695484800 }, { "end_time": 1698508799, "img": "https://static001.infoq.cn/resource/image/38/cd/387a0735e11d8ed6a39270aa93f27bcd.jpeg", "link": "https://www.paddlepaddle.org.cn/PaddlePaddleFoundathon-2023-8", "location": "线上", "name": "AGI Foundathon大模型创业松", "start_time": 1698422400 }, { "end_time": 1693324800, "img": "https://static001.infoq.cn/resource/image/ae/3d/ae7d0247fda95f8fe60645ff6dff4a3d.jpg", "link": "https://www.infoq.cn/event/?id=273", "location": "线上", "name": "Geekathon 大模型技术应用创新大赛", "start_time": 1688054400 }, { "end_time": 1695139199, "img": "https://static001.infoq.cn/resource/image/c8/2d/c8a645e0632d33293b7f2bd8068fa12d.jpg", "link": "https://live.polyv.cn/watch/4175199?promoteId=LgSt21", "location": "线上", "name": "9.19 青云科技 AI 算力发布会", "start_time": 1695052800 }, { "end_time": 1695398400, "img": "https://static001.infoq.cn/resource/image/40/9b/4099a26e6400d52ffae41e1354b7729b.jpg", "link": "https://season-share.7-event.cn/FormTemplate/index.html#/?formID=368&showID=10458&trace_code=MW9ibpqQFva4", "location": "广州", "name": "数聚·源力 2023PRO_大会", "start_time": 1693238400 }, { "end_time": 1694015999, "img": "https://static001.infoq.cn/resource/image/65/45/65079701ba555721b6bd01c527586c45.jpg", "link": "https://www.infoq.cn/form/?id=1777&utm_source=hd&sign=iq_64e886900c011", "location": "线上", "name": "存储难题新解法揭秘极致易用的HBlock", "start_time": 1693324800 }, { "end_time": 1693583999, "img": "https://static001.infoq.cn/resource/image/a6/11/a6007122e73b33144c2989075dc22311.png", "link": "https://www.infoq.cn/form/?id=1769&utm_source=5&sign=iq_64db3b0ef25e1", "location": "深圳", "name": "APP开发者个人信息保护培训宣讲会·深圳站", "start_time": 1693497600 }, { "end_time": 1692719999, "img": "https://static001.infoq.cn/resource/image/01/79/01c91f1230ce7b4e9e8dbe816d3ee879.jpg", "link": "https://volcengine2023.cevent.com.cn/VideoCloud&AIGC.html?s=infoQ", "location": "线上", "name": "火山引擎视频云&AIGC技术大会", "start_time": 1692633600 }, { "end_time": 1693929599, "img": "https://static001.infoq.cn/resource/image/7b/f6/7b0291ea5e4f9f088ffa2630fe3711f6.png", "link": "https://qcon.infoq.cn/202309/beijing?utm_source=infoqweb&utm_medium=homehdbanner&utm_campaign=8&utm_term=0607", "location": "北京", "name": "启航·AIGC软件工程变革", "start_time": 1693670400 }, { "end_time": 1693497599, "img": "https://static001.infoq.cn/resource/image/d4/57/d498e5cbf950ae00a3babf87384fab57.jpg", "link": "https://www.infoq.cn/event/?id=271&utm_source=6&sign=iq_64bddefbaa31b", "location": "线上", "name": "2小时学会10个组件“取代”传统Java开发", "start_time": 1690128000 }, { "end_time": 1691510400, "img": "https://static001.infoq.cn/resource/image/4d/59/4de42267c4daf12130d7901892b2a759.jpg", "link": "https://www.infoq.cn/form/?id=1746&utm_source=4&sign=iq_64c9f1e213e56", "location": "线上", "name": "大模型时代的 AI 基础设施——百度AI大底座", "start_time": 1690905600 }, { "end_time": 1693238399, "img": "https://static001.infoq.cn/resource/image/d2/70/d289a3fde03151ddc21e9a134a843b70.png", "link": "https://sf.163.com/lcapcompetition?fromnsf=qzzu_SELF_INFO_m_infoq_23ddmdsinfoq", "location": "线上", "name": "2023网易低代码大赛", "start_time": 1686844800 }, { "end_time": 1684252799, "img": "https://static001.infoq.cn/resource/image/59/8b/59c58407651ca6275a3c3b7f40db318b.jpg", "link": "https://live.infoq.cn/room/1758?utm_source=infoq-web&utm_medium=rightbanner", "location": "线上", "name": "金融企业的数字化转型秘钥", "start_time": 1684166400 }, { "end_time": 1683993599, "img": "https://static001.infoq.cn/resource/image/72/13/7270cf7fb9782b02550cf3291d43a513.jpg", "link": "https://www.infoq.cn/event/?id=262&utm_source=guanwang&sign=iq_6440e2058c94b", "location": "北京", "name": "出海领航｜数据战略创新驱动业务增长", "start_time": 1683907200 }, { "end_time": 1682870399, "img": "https://static001.infoq.cn/resource/image/e1/99/e1eabe46d33074c03b3f91b0c9939999.jpg", "link": "https://www.infoq.cn/minibook/Is534v4mBvUmgC1uJEdc", "location": "线上", "name": "腾讯大规模云原生技术实践案例集", "start_time": 1679932800 }, { "end_time": 1679500799, "img": "https://static001.infoq.cn/resource/image/d4/d0/d451e80da1422c401c7c69a64a7791d0.jpg", "link": "https://www.nvidia.cn/gtc-global/sessions/china-ai-day/?ncid=pa-dis-othe-205289", "location": "线上", "name": "GTC 大会热门会议精选", "start_time": 1679414400 }, { "end_time": 1682870399, "img": "https://static001.infoq.cn/resource/image/30/25/3012263d0391f1d6eb801ff836639025.jpg", "link": "https://www.industrial-bigdata.com/Competition", "location": "线上", "name": "大数据建模预测技术实赛演练正在进行中！", "start_time": 1676390400 }, { "end_time": 1672156799, "img": "https://static001.infoq.cn/resource/image/bf/33/bf86f775aa09a22d6e87d0462449b633.jpg", "link": "https://dev.amazoncloud.cn/activity/activityDetail?id=63959a6132e83b0359766ff9", "location": "线上", "name": "数据与机器学习：面向未来的数据战略", "start_time": 1672070400 }, { "end_time": 1671551999, "img": "https://static001.infoq.cn/resource/image/d1/7a/d1dc55ef96919aa6286767a0e31f137a.jpg", "link": "https://www.awsevents.cn/reInvent2022/roving-exhibition.aspx?code=b29c46ea7b874cbb8310b53921670f9e&s=7982&smid=15648", "location": "北京", "name": "构建者之夜：用一朵云探索技术新边界", "start_time": 1671465600 }, { "end_time": 1668787199, "img": "https://static001.infoq.cn/resource/image/d4/3e/d414d2f3c0feb7cae2a32803c9b1953e.jpg", "link": "https://www.infoq.cn/form/?id=1265", "location": "线上", "name": "《中国企业数智化创新TOP50 》", "start_time": 1667750400 }, { "end_time": 1681833599, "img": "https://static001.infoq.cn/resource/image/69/f1/694cc0a66b82c55216fe5be7b575e5f1.jpg", "link": "https://www.volcengine.com/event/force-spring?utm_source=social&utm_medium=chuanbo_nocontact&utm_term=infoq&utm_campaign=20230418&utm_content=springforce", "location": "线上", "name": "2023春季火山引擎FORCE原动力大会", "start_time": 1681747200 }, { "end_time": 1682524799, "img": "https://static001.infoq.cn/resource/image/11/f0/11ce3bc00389596a57d09fa9873900f0.jpg", "link": "https://www.infoq.cn/event/?id=264&utm_source=hddby&sign=iq_643e136988c34", "location": "杭州", "name": "蚂蚁集团数字科技开发者大会 · 2023", "start_time": 1682438400 }, { "end_time": 1681919999, "img": "https://static001.infoq.cn/resource/image/30/50/30979d04a9b03377ddbcd01a1f1d1850.jpg", "link": "https://www.infoq.cn/event/?id=263", "location": "北京", "name": "OpenHarmony 开发者大会 2023", "start_time": 1681833600 }, { "end_time": 1672156799, "img": "https://static001.infoq.cn/resource/image/c3/cd/c3af01a108dbdbc66127843a61531dcd.jpg", "link": "https://app.jingsocial.com/microFrontend/leadGeneration/jsf-leads/list/webinar/AF8YFe4LVVkzAoL8GTTi9Y/dPFWGd7HbwrT3khbgPfKum", "location": "线上", "name": "研发效率提升与可观测体系建设", "start_time": 1672070400 }, { "end_time": 1667923199, "img": "https://static001.infoq.cn/resource/image/2e/7a/2ef2160e5b4a15yy92bc1b84b358yy7a.jpeg", "link": "https://services.google.cn/fb/forms/1108next22/?channel=infoq", "location": "线上", "name": "Google Cloud Next 中文精选课", "start_time": 1667836800 }, { "end_time": 1667577599, "img": "https://static001.infoq.cn/resource/image/87/cd/873bf0e3965bba90601449aea4f4c3cd.jpg", "link": "https://www.huaweicloud.com/lab/data/luntan.html", "location": "杭州", "name": "华为云数智高峰论坛", "start_time": 1667491200 }, { "end_time": 1667491200, "img": "https://static001.infoq.cn/resource/image/9b/53/9bb2b6dd90f2083d809e7d2b67cbb453.jpg", "link": "https://www.bagevent.com/event/sales/kdxhshikk7fixlcaf4rg9uqxf6qmwr34", "location": "线上", "name": "RTE2022 第八届实时互联网大会", "start_time": 1667232000 }, { "end_time": 1667577600, "img": "https://static001.infoq.cn/resource/image/c9/97/c9abc8ef3298c095f13689741f428497.jpg", "link": "https://openanolis.cn/summitMeeting", "location": "杭州云栖小镇国际会展", "name": "2022云栖大会龙蜥操作系统峰会", "start_time": 1667404800 }, { "end_time": 1669737600, "img": "https://static001.infoq.cn/resource/image/01/3f/01dc280a768yy70f2aaa009c08f75d3f.jpeg", "link": "https://datayi.cn/w/GR4vgygo", "location": "线上", "name": "2022中国企业敏捷实践调研全面启动", "start_time": 1666281600 }, { "end_time": 1666799999, "img": "https://static001.infoq.cn/resource/image/5c/81/5c889ef6c2dfbf94c4f48b8e3f47e581.jpg", "link": "https://static001.geekbang.org/resource/image/37/cb/376438fe7496af1596dcd1e1bc6d8dcb.png", "location": "视频号", "name": "YMatrix 5.0 新品发布会", "start_time": 1666713600 }, { "end_time": 1665503999, "img": "https://static001.infoq.cn/resource/image/7d/7f/7d02690f3b83682719f69f36a47ba87f.png", "link": "https://home.netease.im/promotion/innovation2022", "location": "线上", "name": "网易云信 Innovation 2022 开发者大赛", "start_time": 1663776000 }, { "end_time": 1664035199, "img": "https://static001.infoq.cn/resource/image/40/93/4031be87ff4495608a4e8c72ed233c93.jpg", "link": "https://survey.aliyun.com/apps/zhiliao/-NasGL9m3", "location": "广州", "name": "OceanBase Meetup 广州站", "start_time": 1663516800 }, { "end_time": 1664035199, "img": "https://static001.infoq.cn/resource/image/45/74/4553ac06ae495382409c09489eb0e974.png", "link": "https://summitasia2022infoq.starrocks.com", "location": "线上", "name": "StarRocks Summit Asia 2022", "start_time": 1663948800 }, { "end_time": 1662047999, "img": "https://static001.infoq.cn/resource/image/b0/f4/b0b22daef32a0affa031f7d013057af4.png", "link": "https://datayi.cn/w/a9B3Z7wR", "location": "线上", "name": "企业服务行业研发管理解决方案发布会", "start_time": 1661961600 }, { "end_time": 1661270400, "img": "https://static001.infoq.cn/resource/image/5e/9e/5e86555d83a40c531919ec39e38b279e.jpg", "link": "https://opensource.alibaba.com/collection/osweek2022#asoc", "location": "线上", "name": "阿里巴巴开源开放周", "start_time": 1661097600 }, { "end_time": 1660665599, "img": "https://static001.infoq.cn/resource/image/69/bb/6921feca8052910ca9e0da42d9ca00bb.jpg", "link": "https://app.jingsocial.com/microFrontend/leadGeneration/jsf-leads/list/seminar/NStgRxTWXMFTfBRockKi54/n4C9K5FnnnJUyxTcH3LejM", "location": "北京", "name": "SUSECON 北京 2022", "start_time": 1660579200 }, { "end_time": 1663257599, "img": "https://static001.infoq.cn/resource/image/b9/54/b9de045280504b10eb7299d274df6154.jpg", "link": "https://www.infoq.cn/form/?id=1198&utm_source=gw&sign=iq_6319b6f8c9040", "location": "线上", "name": "Kyligence 2022 秋季线上论坛", "start_time": 1663171200 }, { "end_time": 1660406399, "img": "https://static001.infoq.cn/resource/image/95/99/955562245afddc63235e2054c619fe99.jpg", "link": "https://www.taosdata.com/events/tdcon2022?utm_source=infoq&utm_medium=event&utm_campaign=tdcon2022", "location": "北京", "name": "TDengine 开发者大会", "start_time": 1660320000 }, { "end_time": 1658937599, "img": "https://static001.infoq.cn/resource/image/b0/49/b0f8a4ce0e4b55048b07b9fa48c96e49.jpg", "link": "https://xie.infoq.cn/article/c6dcbcac25f3778008dc0a81d", "location": "线上", "name": "小红书技术对话", "start_time": 1658851200 }, { "end_time": 1658937599, "img": "https://static001.infoq.cn/resource/image/37/yy/37168630c2882711c56e74225ee5f2yy.jpg", "link": "https://mp.weixin.qq.com/s/i7rec4dYdAXI375saiZeQg", "location": "北京", "name": "2022开放原子全球开源峰会龙蜥专场", "start_time": 1658851200 }, { "end_time": 1658591999, "img": "https://static001.infoq.cn/resource/image/17/07/17ff78e333920ee4d44a7737c0779507.jpg", "link": "https://conf.juejin.cn/xdc2022/?utm_source=infoq#s2", "location": "线上", "name": "稀土开发者大会", "start_time": 1658419200 }, { "end_time": 1664380800, "img": "https://static001.infoq.cn/resource/image/2c/ff/2cc082a108813bf4cfe277c7da4a7aff.png", "link": "https://www.infoq.cn/event/?id=235", "location": "线上", "name": "飞桨黑客马拉松第三期", "start_time": 1656864000 }, { "end_time": 1656518399, "img": "https://static001.infoq.cn/resource/image/0b/0e/0b47b188aff652f7bc8b0bb8a33b940e.jpg", "link": "https://tapdata.net/tapdata-LDP-launch-event.html", "location": "线上", "name": "Tapdata LDP 产品发布暨开源说明会", "start_time": 1656432000 }, { "end_time": 1657382399, "img": "https://static001.infoq.cn/resource/image/52/22/52e48d297c5d725ec03e825ddcb81e22.png", "link": "https://mp.weixin.qq.com/s/pPafW2_wMprRh_RW1vlGWw", "location": "北京", "name": "ITCP联盟“架构”主题开放性大会", "start_time": 1657296000 }, { "end_time": 1656863999, "img": "https://static001.infoq.cn/resource/image/2y/7c/2yyaf4ba00f96b57c94ab8eb525bcc7c.jpg", "link": "https://xie.infoq.cn/article/be47a5e41e3b5c75ead7f1c00", "location": "线上", "name": "火山引擎开发者社区征文大赛", "start_time": 1654790400 }, { "end_time": 1656086399, "img": "https://static001.infoq.cn/resource/image/50/89/50a44a422e8b885c7e7f6f06ddc48389.jpg", "link": "https://www.infoq.cn/form/?id=1044&utm_source=hddby&sign=iq_62a80575c32cb", "location": "线上", "name": "面向体验的视频云-火山引擎增长沙龙", "start_time": 1656000000 }, { "end_time": 1655913599, "img": "https://static001.infoq.cn/resource/image/15/b9/15d8102b3f97e099a82d1010585338b9.jpg", "link": "https://www.infoq.cn/event/?id=227&utm_source=hd&sign=iq_62a0dbf6289a4", "location": "线上", "name": "2022 OpenCloudOS 社区开放日", "start_time": 1655827200 }, { "end_time": 1656604799, "img": "https://static001.infoq.cn/resource/image/fb/47/fbaae22a09682f707c102e2aa1311847.png", "link": "https://gitee.com/activity/9th/", "location": "线上", "name": "Gitee 9 周年，以有源之水，引万物生长", "start_time": 1653580800 }, { "end_time": 1653062399, "img": "https://static001.infoq.cn/resource/image/e0/ca/e0beyy709dd8b4d54cbb69103276e3ca.png", "link": "https://www.infoq.cn/event/?id=226&utm_source=hddby&sign=iq_627e147087158", "location": "北京", "name": "WAVE SUMMIT 2022 深度学习开发者峰会", "start_time": 1652976000 }, { "end_time": 1650038400, "img": "https://static001.infoq.cn/resource/image/2d/86/2db870b36b19f82218b537402b93ae86.jpg", "link": "https://dive.infoq.cn/2021/beijing", "location": "线上", "name": "DIVE 全球基础软件创新大会", "start_time": 1649952000 }, { "end_time": 1655567999, "img": "https://static001.infoq.cn/resource/image/39/c0/3929995e7d2032ca8bc280da55718fc0.jpg", "link": "https://www.infoq.cn/minibook/O8BNoAf7iKAGqKzmMJ2w", "location": "线上", "name": "超低延时直播白皮书下载", "start_time": 1654963200 }, { "end_time": 1649347199, "img": "https://static001.infoq.cn/resource/image/97/ff/97d4301eda24df6cf451d6d69a886cff.jpg", "link": "https://live.infoq.cn/room/1369", "location": "线上", "name": "《数据 Cool 谈》第4期", "start_time": 1649260800 }, { "end_time": 1649260799, "img": "https://static001.infoq.cn/resource/image/94/d2/94c1c28c2d0511f6e83d6df7d90d22d2.jpg", "link": "https://live.infoq.cn/room/1374", "location": "线上", "name": "头号云话题：进击的开源操作系统", "start_time": 1649174400 }, { "end_time": 1656086399, "img": "https://static001.infoq.cn/resource/image/26/c6/261e08b762b70634ce4ea332eebc11c6.jpg", "link": "https://www.infoq.cn/event/?id=220&utm_source=hd&sign=iq_6220daec95bce", "location": "北京", "name": "云数据库的架构设计与技术演进专场", "start_time": 1656000000 }, { "end_time": 1656086399, "img": "https://static001.infoq.cn/resource/image/30/92/30855fdd90ef86706c70bed295be0b92.jpg", "link": "https://www.infoq.cn/event/?id=219&utm_source=hd&sign=iq_6220d3a70dc6d", "location": "北京", "name": "企业云原生成本优化最佳实践专场", "start_time": 1656000000 }, { "end_time": 1641657600, "img": "https://static001.infoq.cn/resource/image/f8/88/f874b150cfc8e234fb382c222d6cfc88.png", "link": "https://developer.aliyun.com/special/ffa2021/live", "location": "线上", "name": "Flink Forward Asia 2021 峰会", "start_time": 1641571200 }, { "end_time": 1641484799, "img": "https://static001.infoq.cn/resource/image/a6/2b/a64c9b98dde31fe3850f93744720eb2b.jpg", "link": "https://live.infoq.cn/room/1267", "location": "线上", "name": "DC2021 分布式数据库开发者大会", "start_time": 1641398400 }, { "end_time": 1647964799, "img": "https://static001.infoq.cn/resource/image/24/b7/243eeb97ae454057f1c9560e7ce73ab7.jpg", "link": "https://www.infoq.cn/form/?id=881", "location": "线上", "name": "【参与有奖】Red Hat IDC 业务价值白皮书", "start_time": 1647273600 }, { "end_time": 1626624000, "img": "https://static001.infoq.cn/resource/image/8d/bd/8d43034b3b26906f8f0c68e100c574bd.jpg", "link": "https://www.infoq.cn/event/?id=184", "location": "线上", "name": "平安科技高校挑战赛", "start_time": 1623254400 }, { "end_time": 1576166399, "img": "https://static001.infoq.cn/resource/image/28/ae/283ae28141e197c05a69d7144011b1ae.jpg", "link": "https://www.geekbang.org/page/aws2019.html?utm_source=infoq&utm_medium=specialtopic", "location": "上海", "name": "亚马逊云科技技术专区", "start_time": 1576080000 }, { "end_time": 1574697599, "img": "https://static001.infoq.cn/resource/image/43/6d/43ac3623d95c0c0d2e98c04756c4d46d.jpg", "link": "https://www.infoq.cn/zones/talkingdata/2019/t11/", "location": "北京", "name": "T11数据智能峰会", "start_time": 1574611200 }, { "end_time": 1592668799, "img": "https://static001.infoq.cn/resource/image/77/56/77983803e1e48c2b822cb8fc00790d56.jpg", "link": "https://www.infoq.cn/zones/huawei/shengteng/", "location": "杭州", "name": "华为昇腾技术沙龙", "start_time": 1592582400 }, { "end_time": 1564761599, "img": "https://static001.infoq.cn/resource/image/c4/a7/c45a97169699bfd58a85b89292bfb0a7.jpg", "link": "https://www.infoq.cn/zones/intel/2019/ai.html?utm_campaign=2019_q4_dcg_ai&utm_source=infoq&utm_medium=display_banner&utm_content=ai", "location": "线上", "name": "Intel AI", "start_time": 1564675200 }, { "end_time": 1567871999, "img": "https://static001.infoq.cn/resource/image/0f/e5/0f7eeb8c8e828a1153bccd81be8fa7e5.jpg", "link": "https://www.infoq.cn/zones/huawei/cloudnativedays.html", "location": "南京", "name": "华为云 MeetUp", "start_time": 1567785600 }, { "end_time": 1543075199, "img": "https://static001.infoq.cn/resource/image/36/42/361cyy0d3345298ee32d91b3ab4e9442.jpg", "link": "https://www.geekbang.org/page/thunderchain.html", "location": "上海", "name": "迅雷链技术专区", "start_time": 1542988800 }, { "end_time": 1544889599, "img": "https://static001.infoq.cn/resource/image/73/ed/735d47d1144e550cce1d635bb48481ed.jpg", "link": "https://cloud.tencent.com/developer/conf/2018-beijing?channel=tbzt", "location": "北京", "name": "云+社区开发者大会", "start_time": 1544803200 }, { "end_time": 1611331199, "img": "https://static001.infoq.cn/resource/image/71/28/713c4225c9b2b6f76febd8b391631a28.jpg", "link": "https://www.infoq.cn/zones/huawei/cloud/", "location": "北京", "name": "华为云5G+X联创营", "start_time": 1611244800 }, { "end_time": 1607788799, "img": "https://static001.infoq.cn/resource/image/77/56/77983803e1e48c2b822cb8fc00790d56.jpg", "link": "https://www.infoq.cn/zones/huawei/devrun.html", "location": "珠海", "name": "华为云 DevRun 专区", "start_time": 1607702400 }, { "end_time": 1599148799, "img": "https://static001.infoq.cn/resource/image/46/ec/46fbffbf4fb530315eaa169ae7e5e6ec.jpg", "link": "https://www.infoq.cn/zones/microsoft/?utm_source=guanwang&utm_medium=0831", "location": "线上", "name": "微软技术专区", "start_time": 1599062400 }, { "end_time": 1639756799, "img": "https://static001.infoq.cn/resource/image/96/d8/964639b427776db5368ff2a173a043d8.jpg", "link": "https://www.infoq.cn/zones/baidu-salon/", "location": "北京", "name": "百度技术沙龙", "start_time": 1639670400 }, { "end_time": 1645977599, "img": "https://static001.infoq.cn/resource/image/3f/05/3fecb9e2d446abf609e9cf711e61db05.jpg", "link": "https://www.infoq.cn/zones/TechReview2021/", "location": "线上", "name": "2021 InfoQ 年度技术盘点与展望", "start_time": 1643040000 }, { "end_time": 1644076799, "img": "https://static001.infoq.cn/resource/image/72/7c/7294e60ebf8e5ae85d5730b5aaa7e27c.png", "link": "https://www.infoq.cn/event/?id=217&utm_source=gb&sign=iq_61f0b62007217", "location": "线上", "name": "2021中国数字经济灯塔奖获奖名单公布", "start_time": 1643040000 }, { "end_time": 1650988799, "img": "https://static001.infoq.cn/resource/image/30/92/30855fdd90ef86706c70bed295be0b92.jpg", "link": "https://www.infoq.cn/event/?id=219&utm_source=hd&sign=iq_6220d3a70dc6d", "location": "北京", "name": "企业云原生成本优化最佳实践专场·", "start_time": 1650902400 }, { "end_time": 1648742399, "img": "https://static001.infoq.cn/resource/image/3c/70/3cd7a69b044df8d2280da05344992a70.png", "link": "https://b.geekbang.org/con/dtds/202203/online?utm_source=infoq&utm_medium=event&utm_campaign=dtdslive&gk_source=2022031401infoqevent", "location": "线上", "name": "DTDS 全球数字人才发展线上峰会", "start_time": 1648656000 }, { "end_time": 1650988799, "img": "https://static001.infoq.cn/resource/image/26/c6/261e08b762b70634ce4ea332eebc11c6.jpg", "link": "https://www.infoq.cn/event/?id=220&utm_source=hd&sign=iq_6220daec95bce", "location": "北京", "name": "云数据库的架构设计与技术演进专场·", "start_time": 1650902400 }, { "end_time": 1650124799, "img": "https://static001.infoq.cn/resource/image/2d/86/2db870b36b19f82218b537402b93ae86.jpg", "link": "https://dive.infoq.cn/2021/beijing", "location": "线上", "name": "DIVE 全球基础软件创新大会", "start_time": 1649952000 }, { "end_time": 1651161599, "img": "https://static001.infoq.cn/resource/image/2d/46/2dc27869cccf20ff71e38a745e45fe46.jpeg", "link": "https://www.guance.com/productrelease", "location": "线上", "name": "专为IT工程师定制｜2022观测云产品发布会", "start_time": 1651075200 }, { "end_time": 1653148799, "img": "https://static001.infoq.cn/resource/image/8d/af/8daa9543de9668d8136db9d0526567af.jpg", "link": "https://app.ma.scrmtech.com/meetings/MeetingPc/Detail?pf_uid=27715_2095&id=58292&source=2&pf_type=3&channel_id=28603&channel_name=InfoQ&tag_id=e227c32eddab16f3", "location": "线上", "name": "TDengine用户案例专场", "start_time": 1653062400 }, { "end_time": 1656604799, "img": "https://static001.infoq.cn/resource/image/3e/c1/3eaa69eb89184ab16531402e2b4aa5c1.jpg", "link": "https://www.infoq.cn/minibook/gSVX7kVxVd1CIgfDSLD9?id=973&utm_source=gw&sign=iq_628470f6ed9ec", "location": "线上", "name": "2021年中国分布式数据库市场报告", "start_time": 1653235200 }, { "end_time": 1656518400, "img": "https://static001.infoq.cn/resource/image/bf/51/bf18022yy2616cd9d55dfbcaa4b1c951.jpg", "link": "https://www.infoq.cn/minibook/zH4ITB3UzibuYg3UTxyB", "location": "线上", "name": "腾讯云原生路线图手册", "start_time": 1652716800 }, { "end_time": 1657900799, "img": "https://static001.infoq.cn/resource/image/c1/2e/c17aab59632dc41aaa5aeaa0429ce82e.jpg", "link": "https://www.infoq.cn/event/?id=232&utm_source=gw&sign=iq_62c29c5f81751", "location": "深圳", "name": "腾讯自研业务大规模云原生实践专场", "start_time": 1657814400 }, { "end_time": 1658937599, "img": "https://static001.infoq.cn/resource/image/d9/d0/d952785ef4fe64yy390ac0fa8c93f6d0.png", "link": "https://mp.weixin.qq.com/s/gNlVUcSNfRh6OwhwKP-2Dw", "location": "线上", "name": "研发效能黄金三角及需求与敏捷协作领域实践", "start_time": 1658851200 }, { "end_time": 1658851199, "img": "https://static001.infoq.cn/resource/image/6c/5d/6cd448341929757b0904d9ac0da0705d.jpg", "link": "https://live.infoq.cn/room/1526", "location": "线上", "name": "分布式数据库在金融核心场景落地实践", "start_time": 1658764800 }, { "end_time": 1659283199, "img": "https://static001.infoq.cn/resource/image/46/ab/46d2c7e473b216df11592719f9f348ab.jpg", "link": "https://www.infoq.cn/event/?id=236", "location": "广州", "name": "腾讯自研业务大规模云原生实践专场", "start_time": 1659196800 }, { "end_time": 1658505599, "img": "https://static001.infoq.cn/resource/image/71/34/714e4b9387daf584544cbc202038fe34.png", "link": "https://www.aliyun.com/page-source/tianchi/promotion/RocketMQ_Summit2022", "location": "线上", "name": "RocketMQ Summit 全球开发者峰会", "start_time": 1658332800 }, { "end_time": 1657987199, "img": "https://static001.infoq.cn/resource/image/12/e4/128752cb4b0fe89564d9ed26737b9de4.jpg", "link": "https://www.infoq.cn/event/?id=233&utm_source=gw&sign=iq_62c28993c5b5d", "location": "深圳", "name": "企业云上管理与治理专场", "start_time": 1657900800 }, { "end_time": 1657814399, "img": "https://static001.infoq.cn/resource/image/4f/fa/4fb53f9599990098cc3590b3ea7c0afa.jpg", "link": "https://live.infoq.cn/room/1520", "location": "线上", "name": "新知·音视频技术公开课第五期", "start_time": 1657728000 }, { "end_time": 1660838399, "img": "https://static001.infoq.cn/resource/image/08/bf/080d6253808cb41011be166578yy4fbf.jpg", "link": "https://www.infoq.cn/event/?id=219", "location": "北京", "name": "企业云原生成本优化最佳实践专场", "start_time": 1660752000 }, { "end_time": 1660924799, "img": "https://static001.infoq.cn/resource/image/8a/53/8a46a5a1bc2fa426f6929673238b5a53.jpg", "link": "https://www.infoq.cn/event/?id=239", "location": "线上", "name": "腾讯云大数据峰会暨Techo TVP开发者峰会", "start_time": 1660838400 }, { "end_time": 1660147199, "img": "https://static001.infoq.cn/resource/image/0e/62/0eb00cbf52abb2186601f9e69e5d5c62.jpg", "link": "https://www.infoq.cn/event/?id=237", "location": "深圳", "name": "2022 OceanBase 年度发布会", "start_time": 1660060800 }, { "end_time": 1660233599, "img": "https://static001.infoq.cn/resource/image/9f/6f/9f328460d64d729e48370f21d054976f.jpg", "link": "https://www.infoq.cn/event/?id=238", "location": "深圳", "name": "2022阿里云飞天科技峰会", "start_time": 1660147200 }, { "end_time": 1660233599, "img": "https://static001.infoq.cn/resource/image/90/8e/90f1b4260fd376ea48edef3962dafe8e.png", "link": "https://xie.infoq.cn/article/01cd0581e3d7bae0f75027d0a", "location": "线上", "name": "ONES 研发管理大师课", "start_time": 1659974400 }, { "end_time": 1667145599, "img": "https://static001.infoq.cn/resource/image/yy/2e/yy63948fb2c360db81223155ffc7302e.jpg", "link": "https://www.infoq.cn/event/?id=246", "location": "北京", "name": "腾讯云原生最佳实践专场", "start_time": 1667059200 }, { "end_time": 1664207999, "img": "https://static001.infoq.cn/resource/image/6a/e5/6aeba4feyye7285e5a9230ed3eea3ae5.jpg", "link": "https://live.infoq.cn/room/1578", "location": "线上", "name": "自研数据库技术破局与最佳实践", "start_time": 1664121600 }, { "end_time": 1667923199, "img": "https://static001.infoq.cn/resource/image/df/5a/dff2c1276bac4b4f487ca0182a08d85a.jpg", "link": "https://live.infoq.cn/room/1605", "location": "线上", "name": "自研数据库技术破局与最佳实践", "start_time": 1667836800 }, { "end_time": 1669478399, "img": "https://static001.infoq.cn/resource/image/fb/18/fbf1f9cc7ec6ca06a3c17e182b6fb018.jpg", "link": "https://www.infoq.cn/event/?id=250", "location": "上海", "name": "实时音视频技术在抖音上的深度磨砺专场", "start_time": 1669392000 }, { "end_time": 1669391999, "img": "https://static001.infoq.cn/resource/image/83/e8/83235dc18c07yy5b20bb1d67f4d525e8.jpg", "link": "https://www.infoq.cn/event/?id=249&utm_source=hsss&sign=iq_637336d57aa28", "location": "上海", "name": "腾讯自研业务大规模云原生实践专场", "start_time": 1669305600 }, { "end_time": 1668959999, "img": "https://static001.infoq.cn/resource/image/a0/cf/a0bf8117a778385df8744669ca0d67cf.jpg", "link": "https://www.infoq.cn/form/?id=1277&utm_source=web&utm_medium=hd&sign=iq_636a1a0e02ff2", "location": "线上", "name": "Pulsar Summit Asia 2022", "start_time": 1668787200 }, { "end_time": 1669391999, "img": "https://static001.infoq.cn/resource/image/22/97/22f0606ea24861e118b3edyyc6d31c97.jpg", "link": "https://www.infoq.cn/form/?id=1278&utm_source=gw&sign=iq_636e197618943", "location": "上海·宏安瑞士大酒店", "name": "QCon上海-网易智企专场", "start_time": 1669305600 }, { "end_time": 1669478400, "img": "https://static001.infoq.cn/resource/image/58/67/586759c3451398bca513265fe8301467.jpg", "link": "https://developer.aliyun.com/special/ffa2022", "location": "线上", "name": "Flink Forward Asia 2022", "start_time": 1669392000 }, { "end_time": 1666886399, "img": "https://static001.infoq.cn/resource/image/29/0e/294354bf979912e69cda609a4441f70e.jpg", "link": "https://www.infoq.cn/event/?id=245", "location": "线上", "name": "数字化转型第一步，“低代码”搭建更靠谱！", "start_time": 1666800000 }, { "end_time": 1667145599, "img": "https://static001.infoq.cn/resource/image/d6/da/d6441fa0109e3efafb44eb60974066da.jpg", "link": "https://www.infoq.cn/event/?id=244", "location": "线上直播", "name": "云无界，端无边 OGeek 技术峰会", "start_time": 1666972800 }, { "end_time": 1669910399, "img": "https://static001.infoq.cn/resource/image/70/4b/70577884a67ee322204149b85a024b4b.jpg", "link": "https://live.infoq.cn/room/1641", "location": "线上", "name": "DBTalk 第五期", "start_time": 1669824000 }, { "end_time": 1671638399, "img": "https://static001.infoq.cn/resource/image/dd/12/ddc5793176743b217528e2a26c5eaf12.jpg", "link": "https://live.infoq.cn/room/1653", "location": "线上", "name": "高科制造类项目研发如何软硬协同、敏捷提效", "start_time": 1671552000 }, { "end_time": 1670774399, "img": "https://static001.infoq.cn/resource/image/6a/a7/6af9a7694971c586048a004b124345a7.jpg", "link": "https://www.infoq.cn/minibook/RuveM045ptfTNKwfeq6c?id=1326&utm_source=gw&sign=iq_638957ce4f3dd", "location": "线上", "name": "腾讯技术实践精选集", "start_time": 1669910400 }, { "end_time": 1672329599, "img": "https://static001.infoq.cn/resource/image/0d/54/0dc4c07fd11f4e94385e50afdb543354.jpg", "link": "https://live.infoq.cn/room/1672", "location": "线上", "name": "DBTalk第六期", "start_time": 1671984000 }, { "end_time": 1675612799, "img": "https://static001.infoq.cn/resource/image/19/05/19407a3b3bb0c5d681a69c82f712ac05.png", "link": "https://www.infoq.cn/event/?id=255&utm_source=gw&sign=iq_63d7671a45d19", "location": "线上", "name": "QCon北京-现代数据栈建设及思考", "start_time": 1675008000 }, { "end_time": 1675612799, "img": "https://static001.infoq.cn/resource/image/b5/4d/b52de3a6006366d6fc220c16b5ac784d.jpg", "link": "https://www.infoq.cn/event/?id=254&utm_source=gwg&sign=iq_63d60f639f272", "location": "线上", "name": "QCon北京-腾讯云专场@董家冠", "start_time": 1675008000 }, { "end_time": 1672156799, "img": "https://static001.infoq.cn/resource/image/52/b4/52f1e97e4c21c87186e5e1d3yyedbdb4.jpg", "link": "https://www.infoq.cn/event/?id=253", "location": "线上", "name": "2022 云智峰会·智算峰会", "start_time": 1672070400 }, { "end_time": 1671984000, "img": "https://static001.infoq.cn/resource/image/1b/2f/1b7eaa4097c90b3fe8657227a600172f.jpg", "link": "https://www.infoq.cn/form/?id=1328&utm_source=activity&sign=iq_6389a90914ca9", "location": "北京、线上", "name": "百度百舸·AI 异构计算平台", "start_time": 1669910400 }, { "end_time": 1680191999, "img": "https://static001.infoq.cn/resource/image/3b/58/3bf1e0124aa9e80df9f4b274aae5db58.jpg", "link": "https://www.infoq.cn/event/?id=261", "location": "线上", "name": "腾讯云直播课安全篇", "start_time": 1680105600 }, { "end_time": 1678550399, "img": "https://static001.infoq.cn/resource/image/b9/87/b9c76bd730d5bbd2f326cafbf1bb5787.jpg", "link": "https://www.infoq.cn/event/?id=248", "location": "北京", "name": "OGeek 小布沙龙", "start_time": 1678464000 }, { "end_time": 1679673599, "img": "https://static001.infoq.cn/resource/image/31/dd/317230139b0dbe53e09115a73ec572dd.jpg", "link": "https://www.infoq.cn/event/?id=259&utm_source=hddby&sign=iq_640fd4ea03e7f", "location": "北京", "name": "阿里云瑶池数据库峰会 • 北京", "start_time": 1679587200 }, { "end_time": 1679759999, "img": "https://static001.infoq.cn/resource/image/3a/66/3a6aac32e153f0037132bb067a0ccd66.jpg", "link": "https://www.oceanbase.com/devcon2023?utm_source=infoq&utm_medium=pc&utm_campaign=dc2023&utm_term=homebanner", "location": "北京", "name": "OceanBase开发者大会 · 2023", "start_time": 1679673600 }, { "end_time": 1682006399, "img": "https://static001.infoq.cn/resource/image/d2/e3/d223bc5b37623329d614ce98408899e3.png", "link": "https://xie.infoq.cn/article/a2bb8290ef4e9ba436e04dbdc", "location": "线上", "name": "《中国企业软件研发管理白皮书》", "start_time": 1681920000 }, { "end_time": 1687881600, "img": "https://static001.infoq.cn/resource/image/1a/41/1a797cc09be8f79a58041b5c944be641.jpg", "link": "https://summit.awsevents.cn/2023/form.html?source=A1Jmo+hFUc3p2QU//2KWmu/axcY5zRDRzaPxMrZTjIU=", "location": "上海", "name": "2023亚马逊云科技中国峰会··", "start_time": 1687795200 }, { "end_time": 1687881600, "img": "https://static001.infoq.cn/resource/image/1a/41/1a797cc09be8f79a58041b5c944be641.jpg", "link": "https://summit.awsevents.cn/2023/form.html?source=A1Jmo+hFUc3p2QU//2KWmu/axcY5zRDRzaPxMrZTjIU=", "location": "上海", "name": "2023亚马逊云科技中国峰会", "start_time": 1687795200 }, { "end_time": 1687017599, "img": "https://static001.infoq.cn/resource/image/55/7c/55cd06b294721f7e8759579f2eff707c.jpg", "link": "https://static001.geekbang.org/resource/image/9c/3c/9c24570a3cdaea6f9f1db8b28a3a493c.jpg", "location": "线上", "name": "《再谈数据架构》第一期", "start_time": 1686931200 }, { "end_time": 1689091199, "img": "https://static001.infoq.cn/resource/image/2a/d0/2a465b70eaeea5aba10c4e6c3bbb73d0.png", "link": "https://static001.geekbang.org/resource/image/54/cc/54d7f1049cdf37e4ae1835ece16bbacc.jpg", "location": "线上", "name": "数据引擎，One Size Fits All真的能实现么", "start_time": 1689004800 }, { "end_time": 1690300799, "img": "https://static001.infoq.cn/resource/image/fb/2b/fbfba6f97a6e6c90218d35394daf912b.jpg", "link": "https://static001.geekbang.org/resource/image/f2/8a/f2b2a8cac897dc23a95830ba87999a8a.jpg", "location": "线上", "name": "云器科技产品发布会", "start_time": 1690214400 }, { "end_time": 1690819199, "img": "https://static001.infoq.cn/resource/image/63/21/63afb05ba699b993ae1899b6ffbfb921.png", "link": "https://live.infoq.cn/room/1838", "location": "线上", "name": "阿里云智能飞天发布会", "start_time": 1690732800 }, { "end_time": 1685289599, "img": "https://static001.infoq.cn/resource/image/7f/2c/7f66b1f3f7aa26acea890d216b57122c.jpg", "link": "https://dev.amazoncloud.cn/activity/activityDetail?id=645a17374b2abb2a75068e76&catagoryName=communityDay&sc_medium=owned&sc_campaign=Communityday&sc_channel=InfoQ1", "location": "深圳", "name": "亚马逊云科技 Community Day 深圳站", "start_time": 1685203200 }, { "end_time": 1693929599, "img": "https://static001.infoq.cn/resource/image/9d/13/9d6b0bac0dba84097c51a836ef023a13.jpg", "link": "https://cloud.baidu.com/summit/AIcloudsummit_2023/index.html?track=infoQ", "location": "北京", "name": "2023百度云智大会", "start_time": 1693843200 }, { "end_time": 1695311999, "img": "https://static001.infoq.cn/resource/image/e2/be/e2c9728001413b208e0903eee022c0be.png", "link": "https://www.infoq.cn/form/?id=1763&utm_source=hd&sign=iq_64e85d7f35e01", "location": "上海", "name": "Akamai World Tour 2023 上海站", "start_time": 1695225600 }, { "end_time": 1694102400, "img": "https://static001.infoq.cn/resource/image/1a/c5/1a8da5aef7d757e6cc72ff8300f919c5.jpg", "link": "https://qdrl.qq.com/T9OAntJY", "location": "深圳", "name": "2023腾讯全球数字生态大会", "start_time": 1694016000 }, { "end_time": 1694534399, "img": "https://static001.infoq.cn/resource/image/52/0d/52e53bbd519a86yy9201ab96622c1f0d.png", "link": "https://live.infoq.cn/room/1864?utm_source=infoq-web&utm_medium=hdbanner", "location": "线上", "name": "提质增效,数智升级,泛娱企业的研发进化之路", "start_time": 1694448000 }, { "end_time": 1698335999, "img": "https://static001.infoq.cn/resource/image/b4/9e/b41e3ebb3b835f8745b5bcfc8fb3469e.jpg", "link": "https://www.infoq.cn/event/?id=274&utm_source=123&sign=iq_652e5af976d54", "location": "线上", "name": "如何基于AIGC 技术快速开发应用，助力企业", "start_time": 1698249600 }, { "end_time": 1701273600, "img": "https://static001.infoq.cn/resource/image/96/e1/96c324dd2e3904e8c88e8e9c9760c4e1.jpg", "link": "https://cloud.baidu.com/product/wenxinworkshop?track=InfoQ", "location": "线上", "name": "百度文心大模型4.0", "start_time": 1697817600 }, { "end_time": 1701359999, "img": "https://static001.infoq.cn/resource/image/4a/84/4a99774d470387882bc7808d7yy78384.png", "link": "https://www.infoq.cn/minibook/JrzLW0G9ZMZlppDXmWWi?id=1885&utm_source=gw&sign=iq_653b7ed70c95a", "location": "线上", "name": "分布式云行业实践指南", "start_time": 1698595200 }, { "end_time": 1698163199, "img": "https://static001.infoq.cn/resource/image/76/5a/76fe09bdc8c6b013128bb4bc282e2f5a.jpg", "link": "https://ct.ctrip.com/activitysetupapp/mkt/index/sigfh?popup=close&type=dynamic", "location": "线上", "name": "B+携程商旅伙伴大会", "start_time": 1698076800 }, { "end_time": 1703952000, "img": "https://static001.infoq.cn/resource/image/bc/3c/bc3yy75739ef34b57f50f3d48c8f0e3c.png", "link": "https://www.infoq.cn/event/?id=275", "location": "线上", "name": "2023年OceanBase发布会", "start_time": 1699200000 }, { "end_time": 1704038399, "img": "https://static001.infoq.cn/resource/image/c4/3a/c4e71f32aa47ebe48ffe35e421066e3a.png", "link": "https://xie.infoq.cn/article/65f0fe58bfe5a2bd828a234b5", "location": "线上", "name": "技术人的 2023 总结｜有奖征文大赛来袭！", "start_time": 1701360000 }, { "end_time": 1703087999, "img": "https://static001.infoq.cn/resource/image/be/9f/bea0ee740a82595085eb0b2bbec4519f.jpg", "link": "https://cloud.baidu.com/summit/aicomputing_2023/index.html?track=mkt_InfoQ", "location": "线下", "name": "2023百度云智大会•智算大会", "start_time": 1701273600 }, { "end_time": 1703001600, "img": "https://static001.infoq.cn/resource/image/08/e1/08e97acc6b8d066ffc0c021cc4995ae1.jpg", "link": "https://www.infoq.cn/form/?id=1953&utm_source=wz01&sign=iq_65698a46f3a5d", "location": "线下", "name": "2023百度云智大会•智算大会开发者沙龙", "start_time": 1701360000 }, { "end_time": 1702828800, "img": "https://static001.infoq.cn/resource/image/4c/02/4ce5e4234d3bdab6ce7f765cc5e9d502.jpg", "link": "https://openanolis.cn/openanolisconference", "location": "北京", "name": "2023 龙蜥操作系统大会", "start_time": 1702742400 }, { "end_time": 1703088000, "img": "https://static001.infoq.cn/resource/image/4f/e5/4f037904e16c000b17e3f2e9d73ba3e5.png", "link": "https://www.infoq.cn/form/?id=1979&utm_source=1&sign=iq_657961be4a74fhttps://www.infoq.cn/form/?id=1979&utm_source=1&sign=iq_657961be4a74f", "location": "线上", "name": "百度 Comate公开课", "start_time": 1702396800 }, { "end_time": 1703952000, "img": "https://static001.infoq.cn/resource/image/62/54/62668b5abed7ac0c7b0afcc1a3b1c254.jpg", "link": "https://www.huodongxing.com/event/2730575053800?td=2144095838345", "location": "北京", "name": "FFA大会&闭门会", "start_time": 1700668800 }, { "end_time": 1702137599, "img": "https://static001.infoq.cn/resource/image/46/04/46b43918ed8ff11713bcf357e23b6504.jpg", "link": "https://flink-forward.org.cn", "location": "北京", "name": "Flink Forward 2023", "start_time": 1701964800 } ], "notice": { "content": "", "end_time": 0, "link": "", "start_time": 0, "time_now": 0 }, "top": [ { "alias": " industrynews", "child_list": [ { "id": 1164, "name": "英特尔", "alias": "", "type": 1 }, { "id": 19, "name": "Google", "alias": "google", "type": 1 }, { "id": 20, "name": "微软", "alias": "Microsoft", "type": 1 }, { "id": 26, "name": "亚马逊云科技", "alias": "AWS", "type": 1 }, { "id": 54, "name": "百度", "alias": "baidu", "type": 1 }, { "id": 61, "name": "阿里巴巴", "alias": "alibaba", "type": 1 }, { "id": 78, "name": "腾讯", "alias": "tencent", "type": 1 }, { "id": 145, "name": "华为", "alias": "huawei", "type": 1 }, { "id": 1167, "name": "字节跳动", "alias": "", "type": 1 }, { "id": 1215, "name": "用友", "alias": "", "type": 1 } ], "icon": "", "id": 147, "link": "", "name": "企业动态", "type": 1 }, { "alias": "", "child_list": [ { "id": 160, "name": "医疗", "alias": "medical", "type": 1 }, { "id": 1169, "name": "银行", "alias": "", "type": 1 }, { "id": 1170, "name": "证券", "alias": "", "type": 1 }, { "id": 1171, "name": "保险", "alias": "", "type": 1 }, { "id": 1172, "name": "汽车", "alias": "", "type": 1 }, { "id": 1173, "name": "工业", "alias": "", "type": 1 } ], "icon": "", "id": 1168, "link": "", "name": "行业深度", "type": 1 }, { "alias": "", "child_list": [ { "id": 141, "name": "小程序", "alias": "applets", "type": 1 }, { "id": 1209, "name": "Android/iOS", "alias": "", "type": 1 }, { "id": 1210, "name": "架构/框架", "alias": "", "type": 1 }, { "id": 1211, "name": "工程化", "alias": "", "type": 1 }, { "id": 1212, "name": "跨端开发", "alias": "", "type": 1 }, { "id": 1213, "name": "性能优化", "alias": "", "type": 1 }, { "id": 1214, "name": "音视频（前端）", "alias": "", "type": 1 } ], "icon": "", "id": 1208, "link": "", "name": "大前端", "type": 1 }, { "alias": "", "child_list": [ { "id": 29, "name": "数据库", "alias": "Database", "type": 1 }, { "id": 32, "name": "编程语言", "alias": "programing-languages", "type": 1 }, { "id": 81, "name": "区块链", "alias": "Blockchain", "type": 1 }, { "id": 1175, "name": "中间件", "alias": "", "type": 1 }, { "id": 1176, "name": "操作系统", "alias": "", "type": 1 }, { "id": 1177, "name": "5G/IoT", "alias": "", "type": 1 }, { "id": 1178, "name": "音视频（后端）", "alias": "", "type": 1 } ], "icon": "", "id": 1174, "link": "", "name": "后端", "type": 1 }, { "alias": "architecture", "child_list": [ { "id": 12, "name": "SOA", "alias": "soa", "type": 1 }, { "id": 70, "name": "微服务", "alias": "microservice", "type": 1 }, { "id": 1179, "name": "业务架构", "alias": "", "type": 1 }, { "id": 1180, "name": "框架", "alias": "", "type": 1 }, { "id": 1181, "name": "领域驱动设计", "alias": "", "type": 1 }, { "id": 1182, "name": "多云/混合云", "alias": "", "type": 1 } ], "icon": "", "id": 8, "link": "", "name": "架构", "type": 1 }, { "alias": "AI", "child_list": [ { "id": 125, "name": "自动驾驶", "alias": "Autopilot", "type": 1 }, { "id": 127, "name": "计算机视觉", "alias": " computing-vision", "type": 1 }, { "id": 1183, "name": "生成式 AI", "alias": "", "type": 1 }, { "id": 1184, "name": "AI 工程化", "alias": "", "type": 1 }, { "id": 1185, "name": "机器学习/深度学习", "alias": "", "type": 1 }, { "id": 1186, "name": "自然语言处理", "alias": "", "type": 1 }, { "id": 1187, "name": "芯片", "alias": "", "type": 1 } ], "icon": "", "id": 31, "link": "", "name": "AI", "type": 1 }, { "alias": "bigdata", "child_list": [ { "id": 1188, "name": "DataOps", "alias": "", "type": 1 }, { "id": 1189, "name": "数据集成", "alias": "", "type": 1 }, { "id": 1190, "name": "DataMesh", "alias": "", "type": 1 }, { "id": 1191, "name": "数据编织", "alias": "", "type": 1 }, { "id": 1192, "name": "数据湖仓", "alias": "", "type": 1 }, { "id": 1193, "name": "在离线混部", "alias": "", "type": 1 }, { "id": 1194, "name": "实时计算", "alias": "", "type": 1 } ], "icon": "", "id": 15, "link": "", "name": "大数据", "type": 1 }, { "alias": "", "child_list": [ { "id": 21, "name": "安全", "alias": "Security", "type": 1 }, { "id": 120, "name": "AIOps", "alias": "AIOps", "type": 1 }, { "id": 1165, "name": "BizDevOps", "alias": "BizDevOps", "type": 1 }, { "id": 1196, "name": "DevOps & 平台工程", "alias": "", "type": 1 }, { "id": 1197, "name": "FinOps", "alias": "", "type": 1 }, { "id": 1198, "name": "研发效能", "alias": "", "type": 1 }, { "id": 1199, "name": "可观测", "alias": "", "type": 1 } ], "icon": "", "id": 1195, "link": "", "name": "软件工程", "type": 1 }, { "alias": "cloud-computing", "child_list": [ { "id": 106, "name": "云原生", "alias": "CloudNative", "type": 1 }, { "id": 119, "name": "Serverless", "alias": "Serverless", "type": 1 }, { "id": 1200, "name": "服务革新", "alias": "", "type": 1 }, { "id": 1201, "name": "云安全", "alias": "", "type": 1 }, { "id": 1202, "name": "云端开发", "alias": "", "type": 1 }, { "id": 1203, "name": "芯片与网络", "alias": "", "type": 1 }, { "id": 1216, "name": "低代码", "alias": "", "type": 1 } ], "icon": "", "id": 11, "link": "", "name": "云计算", "type": 1 }, { "alias": "", "child_list": [ { "id": 17, "name": "开源", "alias": "opensource", "type": 1 }, { "id": 1131, "name": "技术选型", "alias": "technology-selection", "type": 1 }, { "id": 1160, "name": "数字化转型", "alias": "", "type": 1 }, { "id": 1205, "name": "数字人才培养", "alias": "", "type": 1 }, { "id": 1206, "name": "团队搭建", "alias": "", "type": 1 }, { "id": 1207, "name": "技术出海", "alias": "", "type": 1 } ], "icon": "", "id": 1204, "link": "", "name": "管理/文化", "type": 1 }, { "child_list": [ ], "icon": "", "id": 0, "link": "https://www.infoq.cn/theme/207", "name": "AI 编程助手", "type": 2 }, { "child_list": [ ], "icon": "https://static001.infoq.cn/resource/image/90/73/906da8288da450f8732be47ad0120073.png", "id": 0, "link": "https://www.infoq.cn/zones/business/?utm_source=infoq-web&utm_medium=header_graybar&utm_term=0126", "name": "企业会员", "type": 3 }, { "child_list": [ ], "icon": "https://static001.infoq.cn/resource/image/52/fa/5248de588832bcf63b5a9570caa2b0fa.png", "id": 0, "link": "https://www.infoq.cn/article/CHFMEwL6dcXxxpqx7Avc?utm_source=infoq&utm_medium=header_graybar", "name": "访谈录报名", "type": 3 } ] }, "error": { }, "extra": { "cost": 0.008470562, "request-id": "a303a5f913a44e508590d0dbd7529d82@3@xie" } }

{ "code": 0, "data": { "id": 261716, "aid": "603998387209424899", "aidint": 603998387209424900, "type": 1, "views": 2, "uuid": "cf53746c1dd20cddae7d82be3", "status": 1, "publish_time": 1703822431343, "ctime": 1703822431428, "utime": 1703822431428, "vid": "", "source": 2, "sub_status": 0, "ip_address": "北京", "score": 1703822431343, "article_title": "一个 39.3T 的集群从TiDB v3.1.0迁移升级到 TiDB v7.1.2 的实践", "article_sharetitle": "一个 39.3T 的集群从TiDB v3.1.0迁移升级到 TiDB v7.1.2 的实践", "article_subtitle": "", "article_summary": "集群目前情况数据39.3Timage.pngtidb版本image.png数据导出方式选择1、BR这个版本刚开始支持，不知道有什么未知bug，暂时没有选择2、逻辑导出，首先考虑同版本发行对应的m...", "article_cover": "", "article_cover_point": "", "author": [ { "uid": 2869403, "nickname": "TiDB 社区干货传送门", "avatar": "https://static001.geekbang.org/account/avatar/00/2b/c8/9b/b9c2439c.jpg", "active": 1, "is_early": 0, "ucode": "E47A66A843E94F", "uri": "/profile/E47A66A843E94F/", "author_type": 1, "vip": 0 } ], "translator": null, "planner": null, "topic": null, "is_collect": false, "no_author": "", "is_promotion": false, "share_pic": "", "sub_type": 0, "comment_user": 0, "comment_count": 0, "speaker_title": "", "speaker_introduce": "", "video_status": 0, "duration": "", "total_duration": "", "label": [ { "id": 2182, "name": "迁移" }, { "id": 9590, "name": "实践案例" }, { "id": 15022, "name": "版本升级" }, { "id": 21999, "name": "大数据场景实践" }, { "id": 30781, "name": "7.x 实践" } ], "out_id": null, "word_count": 3161, "front_type": 1, "content_short": "", "is_fill_info": 0, "content": "", "ebook": { }, "love": 0, "is_love": false, "copyright": 1, "lead_author": 0, "ppt_url": "", "publisher": { "uid": 0, "nickname": "", "avatar": "", "active": 0, "is_early": 0, "ucode": "", "uri": "", "author_type": 0, "vip": 0, "mood": "", "intro": "", "is_sub": false }, "definition": null, "read_status": 0, "collect": 0, "checker": null, "outlines": null, "content_url": "https://static-acl-001.geekbang.org/resource/article/a89a3c91ee3b711f5c8a326906190a20/content.json?auth_key=1703820700-b43594ddff7946a8a262bfa68066495c-0-b2d81682f0c65d37d8540598279c28cb&v_t=1703822431428", "themes": [ ], "audio_status": 0, "audio_url": "", "audio_size": 0 }, "error": { }, "extra": { "cost": 0.054813573, "request-id": "a7278b3a2ac849078611fe27af651cbd@3@xie" } }

{ "type": "doc", "content": [ { "type": "blockquote", "content": [ { "type": "paragraph", "content": [ { "type": "text", "text": "作者： xingzhenxiang原文来源：" }, { "type": "link", "attrs": { "href": "https://tidb.net/blog/0629c299?utm_source=tidb-community&utm_medium=referral&utm_campaign=repost" }, "content": [ { "type": "text", "text": "https://tidb.net/blog/0629c299" } ] } ] } ] }, { "type": "heading", "attrs": { "level": 1 }, "content": [ { "type": "text", "text": "集群目前情况" } ] }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "数据 39.3T" } ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/image-1703560379240.png" } }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "tidb 版本" } ] }, { "type": "heading", "attrs": { "level": 2 }, "content": [ { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/image-1703560530366.png" } } ] }, { "type": "heading", "attrs": { "level": 1 }, "content": [ { "type": "text", "text": "数据导出方式选择" } ] }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "1、BR 这个版本刚开始支持，不知道有什么未知 bug，暂时没有选择" } ] }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "2、逻辑导出，首先考虑同版本发行对应的 mydumper，出现 tidb server 内存耗尽，放弃" } ] }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "3、最后选择 dumpling v7.1.2，看文档说事兼容以前版本" } ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/image-1703561547929.png" } }, { "type": "heading", "attrs": { "level": 4 }, "content": [ { "type": "text", "text": "导出命令" } ] }, { "type": "codeblock", "attrs": { "lang": "markdown" }, "content": [ { "type": "text", "text": "./dumpling -u root -ppassword -h 10.10.110.47 -P3306 -f 'mydatabase.*' --tidb-mem-quota-query=1073741824 --filetype sql -t 24 -o /data/backup -r 200000 -F256MiB -L /tmp/dumplinglog.txt\n" } ] }, { "type": "heading", "attrs": { "level": 4 }, "content": [ { "type": "text", "text": "注意密码需要显示配置，否则会报如下错" } ] }, { "type": "codeblock", "attrs": { "lang": "markdown" }, "content": [ { "type": "text", "text": "Release version: v7.1.2\nGit commit hash: aa6ed99ae63191bc98e883fd4c369ae7482cccb7\nGit branch: heads/refs/tags/v7.1.2\nBuild timestamp: 2023-10-21 07:38:45Z\nGo version: go version go1.20.10 linux/amd64\nmeet some unparsed arguments, please check again: [10.10.110.47]\n" } ] }, { "type": "heading", "attrs": { "level": 1 }, "content": [ { "type": "text", "text": "导入测试" } ] }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "1、逻辑导入" } ] }, { "type": "heading", "attrs": { "level": 4 }, "content": [ { "type": "text", "text": "导入配置文件" } ] }, { "type": "codeblock", "attrs": { "lang": "markdown" }, "content": [ { "type": "text", "text": "[lightning]\nregion-concurrency = 14\n# 日志\nlevel = "info"\nfile = "tidb-lightning.log"\nmax-size = 256 # MB\nmax-days = 28\nmax-backups = 14\n\n# 启动之前检查集群是否满足最低需求。\ncheck-requirements = true\n\n[mydumper]\n# 本地源数据目录或外部存储 URL\ndata-source-dir = "/data/backup"\n\n[checkpoint]\n# 是否启用断点续传。\n# 导入数据时，TiDB Lightning 会记录当前表导入的进度。\n# 所以即使 TiDB Lightning 或其他组件异常退出，在重启时也可以避免重复再导入已完成的数据。\nenable = true\n# 存储断点的数据库名称。\nschema = "tidb_lightning_checkpoint"\n# 存储断点的方式。\n# - file：存放在本地文件系统。\n# - mysql：存放在兼容 MySQL 的数据库服务器。\ndriver = "file"\n\n# dsn 是数据源名称 (data source name)，表示断点的存放位置。\n# 若 driver = "file"，则 dsn 为断点信息存放的文件路径。\n#若不设置该路径，则默认存储路径为“/tmp/CHECKPOINT_SCHEMA.pb”。\n# 若 driver = "mysql"，则 dsn 为“用户:密码@tcp(地址:端口)/”格式的 URL。\n# 若不设置该 URL，则默认会使用 [tidb] 部分指定的 TiDB 服务器来存储断点。\n# 为减少目标 TiDB 集群的压力，建议指定另一台兼容 MySQL 的数据库服务器来存储断点。\n# dsn = "/tmp/tidb_lightning_checkpoint.pb"\n\n# 所有数据导入成功后是否保留断点。设置为 false 时为删除断点。\n# 保留断点有利于进行调试，但会泄漏关于数据源的元数据。\n# keep-after-success = false\n\n[tikv-importer]\n# 导入模式配置，设为 tidb 即使用 Logical Import Mode\nbackend = "tidb"\n\n# Logical Import Mode 插入重复数据时执行的操作。\n# - replace：新数据替代已有数据\n# - ignore：保留已有数据，忽略新数据\n# - error：中止导入并报错\non-duplicate = "replace"\n\n[tidb]\n# 目标集群的信息。tidb-server 的地址，填一个即可。\nhost = "10.21.109.11"\nport = 3306\nuser = "root"\n# 设置连接 TiDB 的密码，可为明文或 Base64 编码。\npassword = ""\n# tidb-lightning 引用了 TiDB 库，并生成产生一些日志。\n# 设置 TiDB 库的日志等级。\nlog-level = "error"\nsql-mode = "ONLY_FULL_GROUP_BY,NO_ENGINE_SUBSTITUTION"\n" } ] }, { "type": "heading", "attrs": { "level": 4 }, "content": [ { "type": "text", "text": "遇到问题" } ] }, { "type": "paragraph", "content": [ { "type": "text", "text": "报错内容，考虑导入并发参数过大，所以修改并发参数为 cpu 的 75%（region-concurrency = 42，第三次调整为 32, 第四次调整为 24，第五次调整为 14 就不报错了）" } ] }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "codeblock", "attrs": { "lang": "markdown" }, "content": [ { "type": "text", "text": "[2023/11/23 10:59:05.172 +08:00] [ERROR] [tidb.go:708] [“execute statement failed”] [rows=“[”] [error=“Error 9005 (HY000): Region is unavailable”][2023/11/23 10:59:05.172 +08:00] [ERROR] [tidb.go:708] [“execute statement failed”] [rows=“[)]”] [stmt=“REPLACE INTO db.table VALUES()”] [error=“Error 9005 (HY000): Region is unavailable”]\n" } ] }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "2、物理导入" } ] }, { "type": "heading", "attrs": { "level": 4 }, "content": [ { "type": "text", "text": "物理导入配置文件（只有一个 lightning 导入）" } ] }, { "type": "codeblock", "attrs": { "lang": "markdown" }, "content": [ { "type": "text", "text": "[lightning]\n# 日志\nlevel = "info"\nfile = "tidb-lightning.log"\nmax-size = 256 # MB\nmax-days = 28\nmax-backups = 14\n\n# 启动之前检查集群是否满足最低需求。\ncheck-requirements = true\n\n[mydumper]\n# 本地源数据目录或外部存储 URI。关于外部存储 URI 详情可参考 https://docs.pingcap.com/zh/tidb/v6.6/backup-and-restore-storages#uri-%E6%A0%BC%E5%BC%8F。\ndata-source-dir = "/data/backup"\n\n[tikv-importer]\n# 导入模式配置，设为 local 即使用物理导入模式\nincremental-import = true\ndisk-quota = "200GB"\nbackend = "local"\n\n# 冲突数据处理方式\nduplicate-resolution = 'remove'\n\n# 本地进行 KV 排序的路径。\nsorted-kv-dir = "/localimport/tempdata"\n\n# 限制 TiDB Lightning 向每个 TiKV 节点写入的带宽大小，默认为 0，表示不限制。\n# store-write-bwlimit = "128MiB"\n\n# 物理导入模式是否通过 SQL 方式添加索引。默认为 `false`，表示 TiDB Lightning 会将行数据以及索引数据都编码成 KV pairs 后一同导入 TiKV，实现机制和历史版本保持一致。如果设置为 `true`，即 TiDB Lightning 会导完数据后，再使用 add index 的 SQL 来添加索引。\n# 通过 SQL 方式添加索引的优点是将导入数据与导入索引分开，可以快速导入数据，即使导入数据后，索引添加失败，也不会影响数据的一致性。\n# add-index-by-sql = false\n\n[tidb]\n# 目标集群的信息。tidb-server 的地址，填一个即可。\nhost = "10.21.109.11"\nport = 3306\nuser = "root"\n# 设置连接 TiDB 的密码，可为明文或 Base64 编码。\npassword = ""\n# 必须配置。表结构信息从 TiDB 的“status-port”获取。\nstatus-port = 10080\n# 必须配置。pd-server 的地址，填一个即可。\npd-addr = "10.21.109.11:2379"\n# tidb-lightning 引用了 TiDB 库，并生成产生一些日志。\n# 设置 TiDB 库的日志等级。\nlog-level = "error"\n\n[post-restore]\n# 配置是否在导入完成后对每一个表执行 `ADMIN CHECKSUM TABLE <table>` 操作来验证数据的完整性。\n# 可选的配置项：\n# - "required"（默认）。在导入完成后执行 CHECKSUM 检查，如果 CHECKSUM 检查失败，则会报错退出。\n# - "optional"。在导入完成后执行 CHECKSUM 检查，如果报错，会输出一条 WARN 日志并忽略错误。\n# - "off"。导入结束后不执行 CHECKSUM 检查。\n# 默认值为 "required"。从 v4.0.8 开始，checksum 的默认值由此前的 "true" 改为 "required"。\n#\n# 注意：\n# 1. Checksum 对比失败通常表示导入异常（数据丢失或数据不一致），因此建议总是开启 Checksum。\n# 2. 考虑到与旧版本的兼容性，依然可以在本配置项设置 `true` 和 `false` 两个布尔值，其效果与 `required` 和 `off` 相同。\nchecksum = "required"\n# 配置是否在 CHECKSUM 结束后对所有表逐个执行 `ANALYZE TABLE <table>` 操作。\n# 此配置的可选配置项与 `checksum` 相同，但默认值为 "optional"。\nanalyze = "optional"\n" } ] }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "paragraph", "content": [ { "type": "text", "text": "遇到问题" } ] }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "paragraph", "content": [ { "type": "text", "text": "正常现象相关解释（" }, { "type": "link", "attrs": { "href": "https://asktug.com/t/topic/1018802/1" }, "content": [ { "type": "text", "text": "https://asktug.com/t/topic/1018802/1" } ] }, { "type": "text", "text": "）" } ] }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "codeblock", "attrs": { "lang": "markdown" }, "content": [ { "type": "text", "text": "meet error and handle the job later\nput job back to jobCh to retry later\nBR:Restore:ErrRestoreSplitFailed]fail to split region\n" } ] }, { "type": "heading", "attrs": { "level": 1 }, "content": [ { "type": "text", "text": "导入测试结果对比" } ] }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "逻辑导入（导入时长 14 天）" } ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/6e9f3e719b581e224aab14a17e0403296c1ccc8a-1703564363119.png" } }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "物理导入（导入时长 4 天）" } ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/2b6d2e00e7da8c8ed12645c9f586e618fdf3e351_2_690x131-1703564363051.png" } }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "数据记录 count(*) 两种方式是一样的" } ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/7cbd1b3d10d2188eab8508b714994320273be083_2_690x246-1703564363095.png" } }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "paragraph", "content": [ { "type": "text", "text": "物理导入压缩比更高，导入时长更短，为啥不直接使用物理导入，因为官网限制说明有歧义，一个说单表一个说单实例，只能自己测试验证一下，还有一个原因就是我这是单库数据量为 17.30T（sql 文件）" } ] }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/image-1703564608250.png" } }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/image-1703564668883.png" } }, { "type": "heading", "attrs": { "level": 1 }, "content": [ { "type": "text", "text": "正式导入" } ] }, { "type": "paragraph", "content": [ { "type": "text", "text": "配置 mysql 二进制日志周期为 30 天，采用 lighting 物理导入方式导入，导入完后同步增量数据到最新。" } ] }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "版本信息" } ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/image-1703565704461.png" } }, { "type": "heading", "attrs": { "level": 3 }, "content": [ { "type": "text", "text": "验证数据" } ] }, { "type": "paragraph", "content": [ { "type": "text", "text": "select count（*）from table_xxx where create_date_time<‘2012-12-25’" } ] }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "image", "attrs": { "src": "https://tidb-blog.oss-cn-beijing.aliyuncs.com/media/1703565268858-1703565285563.jpg" } }, { "type": "paragraph", "attrs": { }, "content": [ ] }, { "type": "paragraph", "content": [ { "type": "text", "text": "所有重要表验证完毕，任务完成" } ] }, { "type": "paragraph", "attrs": { }, "content": [ ] } ] }

{ "code": 0, "data": { "avatar": "https://static001.geekbang.org/account/avatar/00/2b/c8/9b/b9c2439c.jpg", "fan_count": 17, "intro": "TiDB 社区干货传送门是由 TiDB 社区中布道师组委会自发组织的 TiDB 社区优质内容对外宣布的栏目，旨在加深 TiDBer 之间的交流和学习。一起构建有爱、互助、共创共建的 TiDB 社区 https://tidb.net/", "is_early": 0, "is_sub": false, "mood": "TiDB 社区官网:https://tidb.net/", "nickname": "TiDB 社区干货传送门", "register_time": 1639536645, "ucode": "E47A66A843E94F", "uid": 2869403, "uri": "/profile/E47A66A843E94F/" }, "error": { }, "extra": { "cost": 0.001667941, "request-id": "fff3f808f5234567842d29e0988e5c6b@3@xie" } }

{ "code": 0, "data": { "list": [ ], "page": { "hasmore": false } }, "error": { }, "extra": { "cost": 0.013568846, "request-id": "8d015eaa231d4371bfe3ebc847ec24c3@3@xie" } }

创作场景

一个 39.3T 的集群从 TiDB v3.1.0 迁移升级到 TiDB v7.1.2 的实践

集群目前情况

数据 39.3T

tidb 版本

数据导出方式选择

1、BR 这个版本刚开始支持，不知道有什么未知 bug，暂时没有选择

2、逻辑导出，首先考虑同版本发行对应的 mydumper，出现 tidb server 内存耗尽，放弃

3、最后选择 dumpling v7.1.2，看文档说事兼容以前版本

导出命令

注意密码需要显示配置，否则会报如下错

导入测试

1、逻辑导入

导入配置文件

遇到问题

2、物理导入

物理导入配置文件（只有一个 lightning 导入）

导入测试结果对比

逻辑导入（导入时长 14 天）

物理导入（导入时长 4 天）

数据记录 count(*) 两种方式是一样的

正式导入

版本信息

验证数据

TiDB 社区干货传送门

评论