INFINI 产品更新啦 20230210

Hi，大家好。今天 INFINI Labs 为大家带来 2023 春节后第一波产品更新发布，请查阅。

INFINI Gateway v1.9.0

极限网关本次迭代带来了大量的更新如下：

Breaking changes

• Refactoring config for ip access control

• Disable elasticsearch metadata refresh by default

• Update default config path from configs to config

• Remove sample-configs, moved to dedicated integrated-testing project

• Remove field conntime, update field @timestamp to timestamp in logging filter

• Rename disorder_ to fast_

Features

• Support listen on IPv6 address

• Add general health api

• Add request_ip to context

• Add badger filter plugin

• Allow to split produce and consume messages from s3

• Add bulk_request_throttle filter

• Support access request context and more output options in echo filter

• Add body_json to response context

• Add cert config to API module, support mTLS

• Add api to clear scroll context

• Floating_ip support stick by priority

• Add keystore util

• Allow to save success bulk results in bulk_indexing processor

• Enable watch and reload the major config file

• Support run background job in one goroutine

• Allow to handle async_bulk request logging

• Add config to control cluster health check while cluster not available, set default to false

• Allow to follow redirects in http filter, set default read and write timeout to 30s

• Support collect instance metrics to monitoring gateway

• Add json log format

Bug fix

• Fix user was removed in logging filter

• Fix incorrect message size issue, reload when files changed in disk_queue

• Fix issue that index_diff could not finished automatically

• Fix hostname was not well updated in filter set_request_header or set_hostname

• Fix to check consumer’s lag instead of queue’s lag in flow_runner processor

• Fix file not found error for disk_queue

• Fix the delete requests was not proper handled in filter bulk_reshuffle, bulk_request_mutate and bulk_indexing processor

• Fix memory leak caused by misuse of bytes buffer

• Fix to handle the last request in replay processor

• Fix url args was not updated after change

• Fix memory leak when serving high-concurrent requests

• Fix nil id caused error when using sliced workers in bulk_indexing processor

• Fix index name with dot

• Refactoring time fields for orm, skip empty time

• Refactoring stats, allow to register extended stats

• Fix to restart gateway entrypoint on flow change

• Update ratio filter, fix random number, add header to ratio filter

• Fix query parameter no_cache was not well respected in get_cache filter

• Fix single delete request was ignored in bulk requests

• Fix request mutate filter

Improvements

• Remove newline in indexing_merge and json_indexing processor

• Improve instance check, add config to disable

• Add option skip_insecure_verify to s3 module

• Improve instance check, enable config to disable

• Update the way to get ctx process info, optimize memory usage

• Improve indexing performance for bulk_indexing processor

• Refactoring disk_queue, speedup message consumption

• Enable segment compress for disk_queue by default

• Skip download s3 files when s3 was not enabled

• Add option to log warning messages for throttle filters

• Optimize hash performance for getting primary shardID and partitionID

• Add cache for get index routing table

• Optimize performance for bulk response processing

• Refactoring bulk_processor, pass meta info to payload func

• Don’t call payload func for delete action

• Improve queue consumer’s lag check

• Enable prepare flat files ahead for read by default, skip unnecessary file

• Add object pool for xxhash

• Refactoring disk_queue, handle consumer in-flight segments in memory

• Add config to remove duplicated newline for bulk_processor

• Add metric timestamp in stats api

• Improve error on routing table missing

• Refactoring bytes buffer and object pool, expose metrics via API

• Refactoring tasks pooling, support throttle and unified control

• Optimize badger file size and memory usage

• Refactoring time fields for orm, skip empty time

• Refactoring stats, allow to register extended stats

• Refactoring to handle bulk response results

• Add client_session_cache_size to tls setting

• Safety add newline to each bytes when handle bulk requests

INFINI Console v0.7.0

INFINI Console 本次迭代更新如下：

• 新增初始化安装向导；

• 

• 新增系统服务健康监控；

• 新增 License 授权；

• 

• 新增索引和节点层面数据字节写入吞吐量指标(indexing bytes)；

• 修复了 Discover 第一次加载未发起搜索请求的问题；

• 修复了查看节点线程池指标时选择多个节点后指标不显示的问题；

期待反馈

欢迎下载体验使用，如果您在使用过程中遇到如何疑问或者问题，欢迎前往 INFINI Labs Github（https://github.com/infinilabs） 中的对应项目中提交 Feature Request 或提交 Bug。

• INFINI Gateway： https://github.com/infinilabs/gateway/issues
  

• INFINI Console： https://github.com/infinilabs/console/issues
  

• 下载地址： https://www.infinilabs.com/download/
  

感谢大家的围观，祝大家周末愉快。