采集华为云 CCI 日志到观测云最佳实践
作者：观测云
- 2025-11-28 上海
本文字数：27718 字
阅读完需：约 91 分钟
一、背景与挑战
华为云 CCE 提供了云原生日志采集插件，采集了包含 CCE 集群以及弹性到 CCI 的实例的容器内日志，但对观测云来讲，观测云可以基于 DataKit Operator 以及提供一个 DataKit 的 DaemonSet 部署来实现 CCE 各节点的容器内的日志文件采集，但针对于对于 CCI 的这种 serverless 的容器内日志采集，观测云采集思路包含：
通过观测云的 logforward 的 sidecar 部署来实现日志转发给观测云，这种方式消耗大量的资源，并且要对原有的 CCE 的 Deployment 进行改造注入。
使用 lambda 函数将 LTS 采集的 OBS 的日志上报到观测云，因 CCE 的同一 Deployment 弹性到 CCI，这种方式基于 OBS 区分不出哪些是 CCI 的日志，哪些是 CCE 的日志。
华为云 CCE 云原生日志采集插件中包含了 Otel Collector 组件，通过改造 Otel Collector 的 exporter 配置实现 CCI 日志的导出，这种方式减少了日志接入的成本，避免了资源额外消耗的成本，即本篇重点阐述的最佳实践。
二、前置条件
DataKit：观测云的采集组件，负责 CCE 日志采集与接收 Otel Collector 的 CCI 日志收集导出。
观测云：统一日志检索、查询分析、仪表盘展示、智能告警等。
云原生日志采集插件：负责 CCE 日志和 CCI 日志的采集，插件版本要求 1.5.1 版本以上，插件说明如下。
业务场景环境：华为 CCE 调度到 CCI 场景。
三、采集流程
华为云 CCE 集群容器内日志通过观测云标准方案 DataKit Operator 的方式采集，而弹性到 CCI 的日志通过云原生插件采集 Otel Collector 并导出到观测云 DataKit 服务，最终展示在观测云控制台，如下流程图：
四、配置步骤
步骤 1：CCE 集群弹性到 CCI Demo 搭建
请自行创建 CCE 集群，并创建应用，测试可强制调度到 CCI，如下图：
sp-demo2.yaml
kind: Deployment
apiVersion: apps/v1
metadata:
name: sp-demo2
namespace: default
uid: 403dd3e0-8591-44d8-bd7f-0c8585acb26d
resourceVersion: '295573'
generation: 1
creationTimestamp: '2025-09-12T12:15:48Z'
labels:
appgroup: ''
version: v1
virtual-kubelet.io/burst-to-cci: enforce
annotations:
deployment.kubernetes.io/revision: '1'
description: ''
kubectl.kubernetes.io/last-applied-configuration: >
{"apiVersion":"apps/v1","kind":"Deployment","metadata":{"annotations":{"deployment.kubernetes.io/revision":"5","description":"","workload.cce.io/swr-version":"[{\"version\":\"Private
Edition\"}]"},"labels":{"appgroup":"","version":"v1","virtual-kubelet.io/burst-to-cci":"enforce"},"name":"sp-demo2","namespace":"default"},"spec":{"progressDeadlineSeconds":600,"replicas":1,"revisionHistoryLimit":10,"selector":{"matchLabels":{"app":"sp-demo2","version":"v1"}},"strategy":{"rollingUpdate":{"maxSurge":"25%","maxUnavailable":"25%"},"type":"RollingUpdate"},"template":{"metadata":{"labels":{"app":"sp-demo2","version":"v1"}},"spec":{"containers":[{"env":[{"name":"PAAS_APP_NAME","value":"sp-demo2"},{"name":"PAAS_NAMESPACE","value":"default"},{"name":"PAAS_PROJECT_ID","value":"bacc65fb662f435dab3acda49acae0c9"}],"image":"swr.cn-north-4.myhuaweicloud.com/liurui_bj/springboot-server:openj8","imagePullPolicy":"IfNotPresent","name":"container-1","resources":{"limits":{"cpu":"250m","memory":"512Mi"},"requests":{"cpu":"250m","memory":"512Mi"}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","imagePullSecrets":[{"name":"default-secret"}],"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"terminationGracePeriodSeconds":30,"tolerations":[{"effect":"NoExecute","key":"node.kubernetes.io/not-ready","operator":"Exists","tolerationSeconds":300},{"effect":"NoExecute","key":"node.kubernetes.io/unreachable","operator":"Exists","tolerationSeconds":300}]}}}}
workload.cce.io/swr-version: '[{"version":"Private Edition"}]'
managedFields:
- manager: kubectl-client-side-apply
operation: Update
apiVersion: apps/v1
time: '2025-09-12T12:15:48Z'
fieldsType: FieldsV1
fieldsV1:
f:metadata:
f:annotations:
.: {}
f:description: {}
f:kubectl.kubernetes.io/last-applied-configuration: {}
f:workload.cce.io/swr-version: {}
f:labels:
.: {}
f:appgroup: {}
f:version: {}
f:virtual-kubelet.io/burst-to-cci: {}
f:spec:
f:progressDeadlineSeconds: {}
f:replicas: {}
f:revisionHistoryLimit: {}
f:selector: {}
f:strategy:
f:rollingUpdate:
.: {}
f:maxSurge: {}
f:maxUnavailable: {}
f:type: {}
f:template:
f:metadata:
f:labels:
.: {}
f:app: {}
f:version: {}
f:spec:
f:containers:
k:{"name":"container-1"}:
.: {}
f:env:
.: {}
k:{"name":"PAAS_APP_NAME"}:
.: {}
f:name: {}
f:value: {}
k:{"name":"PAAS_NAMESPACE"}:
.: {}
f:name: {}
f:value: {}
k:{"name":"PAAS_PROJECT_ID"}:
.: {}
f:name: {}
f:value: {}
f:image: {}
f:imagePullPolicy: {}
f:name: {}
f:resources:
.: {}
f:limits:
.: {}
f:cpu: {}
f:memory: {}
f:requests:
.: {}
f:cpu: {}
f:memory: {}
f:terminationMessagePath: {}
f:terminationMessagePolicy: {}
f:dnsPolicy: {}
f:imagePullSecrets:
.: {}
k:{"name":"default-secret"}: {}
f:restartPolicy: {}
f:schedulerName: {}
f:securityContext: {}
f:terminationGracePeriodSeconds: {}
f:tolerations: {}
- manager: kube-controller-manager
operation: Update
apiVersion: apps/v1
time: '2025-09-12T12:16:19Z'
fieldsType: FieldsV1
fieldsV1:
f:metadata:
f:annotations:
f:deployment.kubernetes.io/revision: {}
f:status:
f:availableReplicas: {}
f:conditions:
.: {}
k:{"type":"Available"}:
.: {}
f:lastTransitionTime: {}
f:lastUpdateTime: {}
f:message: {}
f:reason: {}
f:status: {}
f:type: {}
k:{"type":"Progressing"}:
.: {}
f:lastTransitionTime: {}
f:lastUpdateTime: {}
f:message: {}
f:reason: {}
f:status: {}
f:type: {}
f:observedGeneration: {}
f:readyReplicas: {}
f:replicas: {}
f:updatedReplicas: {}
subresource: status
spec:
replicas: 1
selector:
matchLabels:
app: sp-demo2
version: v1
template:
metadata:
creationTimestamp: null
labels:
app: sp-demo2
version: v1
spec:
containers:
- name: container-1
image: swr.cn-north-4.myhuaweicloud.com/liurui_bj/springboot-server:openj8
env:
- name: PAAS_APP_NAME
value: sp-demo2
- name: PAAS_NAMESPACE
value: default
- name: PAAS_PROJECT_ID
value: bacc65fb662f435dab3acda49acae0c9
resources:
limits:
cpu: 250m
memory: 512Mi
requests:
cpu: 250m
memory: 512Mi
terminationMessagePath: /dev/termination-log
terminationMessagePolicy: File
imagePullPolicy: IfNotPresent
restartPolicy: Always
terminationGracePeriodSeconds: 30
dnsPolicy: ClusterFirst
securityContext: {}
imagePullSecrets:
- name: default-secret
schedulerName: default-scheduler
tolerations:
- key: node.kubernetes.io/not-ready
operator: Exists
effect: NoExecute
tolerationSeconds: 300
- key: node.kubernetes.io/unreachable
operator: Exists
effect: NoExecute
tolerationSeconds: 300
strategy:
type: RollingUpdate
rollingUpdate:
maxUnavailable: 25%
maxSurge: 25%
revisionHistoryLimit: 10
progressDeadlineSeconds: 600
status:
observedGeneration: 1
replicas: 1
updatedReplicas: 1
readyReplicas: 1
availableReplicas: 1
conditions:
- type: Available
status: 'True'
lastUpdateTime: '2025-09-12T12:16:19Z'
lastTransitionTime: '2025-09-12T12:16:19Z'
reason: MinimumReplicasAvailable
message: Deployment has minimum availability.
- type: Progressing
status: 'True'
lastUpdateTime: '2025-09-12T12:16:19Z'
lastTransitionTime: '2025-09-12T12:15:48Z'
reason: NewReplicaSetAvailable
message: ReplicaSet "sp-demo2-7d9cd96c44" has successfully progressed.
复制代码
查看 CCI 节点运行的 pod ：
本次要采集的 CCI 容器内日志为 server.log，目录如下：
步骤 2：在 CCE 安装云原生日志采集插件
在 CCE 插件中心安装云原生日志采集插件，实例规格自定义配置
在日志中心创建 CCI 日志采集策略
华为云 LTS 日志采集展示
步骤 3：在 CCE 集群部署 DataKit
通过 kubectl apply -f datakit.yaml 命令实现在华为云 CCE 的的一个 Daemonset 部署，采集器要开启 opentelemetry 采集器，并通过亲和性设置不让 DataKit 调度到虚拟节点
datakit.yaml
kind: DaemonSetapiVersion: apps/v1metadata: name: datakit namespace: datakit uid: 122c1472-03cd-4ec6-a684-0384e40b011c resourceVersion: '5351437' generation: 2 creationTimestamp: '2025-09-16T10:45:45Z' labels: app: daemonset-datakit annotations: deprecated.daemonset.template.generation: '2' kubectl.kubernetes.io/last-applied-configuration: > {"apiVersion":"apps/v1","kind":"DaemonSet","metadata":{"annotations":{},"labels":{"app":"daemonset-datakit"},"name":"datakit","namespace":"datakit"},"spec":{"revisionHistoryLimit":10,"selector":{"matchLabels":{"app":"daemonset-datakit"}},"template":{"metadata":{"labels":{"app":"daemonset-datakit"}},"spec":{"containers":[{"env":[{"name":"POD_NAME","valueFrom":{"fieldRef":{"fieldPath":"metadata.name"}}},{"name":"ENV_K8S_NODE_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.hostIP"}}},{"name":"ENV_K8S_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"ENV_DATAWAY","value":"https://openway.guance.com?token=tkn_3a0052c9f6d3498c8ce9ca0988fd9c82"},{"name":"ENV_CLUSTER_NAME_K8S","value":"cce"},{"name":"ENV_GLOBAL_HOST_TAGS","value":"host=__datakit_hostname,host_ip=__datakit_ip"},{"name":"ENV_GLOBAL_ELECTION_TAGS","value":""},{"name":"ENV_DEFAULT_ENABLED_INPUTS","value":"statsd,dk,cpu,disk,diskio,mem,swap,system,hostobject,net,host_processes,container,kubernetesprometheus,logfwdserver,opentelemetry"},{"name":"ENV_ENABLE_ELECTION","value":"enable"},{"name":"ENV_INPUT_CONTAINER_ENABLE_POD_METRIC","value":"true"},{"name":"ENV_HTTP_LISTEN","value":"0.0.0.0:9529"},{"name":"ENV_INPUT_OTEL_GRPC","value":"{\"addr\": \"0.0.0.0:4317\"}"},{"name":"HOST_PROC","value":"/rootfs/proc"},{"name":"HOST_SYS","value":"/rootfs/sys"},{"name":"HOST_ETC","value":"/rootfs/etc"},{"name":"HOST_VAR","value":"/rootfs/var"},{"name":"HOST_RUN","value":"/rootfs/run"},{"name":"HOST_DEV","value":"/rootfs/dev"},{"name":"HOST_ROOT","value":"/rootfs"}],"image":"swr.cn-north-4.myhuaweicloud.com/liurui_bj/datakit:1.79.0","imagePullPolicy":"IfNotPresent","name":"datakit","ports":[{"containerPort":9529,"hostPort":9529,"name":"http-port","protocol":"TCP"},{"containerPort":8125,"hostPort":8125,"name":"statsd-port","protocol":"UDP"},{"containerPort":4317,"hostPort":4317,"name":"otel-grpc-port","protocol":"TCP"},{"containerPort":9533,"hostPort":9533,"name":"logfwd-port","protocol":"TCP"}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"200m","memory":"128Mi"}},"securityContext":{"privileged":true},"volumeMounts":[{"mountPath":"/usr/local/datakit/cache","name":"cache","readOnly":false},{"mountPath":"/rootfs","mountPropagation":"HostToContainer","name":"rootfs"},{"mountPath":"/var/run","mountPropagation":"HostToContainer","name":"run"},{"mountPath":"/sys/kernel/debug","name":"debugfs"},{"mountPath":"/var/lib/containerd/container_logs","name":"container-logs"},{"mountPath":"/usr/local/datakit/conf.d/kubernetesprometheus/kubelet.conf","name":"datakit-conf","subPath":"kubelet.conf"}],"workingDir":"/usr/local/datakit"}],"dnsPolicy":"ClusterFirstWithHostNet","hostIPC":true,"hostNetwork":true,"hostPID":true,"restartPolicy":"Always","serviceAccount":"datakit","serviceAccountName":"datakit","tolerations":[{"operator":"Exists"}],"volumes":[{"configMap":{"name":"datakit-conf"},"name":"datakit-conf"},{"hostPath":{"path":"/"},"name":"rootfs"},{"hostPath":{"path":"/var/run"},"name":"run"},{"hostPath":{"path":"/sys/kernel/debug"},"name":"debugfs"},{"hostPath":{"path":"/root/datakit_cache"},"name":"cache"},{"hostPath":{"path":"/var/lib/containerd/container_logs"},"name":"container-logs"}]}},"updateStrategy":{"rollingUpdate":{"maxUnavailable":1},"type":"RollingUpdate"}}} managedFields: - manager: kubectl-client-side-apply operation: Update apiVersion: apps/v1 time: '2025-09-16T10:45:45Z' fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: .: {} f:deprecated.daemonset.template.generation: {} f:kubectl.kubernetes.io/last-applied-configuration: {} f:labels: .: {} f:app: {} f:spec: f:revisionHistoryLimit: {} f:selector: {} f:template: f:metadata: f:labels: .: {} f:app: {} f:spec: f:containers: k:{"name":"datakit"}: .: {} f:env: .: {} k:{"name":"ENV_CLUSTER_NAME_K8S"}: .: {} f:name: {} f:value: {} k:{"name":"ENV_DATAWAY"}: .: {} f:name: {} f:value: {} k:{"name":"ENV_DEFAULT_ENABLED_INPUTS"}: .: {} f:name: {} f:value: {} k:{"name":"ENV_ENABLE_ELECTION"}: .: {} f:name: {} f:value: {} k:{"name":"ENV_GLOBAL_ELECTION_TAGS"}: .: {} f:name: {} k:{"name":"ENV_GLOBAL_HOST_TAGS"}: .: {} f:name: {} f:value: {} k:{"name":"ENV_HTTP_LISTEN"}: .: {} f:name: {} f:value: {} k:{"name":"ENV_INPUT_CONTAINER_ENABLE_POD_METRIC"}: .: {} f:name: {} f:value: {} k:{"name":"ENV_INPUT_OTEL_GRPC"}: .: {} f:name: {} f:value: {} k:{"name":"ENV_K8S_NODE_IP"}: .: {} f:name: {} f:valueFrom: .: {} f:fieldRef: {} k:{"name":"ENV_K8S_NODE_NAME"}: .: {} f:name: {} f:valueFrom: .: {} f:fieldRef: {} k:{"name":"HOST_DEV"}: .: {} f:name: {} f:value: {} k:{"name":"HOST_ETC"}: .: {} f:name: {} f:value: {} k:{"name":"HOST_PROC"}: .: {} f:name: {} f:value: {} k:{"name":"HOST_ROOT"}: .: {} f:name: {} f:value: {} k:{"name":"HOST_RUN"}: .: {} f:name: {} f:value: {} k:{"name":"HOST_SYS"}: .: {} f:name: {} f:value: {} k:{"name":"HOST_VAR"}: .: {} f:name: {} f:value: {} k:{"name":"POD_NAME"}: .: {} f:name: {} f:valueFrom: .: {} f:fieldRef: {} f:image: {} f:imagePullPolicy: {} f:name: {} f:ports: .: {} k:{"containerPort":4317,"protocol":"TCP"}: .: {} f:containerPort: {} f:hostPort: {} f:name: {} f:protocol: {} k:{"containerPort":8125,"protocol":"UDP"}: .: {} f:containerPort: {} f:hostPort: {} f:name: {} f:protocol: {} k:{"containerPort":9529,"protocol":"TCP"}: .: {} f:containerPort: {} f:hostPort: {} f:name: {} f:protocol: {} k:{"containerPort":9533,"protocol":"TCP"}: .: {} f:containerPort: {} f:hostPort: {} f:name: {} f:protocol: {} f:resources: .: {} f:limits: .: {} f:cpu: {} f:memory: {} f:requests: .: {} f:cpu: {} f:memory: {} f:securityContext: .: {} f:privileged: {} f:terminationMessagePath: {} f:terminationMessagePolicy: {} f:volumeMounts: .: {} k:{"mountPath":"/rootfs"}: .: {} f:mountPath: {} f:mountPropagation: {} f:name: {} k:{"mountPath":"/sys/kernel/debug"}: .: {} f:mountPath: {} f:name: {} k:{"mountPath":"/usr/local/datakit/cache"}: .: {} f:mountPath: {} f:name: {} k:{"mountPath":"/usr/local/datakit/conf.d/kubernetesprometheus/kubelet.conf"}: .: {} f:mountPath: {} f:name: {} f:subPath: {} k:{"mountPath":"/var/lib/containerd/container_logs"}: .: {} f:mountPath: {} f:name: {} k:{"mountPath":"/var/run"}: .: {} f:mountPath: {} f:mountPropagation: {} f:name: {} f:workingDir: {} f:dnsPolicy: {} f:hostIPC: {} f:hostNetwork: {} f:hostPID: {} f:restartPolicy: {} f:schedulerName: {} f:securityContext: {} f:serviceAccount: {} f:serviceAccountName: {} f:terminationGracePeriodSeconds: {} f:tolerations: {} f:volumes: .: {} k:{"name":"cache"}: .: {} f:hostPath: .: {} f:path: {} f:type: {} f:name: {} k:{"name":"container-logs"}: .: {} f:hostPath: .: {} f:path: {} f:type: {} f:name: {} k:{"name":"datakit-conf"}: .: {} f:configMap: .: {} f:defaultMode: {} f:name: {} f:name: {} k:{"name":"debugfs"}: .: {} f:hostPath: .: {} f:path: {} f:type: {} f:name: {} k:{"name":"rootfs"}: .: {} f:hostPath: .: {} f:path: {} f:type: {} f:name: {} k:{"name":"run"}: .: {} f:hostPath: .: {} f:path: {} f:type: {} f:name: {} f:updateStrategy: f:rollingUpdate: .: {} f:maxSurge: {} f:maxUnavailable: {} f:type: {} - manager: cfe-apiserver operation: Update apiVersion: apps/v1 time: '2025-09-19T06:28:11Z' fieldsType: FieldsV1 fieldsV1: f:spec: f:template: f:spec: f:affinity: .: {} f:nodeAffinity: .: {} f:requiredDuringSchedulingIgnoredDuringExecution: {} - manager: kube-controller-manager operation: Update apiVersion: apps/v1 time: '2025-09-19T06:28:19Z' fieldsType: FieldsV1 fieldsV1: f:status: f:currentNumberScheduled: {} f:desiredNumberScheduled: {} f:numberAvailable: {} f:numberMisscheduled: {} f:numberReady: {} f:observedGeneration: {} f:updatedNumberScheduled: {} subresource: statusspec: selector: matchLabels: app: daemonset-datakit template: metadata: creationTimestamp: null labels: app: daemonset-datakit spec: volumes: - name: datakit-conf configMap: name: datakit-conf defaultMode: 420 - name: rootfs hostPath: path: / type: '' - name: run hostPath: path: /var/run type: '' - name: debugfs hostPath: path: /sys/kernel/debug type: '' - name: cache hostPath: path: /root/datakit_cache type: '' - name: container-logs hostPath: path: /var/lib/containerd/container_logs type: '' containers: - name: datakit image: swr.cn-north-4.myhuaweicloud.com/liurui_bj/datakit:1.79.0 workingDir: /usr/local/datakit ports: - name: http-port hostPort: 9529 containerPort: 9529 protocol: TCP - name: statsd-port hostPort: 8125 containerPort: 8125 protocol: UDP - name: otel-grpc-port hostPort: 4317 containerPort: 4317 protocol: TCP - name: logfwd-port hostPort: 9533 containerPort: 9533 protocol: TCP env: - name: POD_NAME valueFrom: fieldRef: apiVersion: v1 fieldPath: metadata.name - name: ENV_K8S_NODE_IP valueFrom: fieldRef: apiVersion: v1 fieldPath: status.hostIP - name: ENV_K8S_NODE_NAME valueFrom: fieldRef: apiVersion: v1 fieldPath: spec.nodeName - name: ENV_DATAWAY value: https://openway.guance.com?token=tkn_3a0052c9f6d3498c8ce9ca0988fd9c82 - name: ENV_CLUSTER_NAME_K8S value: cce - name: ENV_GLOBAL_HOST_TAGS value: host=__datakit_hostname,host_ip=__datakit_ip - name: ENV_GLOBAL_ELECTION_TAGS - name: ENV_DEFAULT_ENABLED_INPUTS value: statsd,dk,cpu,disk,diskio,mem,swap,system,hostobject,net,host_processes,container,kubernetesprometheus,logfwdserver,opentelemetry - name: ENV_ENABLE_ELECTION value: enable - name: ENV_INPUT_CONTAINER_ENABLE_POD_METRIC value: 'true' - name: ENV_HTTP_LISTEN value: 0.0.0.0:9529 - name: ENV_INPUT_OTEL_GRPC value: '{"addr": "0.0.0.0:4317"}' - name: HOST_PROC value: /rootfs/proc - name: HOST_SYS value: /rootfs/sys - name: HOST_ETC value: /rootfs/etc - name: HOST_VAR value: /rootfs/var - name: HOST_RUN value: /rootfs/run - name: HOST_DEV value: /rootfs/dev - name: HOST_ROOT value: /rootfs resources: limits: cpu: 500m memory: 1Gi requests: cpu: 200m memory: 128Mi volumeMounts: - name: cache mountPath: /usr/local/datakit/cache - name: rootfs mountPath: /rootfs mountPropagation: HostToContainer - name: run mountPath: /var/run mountPropagation: HostToContainer - name: debugfs mountPath: /sys/kernel/debug - name: container-logs mountPath: /var/lib/containerd/container_logs - name: datakit-conf mountPath: /usr/local/datakit/conf.d/kubernetesprometheus/kubelet.conf subPath: kubelet.conf terminationMessagePath: /dev/termination-log terminationMessagePolicy: File imagePullPolicy: IfNotPresent securityContext: privileged: true restartPolicy: Always terminationGracePeriodSeconds: 30 dnsPolicy: ClusterFirstWithHostNet serviceAccountName: datakit serviceAccount: datakit hostNetwork: true hostPID: true hostIPC: true securityContext: {} affinity: nodeAffinity: requiredDuringSchedulingIgnoredDuringExecution: nodeSelectorTerms: - matchExpressions: - key: bursting.cci.io/node-type operator: NotIn values: - virtual-kubelet schedulerName: default-scheduler tolerations: - operator: Exists updateStrategy: type: RollingUpdate rollingUpdate: maxUnavailable: 1 maxSurge: 0 revisionHistoryLimit: 10status: currentNumberScheduled: 2 numberMisscheduled: 0 desiredNumberScheduled: 2 numberReady: 2 observedGeneration: 2 updatedNumberScheduled: 2 numberAvailable: 2
复制代码
进入 datakit 容器，并执行 datakit monitor 查看 opentelemetry 采集器是否开启
步骤 4：重写 Otel Collector 的采集配置
log-agent-otel-collector.yaml
kind: DeploymentapiVersion: apps/v1metadata: name: log-agent-otel-collector namespace: monitoring uid: c055d466-4287-4860-9ff7-d28cc036ae89 resourceVersion: '7557223' generation: 3 creationTimestamp: '2025-09-22T07:28:09Z' labels: app: log-agent-otel-collector app.kubernetes.io/managed-by: Helm release: cceaddon-log-agent annotations: deployment.kubernetes.io/revision: '3' kubectl.kubernetes.io/last-applied-configuration: > {"apiVersion":"apps/v1","kind":"Deployment","metadata":{"annotations":{"deployment.kubernetes.io/revision":"3","meta.helm.sh/release-name":"cceaddon-log-agent","meta.helm.sh/release-namespace":"monitoring"},"creationTimestamp":"2025-09-20T19:02:18Z","generation":3,"labels":{"app":"log-agent-otel-collector","app.kubernetes.io/managed-by":"Helm","release":"cceaddon-log-agent"},"name":"log-agent-otel-collector","namespace":"monitoring","resourceVersion":"7514159","uid":"180806a1-7260-4139-989c-73945d7b1a4c"},"spec":{"minReadySeconds":5,"progressDeadlineSeconds":120,"replicas":2,"revisionHistoryLimit":10,"selector":{"matchLabels":{"app":"log-agent-otel-collector"}},"strategy":{"rollingUpdate":{"maxSurge":1,"maxUnavailable":1},"type":"RollingUpdate"},"template":{"metadata":{"annotations":{"prometheus.io/path":"/metrics","prometheus.io/port":"8888","prometheus.io/scheme":"http","prometheus.io/scrape":"true","redeploy-timestamp":"1758396245987","scheduler.alpha.kubernetes.io/tolerations":"[{\"key\": \"taint.alpha.kubernetes.io/nodedown\",\"value\": \"\",\"effect\": \"NoExecute\",\"operator\": \"Exists\"}]"},"creationTimestamp":null,"labels":{"app":"log-agent-otel-collector","release":"cceaddon-log-agent"}},"spec":{"affinity":{"podAntiAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["log-agent-otel-collector"]}]},"topologyKey":"topology.kubernetes.io/zone"},"weight":100}]}},"containers":[{"args":["--config=/var/paas/ot-collector/ot-collector-service.yaml"],"command":["/var/paas/otel-collector/otelcol"],"env":[{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"Region","value":"cn-north-4"},{"name":"ProjectID","value":"9e92837f567145009ad4d230c4ac2c01"},{"name":"ClusterID","value":"74e8b92f-8f80-11f0-afe1-0255ac10026c"},{"name":"ClusterName","value":"cce-cci"},{"name":"WATCH_SECRET","value":"true"},{"name":"INSECURE_SKIP_VERIFY","value":"true"},{"name":"SCENE","value":"HWS"},{"name":"AKSK_SECRET_NAME","value":"paas.elb"},{"name":"WATCH_CLUSTER_CONFIG","value":"true"},{"name":"AOM_ENDPOINT","value":"https://aom.cn-north-4.myhuaweicloud.com"},{"name":"LTS_ACCESS_ENDPOINT","value":"https://lts-access.cn-north-4.myhuaweicloud.com:8102"},{"name":"CRYPTO_ENABLE","value":"true"},{"name":"PAAS_CRYPTO_PATH","value":"/etc/cipher"}],"image":"swr.cn-north-4.myhuaweicloud.com/hwofficial/otelcol:1.7.4","imagePullPolicy":"IfNotPresent","livenessProbe":{"exec":{"command":["/bin/bash","-c","exit 0"]},"failureThreshold":3,"initialDelaySeconds":20,"periodSeconds":20,"successThreshold":1,"timeoutSeconds":10},"name":"otel-collector","ports":[{"containerPort":8006,"protocol":"TCP"},{"containerPort":4317,"protocol":"TCP"},{"containerPort":8888,"name":"metric-port","protocol":"TCP"}],"resources":{"limits":{"cpu":"1","memory":"2Gi"},"requests":{"cpu":"200m","memory":"1Gi"}},"securityContext":{"allowPrivilegeEscalation":false,"readOnlyRootFilesystem":true,"runAsGroup":10000,"runAsUser":10000},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","volumeMounts":[{"mountPath":"/var/paas/otel-collector/conf","name":"otel-collector-config-vol","readOnly":true},{"mountPath":"/var/paas/ot-collector/ot-collector-service.yaml","name":"ot-collector-service","readOnly":true,"subPath":"ot-collector-service.yaml"},{"mountPath":"/var/paas/sys/log","name":"logpath"},{"mountPath":"/etc/cipher/root.key","name":"rootkey","readOnly":true},{"mountPath":"/etc/cipher/common_shared.key","name":"commonsharedkey","readOnly":true},{"mountPath":"/var/paas/cert","name":"cert","readOnly":true}]}],"dnsConfig":{"options":[{"name":"ndots","value":"3"}]},"dnsPolicy":"ClusterFirst","initContainers":[{"command":["/bin/sh","-c","mkdir -p /var/paas/sys/log/otel \u0026\u0026 chmod 750 /var/paas/sys/log/otel \u0026\u0026 chown -R 10000:10000 /var/paas/sys/log/otel"],"image":"swr.cn-north-4.myhuaweicloud.com/hwofficial/otelcol:1.7.4","imagePullPolicy":"IfNotPresent","name":"init","resources":{"limits":{"cpu":"200m","memory":"200Mi"},"requests":{"cpu":"100m","memory":"100Mi"}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","volumeMounts":[{"mountPath":"/var/paas/sys/log","name":"logpath"}]}],"priorityClassName":"system-cluster-critical","restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{"fsGroup":10000},"serviceAccount":"log-agent-serviceaccount","serviceAccountName":"log-agent-serviceaccount","terminationGracePeriodSeconds":30,"tolerations":[{"effect":"NoExecute","key":"node.kubernetes.io/not-ready","operator":"Exists","tolerationSeconds":30},{"effect":"NoExecute","key":"node.kubernetes.io/unreachable","operator":"Exists","tolerationSeconds":30},{"key":"role","operator":"Exists"},{"effect":"NoSchedule","key":"distribution.io/category","operator":"Equal","value":"IES"}],"volumes":[{"name":"otel-collector-config-vol","secret":{"defaultMode":384,"secretName":"log-agent-otel-collector-config"}},{"configMap":{"defaultMode":420,"items":[{"key":"ot-collector-service.yaml","path":"ot-collector-service.yaml"}],"name":"ot-collector-service"},"name":"ot-collector-service"},{"name":"cert","secret":{"defaultMode":416,"items":[{"key":"caCert","path":"caCert"},{"key":"serverCert","path":"serverCert"},{"key":"serverKey","path":"serverKey"}],"secretName":"log-agent-cert-secret"}},{"hostPath":{"path":"/var/paas/sys/log","type":""},"name":"logpath"},{"hostPath":{"path":"/var/paas/srv/kubernetes/root.key","type":""},"name":"rootkey"},{"hostPath":{"path":"/var/paas/srv/kubernetes/common_shared.key","type":""},"name":"commonsharedkey"}]}}},"status":{"conditions":[{"lastTransitionTime":"2025-09-20T19:02:18Z","lastUpdateTime":"2025-09-20T19:37:31Z","message":"ReplicaSet \"log-agent-otel-collector-8fbf8c694\" has successfully progressed.","reason":"NewReplicaSetAvailable","status":"True","type":"Progressing"},{"lastTransitionTime":"2025-09-22T06:15:38Z","lastUpdateTime":"2025-09-22T06:15:38Z","message":"Deployment does not have minimum availability.","reason":"MinimumReplicasUnavailable","status":"False","type":"Available"}],"observedGeneration":3,"replicas":2,"unavailableReplicas":2,"updatedReplicas":2}} meta.helm.sh/release-name: cceaddon-log-agent meta.helm.sh/release-namespace: monitoring managedFields: - manager: kubectl-client-side-apply operation: Update apiVersion: apps/v1 time: '2025-09-22T07:28:09Z' fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: .: {} f:kubectl.kubernetes.io/last-applied-configuration: {} f:meta.helm.sh/release-name: {} f:meta.helm.sh/release-namespace: {} f:labels: .: {} f:app: {} f:app.kubernetes.io/managed-by: {} f:release: {} f:spec: f:minReadySeconds: {} f:progressDeadlineSeconds: {} f:replicas: {} f:revisionHistoryLimit: {} f:selector: {} f:strategy: f:rollingUpdate: .: {} f:maxSurge: {} f:maxUnavailable: {} f:type: {} f:template: f:metadata: f:annotations: .: {} f:prometheus.io/path: {} f:prometheus.io/port: {} f:prometheus.io/scheme: {} f:prometheus.io/scrape: {} f:scheduler.alpha.kubernetes.io/tolerations: {} f:labels: .: {} f:app: {} f:release: {} f:spec: f:affinity: .: {} f:podAntiAffinity: .: {} f:preferredDuringSchedulingIgnoredDuringExecution: {} f:containers: k:{"name":"otel-collector"}: .: {} f:args: {} f:command: {} f:env: .: {} k:{"name":"AKSK_SECRET_NAME"}: .: {} f:name: {} f:value: {} k:{"name":"AOM_ENDPOINT"}: .: {} f:name: {} f:value: {} k:{"name":"CRYPTO_ENABLE"}: .: {} f:name: {} f:value: {} k:{"name":"ClusterID"}: .: {} f:name: {} f:value: {} k:{"name":"ClusterName"}: .: {} f:name: {} f:value: {} k:{"name":"INSECURE_SKIP_VERIFY"}: .: {} f:name: {} f:value: {} k:{"name":"LTS_ACCESS_ENDPOINT"}: .: {} f:name: {} f:value: {} k:{"name":"PAAS_CRYPTO_PATH"}: .: {} f:name: {} f:value: {} k:{"name":"POD_IP"}: .: {} f:name: {} f:valueFrom: .: {} f:fieldRef: {} k:{"name":"ProjectID"}: .: {} f:name: {} f:value: {} k:{"name":"Region"}: .: {} f:name: {} f:value: {} k:{"name":"SCENE"}: .: {} f:name: {} f:value: {} k:{"name":"WATCH_CLUSTER_CONFIG"}: .: {} f:name: {} f:value: {} k:{"name":"WATCH_SECRET"}: .: {} f:name: {} f:value: {} f:image: {} f:imagePullPolicy: {} f:livenessProbe: .: {} f:exec: .: {} f:command: {} f:failureThreshold: {} f:initialDelaySeconds: {} f:periodSeconds: {} f:successThreshold: {} f:timeoutSeconds: {} f:name: {} f:ports: .: {} k:{"containerPort":4317,"protocol":"TCP"}: .: {} f:containerPort: {} f:protocol: {} k:{"containerPort":8006,"protocol":"TCP"}: .: {} f:containerPort: {} f:protocol: {} k:{"containerPort":8888,"protocol":"TCP"}: .: {} f:containerPort: {} f:name: {} f:protocol: {} f:resources: .: {} f:limits: .: {} f:cpu: {} f:memory: {} f:requests: .: {} f:cpu: {} f:memory: {} f:securityContext: .: {} f:allowPrivilegeEscalation: {} f:readOnlyRootFilesystem: {} f:runAsGroup: {} f:runAsUser: {} f:terminationMessagePath: {} f:terminationMessagePolicy: {} f:volumeMounts: .: {} k:{"mountPath":"/etc/cipher/common_shared.key"}: .: {} f:mountPath: {} f:name: {} f:readOnly: {} k:{"mountPath":"/etc/cipher/root.key"}: .: {} f:mountPath: {} f:name: {} f:readOnly: {} k:{"mountPath":"/var/paas/cert"}: .: {} f:mountPath: {} f:name: {} f:readOnly: {} k:{"mountPath":"/var/paas/ot-collector/ot-collector-service.yaml"}: .: {} f:mountPath: {} f:name: {} f:readOnly: {} f:subPath: {} k:{"mountPath":"/var/paas/otel-collector/conf"}: .: {} f:mountPath: {} f:name: {} f:readOnly: {} k:{"mountPath":"/var/paas/sys/log"}: .: {} f:mountPath: {} f:name: {} f:dnsConfig: .: {} f:options: {} f:dnsPolicy: {} f:initContainers: .: {} k:{"name":"init"}: .: {} f:command: {} f:image: {} f:imagePullPolicy: {} f:name: {} f:resources: .: {} f:limits: .: {} f:cpu: {} f:memory: {} f:requests: .: {} f:cpu: {} f:memory: {} f:terminationMessagePath: {} f:terminationMessagePolicy: {} f:volumeMounts: .: {} k:{"mountPath":"/var/paas/sys/log"}: .: {} f:mountPath: {} f:name: {} f:priorityClassName: {} f:restartPolicy: {} f:schedulerName: {} f:securityContext: .: {} f:fsGroup: {} f:serviceAccount: {} f:serviceAccountName: {} f:terminationGracePeriodSeconds: {} f:tolerations: {} f:volumes: .: {} k:{"name":"cert"}: .: {} f:name: {} f:secret: .: {} f:defaultMode: {} f:items: {} f:secretName: {} k:{"name":"commonsharedkey"}: .: {} f:hostPath: .: {} f:path: {} f:type: {} f:name: {} k:{"name":"logpath"}: .: {} f:hostPath: .: {} f:path: {} f:type: {} f:name: {} k:{"name":"ot-collector-service"}: .: {} f:configMap: .: {} f:defaultMode: {} f:items: {} f:name: {} f:name: {} k:{"name":"otel-collector-config-vol"}: .: {} f:name: {} f:secret: .: {} f:defaultMode: {} f:secretName: {} k:{"name":"rootkey"}: .: {} f:hostPath: .: {} f:path: {} f:type: {} f:name: {} - manager: cfe-apiserver operation: Update apiVersion: apps/v1 time: '2025-09-22T07:40:23Z' fieldsType: FieldsV1 fieldsV1: f:spec: f:template: f:metadata: f:annotations: f:redeploy-timestamp: {} - manager: kube-controller-manager operation: Update apiVersion: apps/v1 time: '2025-09-22T07:40:31Z' fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: f:deployment.kubernetes.io/revision: {} f:status: f:availableReplicas: {} f:conditions: .: {} k:{"type":"Available"}: .: {} f:lastTransitionTime: {} f:lastUpdateTime: {} f:message: {} f:reason: {} f:status: {} f:type: {} k:{"type":"Progressing"}: .: {} f:lastTransitionTime: {} f:lastUpdateTime: {} f:message: {} f:reason: {} f:status: {} f:type: {} f:observedGeneration: {} f:readyReplicas: {} f:replicas: {} f:updatedReplicas: {} subresource: statusspec: replicas: 2 selector: matchLabels: app: log-agent-otel-collector template: metadata: creationTimestamp: null labels: app: log-agent-otel-collector release: cceaddon-log-agent annotations: prometheus.io/path: /metrics prometheus.io/port: '8888' prometheus.io/scheme: http prometheus.io/scrape: 'true' redeploy-timestamp: '1758526823089' scheduler.alpha.kubernetes.io/tolerations: '[{"key": "taint.alpha.kubernetes.io/nodedown","value": "","effect": "NoExecute","operator": "Exists"}]' spec: volumes: - name: otel-collector-config-vol secret: secretName: log-agent-otel-collector-config defaultMode: 384 - name: ot-collector-service configMap: name: ot-collector-service items: - key: ot-collector-service.yaml path: ot-collector-service.yaml defaultMode: 420 - name: cert secret: secretName: log-agent-cert-secret items: - key: caCert path: caCert - key: serverCert path: serverCert - key: serverKey path: serverKey defaultMode: 416 - name: logpath hostPath: path: /var/paas/sys/log type: '' - name: rootkey hostPath: path: /var/paas/srv/kubernetes/root.key type: '' - name: commonsharedkey hostPath: path: /var/paas/srv/kubernetes/common_shared.key type: '' initContainers: - name: init image: swr.cn-north-4.myhuaweicloud.com/hwofficial/otelcol:1.7.4 command: - /bin/sh - '-c' - mkdir -p /var/paas/sys/log/otel && chmod 750 /var/paas/sys/log/otel && chown -R 10000:10000 /var/paas/sys/log/otel resources: limits: cpu: 200m memory: 200Mi requests: cpu: 100m memory: 100Mi volumeMounts: - name: logpath mountPath: /var/paas/sys/log terminationMessagePath: /dev/termination-log terminationMessagePolicy: File imagePullPolicy: IfNotPresent containers: - name: otel-collector image: swr.cn-north-4.myhuaweicloud.com/hwofficial/otelcol:1.7.4 command: - /var/paas/otel-collector/otelcol args: - '--config=/var/paas/ot-collector/ot-collector-service.yaml' ports: - containerPort: 8006 protocol: TCP - containerPort: 4317 protocol: TCP - name: metric-port containerPort: 8888 protocol: TCP env: - name: POD_IP valueFrom: fieldRef: apiVersion: v1 fieldPath: status.podIP - name: Region value: cn-north-4 - name: ProjectID value: 9e92837f567145009ad4d230c4ac2c01 - name: ClusterID value: 74e8b92f-8f80-11f0-afe1-0255ac10026c - name: ClusterName value: cce-cci - name: WATCH_SECRET value: 'true' - name: INSECURE_SKIP_VERIFY value: 'true' - name: SCENE value: HWS - name: AKSK_SECRET_NAME value: paas.elb - name: WATCH_CLUSTER_CONFIG value: 'true' - name: AOM_ENDPOINT value: https://aom.cn-north-4.myhuaweicloud.com - name: LTS_ACCESS_ENDPOINT value: https://lts-access.cn-north-4.myhuaweicloud.com:8102 - name: CRYPTO_ENABLE value: 'true' - name: PAAS_CRYPTO_PATH value: /etc/cipher resources: limits: cpu: '1' memory: 2Gi requests: cpu: 200m memory: 1Gi volumeMounts: - name: otel-collector-config-vol readOnly: true mountPath: /var/paas/otel-collector/conf - name: ot-collector-service readOnly: true mountPath: /var/paas/ot-collector/ot-collector-service.yaml subPath: ot-collector-service.yaml - name: logpath mountPath: /var/paas/sys/log - name: rootkey readOnly: true mountPath: /etc/cipher/root.key - name: commonsharedkey readOnly: true mountPath: /etc/cipher/common_shared.key - name: cert readOnly: true mountPath: /var/paas/cert livenessProbe: exec: command: - /bin/bash - '-c' - exit 0 initialDelaySeconds: 20 timeoutSeconds: 10 periodSeconds: 20 successThreshold: 1 failureThreshold: 3 terminationMessagePath: /dev/termination-log terminationMessagePolicy: File imagePullPolicy: IfNotPresent securityContext: runAsUser: 10000 runAsGroup: 10000 readOnlyRootFilesystem: true allowPrivilegeEscalation: false restartPolicy: Always terminationGracePeriodSeconds: 30 dnsPolicy: ClusterFirst serviceAccountName: log-agent-serviceaccount serviceAccount: log-agent-serviceaccount securityContext: fsGroup: 10000 affinity: podAntiAffinity: preferredDuringSchedulingIgnoredDuringExecution: - weight: 100 podAffinityTerm: labelSelector: matchExpressions: - key: app operator: In values: - log-agent-otel-collector topologyKey: topology.kubernetes.io/zone schedulerName: default-scheduler tolerations: - key: node.kubernetes.io/not-ready operator: Exists effect: NoExecute tolerationSeconds: 30 - key: node.kubernetes.io/unreachable operator: Exists effect: NoExecute tolerationSeconds: 30 - key: role operator: Exists - key: distribution.io/category operator: Equal value: IES effect: NoSchedule priorityClassName: system-cluster-critical dnsConfig: options: - name: ndots value: '3' strategy: type: RollingUpdate rollingUpdate: maxUnavailable: 1 maxSurge: 1 minReadySeconds: 5 revisionHistoryLimit: 10 progressDeadlineSeconds: 120status: observedGeneration: 3 replicas: 2 updatedReplicas: 2 readyReplicas: 2 availableReplicas: 2 conditions: - type: Available status: 'True' lastUpdateTime: '2025-09-22T07:28:16Z' lastTransitionTime: '2025-09-22T07:28:16Z' reason: MinimumReplicasAvailable message: Deployment has minimum availability. - type: Progressing status: 'True' lastUpdateTime: '2025-09-22T07:40:31Z' lastTransitionTime: '2025-09-22T07:28:09Z' reason: NewReplicaSetAvailable message: ReplicaSet "log-agent-otel-collector-5cfd6f4c7c" has successfully progressed.
复制代码
为避免配置覆盖以及确保配置生效，指定 Otel Collector 启动加载生效的配置
Otel Collector 挂载新的配置
关闭健康检查
若要实现 LTS 和观测云的数据双写，挂载的配置如下：
exporters: aom/default-event-aom: endpoint: https://aom.cn-north-4.myhuaweicloud.com events: - name: DeleteNodeWithNoServer name_cn: 废弃节点清理 ... lts/default-stdout: compress_type: gzip endpoint: https://lts-access.cn-north-4.myhuaweicloud.com:8102 log_type: log lts_group_id: d6b393b8-484f-4835-ba9f-xxxxx lts_stream_id: 8e02106f-8aeb-4da5-a5e1-xxxxx otlphttp: endpoint: http://datakit-service.datakit:9529/otel tls: insecure: true processors: batch/default-event: send_batch_max_size: 1000 send_batch_size: 500 timeout: 1000000000 ... filter/cci-log: logs: exclude: {} include: match_type: strict record_attributes: - key: logconfig value: cci-log filter/datakit: logs: exclude: {} include: match_type: strict record_attributes: - key: logconfig value: datakitservice: pipelines: logs/cci-log: exporters: - lts/cci-log - otlphttp ...
复制代码
挂载的配置若是只写到观测云，配置如下：
exporters: otlphttp: endpoint: http://datakit-service.datakit:9529/otel tls: insecure: trueprocessors: batch/logs: send_batch_max_size: 2000 send_batch_size: 2000 filter/cci-log: logs: exclude: {} include: match_type: strict record_attributes: - key: logconfig value: cci-logreceivers: fluentforward: endpoint: ${POD_IP}:8006 tls: cert_file: /var/paas/cert/serverCert client_ca_file: /var/paas/cert/caCert key_file: /var/paas/cert/serverKey k8s_events: {}service: pipelines: logs/cci-log: exporters: - otlphttp processors: - filter/cci-log - batch/logs receivers: - fluentforward telemetry: logs: {} metrics: address: ${POD_IP}:8888 level: basic
复制代码
步骤 5：容器 demo 发起请求，产生日志
步骤 6：在观测云验证日志接入
登录观测云控制台 → 日志查看器 ，可以看到相关日志已经被采集到了观测云。
划线
评论
复制
发布于: 刚刚阅读数: 3
观测云
关注
还未添加个人签名 2021-02-08 加入
云时代的系统可观测平台
评论