Nicolas
5101e6d2cd
fix: optimize OpenTelemetry configuration to prevent duplicate log collection
...
- Change receivers from [filelog, otlp, k8scluster] to [filelog] only
- Prevent duplicate logs from multiple collection sources
- Keep only filelog receiver to collect logs from application log files
- This eliminates duplicate logs appearing in Grafana for devsvc and central-storage
2025-07-31 23:08:10 +08:00
Nicolas
f98f980a7b
Merge branch 'Nicolas_local_ops' of https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops into Nicolas_local_ops
2025-07-31 13:00:18 +08:00
Nicolas
ef36db54c2
feat: optimize devsvc OpenTelemetry logging configuration
...
- Change start_at from beginning to end to avoid processing old logs
- Add poll_interval: 1s for more frequent file monitoring
- Add otlp and k8scluster receivers for comprehensive log collection
- Reduce batch processor send_batch_size to 1 and timeout to 1s for real-time logging
- Update pipelines to include all three receivers
2025-07-31 12:47:10 +08:00
5fe4cf6d70
revert 23fca62e86
...
revert feat: add MongoDB connection configuration to notification service
- Add MongoDB configuration to values.yaml, values.alpha.yaml, and values.prod.yaml
- Add MongoDB environment variables to notification-config.yaml
- Include mongodbName, mongodbPort, and mongodbUri settings
- Use same MongoDB Atlas connection as central storage service
2025-07-31 03:32:31 +00:00
Nicolas
cc73ad92a9
feat: add container logs collection to OpenTelemetry config for central storage
2025-07-31 11:27:28 +08:00
Nicolas
23fca62e86
feat: add MongoDB connection configuration to notification service
...
- Add MongoDB configuration to values.yaml, values.alpha.yaml, and values.prod.yaml
- Add MongoDB environment variables to notification-config.yaml
- Include mongodbName, mongodbPort, and mongodbUri settings
- Use same MongoDB Atlas connection as central storage service
2025-07-31 10:43:50 +08:00
Nicolas
da7e43547f
fix: use hasKey to safely check for logIngest.persistence existence
2025-07-31 10:21:50 +08:00
Nicolas
85fa39f8e2
fix: add default values for logIngest.persistence to prevent nil pointer errors
2025-07-31 10:18:47 +08:00
Nicolas
7a7fcf1398
fix: optimize central storage logging configuration to resolve hourly log bursts
...
- Change start_at from beginning to end to avoid historical log duplication
- Add poll_interval: 1s for real-time file monitoring
- Optimize batch processing: send_batch_size: 1, timeout: 1s
- Add PVC template for log persistence to reduce log loss risk
- Update deployment to support persistent volume for logs
2025-07-31 10:14:55 +08:00
Nicolas
309bd6ff7c
fix: update freeleaps OpenTelemetry Collector config to handle loguru serialized format and add environment configs
2025-07-30 15:29:03 +08:00
Nicolas
3413d53d21
feat: add environment configuration for all environments (alpha, prod, dev)
2025-07-30 15:06:29 +08:00
Nicolas
3bdc14c330
fix: update chat OpenTelemetry Collector config to handle loguru serialized format
2025-07-30 14:54:39 +08:00
Nicolas
60b92b54a4
fix: update Jenkins build agent image and adjust chat service resources
2025-07-30 11:00:06 +08:00
Nicolas
fcead75d20
fix: 修复chat服务端口配置和Jenkins流水线
...
- 修复默认values.yaml中的端口配置不一致问题
- 统一所有环境使用8012端口
- 启用probes健康检查配置
- 修改Jenkins流水线使用Nicolas_log分支
- 确保chat服务能正确监听8012端口并响应健康检查
2025-07-30 09:57:05 +08:00
Nicolas
ea44bbfef3
fix: 修复devsvc服务OpenTelemetry配置中的语法错误
...
- 修复transform处理器中访问不存在log.attributes字段的问题
- 将配置更新为与其他服务一致的格式
- 确保ArgoCD能够成功同步devsvc服务配置
2025-07-30 09:42:50 +08:00
Nicolas
09eef0e622
fix: update devsvc OTC transform processor to use correct log.attributes path
2025-07-29 20:15:08 +08:00
Nicolas
06aa63da07
Fix OTC transform processor for devsvc logs - correct attribute paths and remove invalid ParseJSON
2025-07-29 19:19:25 +08:00
Nicolas
18b6bfc9e5
Add APPLICATION_ACTIVITY_LOG environment variable to devsvc config
2025-07-29 19:02:46 +08:00
Nicolas
a65edb236d
Update devsvc OTC config to monitor .log file and start from beginning
2025-07-29 18:20:01 +08:00
Nicolas
f9c2c7e696
Change OTC start_at to beginning to read existing logs
2025-07-29 18:04:53 +08:00
Nicolas
401a2166cd
Simplify OTC config: remove timestamp parsing to fix startup issues
2025-07-29 17:57:30 +08:00
Nicolas
7ae5966da1
Fix timestamp parsing: use move operator to extract timestamp from attributes
2025-07-29 17:54:25 +08:00
Nicolas
12a7f1b98c
Fix timestamp parsing in OTC config for central-storage logs
2025-07-29 17:40:57 +08:00
Nicolas
c4bd3df730
Fix OTLP exporter config: remove unsupported labels options
2025-07-29 17:22:40 +08:00
Nicolas
18eb4df3fb
Revert to OTLP config to fix OTC startup - will investigate Loki config later
2025-07-29 17:16:46 +08:00
Nicolas
d234716697
Comment out Loki labels config to fix OTC startup - can be enabled later
2025-07-29 17:13:01 +08:00
Nicolas
b1c9f59cff
Simplify Loki exporter configuration to fix OTC startup issues
2025-07-29 17:08:32 +08:00
Nicolas
a1d5652efb
Fix Loki exporter configuration: remove invalid keys
2025-07-29 17:05:24 +08:00
Nicolas
b7b6ddcae4
Fix central-storage logging: change OTLP exporter to Loki HTTP exporter
2025-07-29 16:47:47 +08:00
Nicolas
acd5379c27
fix: restore json_parser with timestamp parsing based on local testing
2025-07-29 15:40:26 +08:00
Nicolas
beab7cd117
fix: remove all parsing operators to use raw log content
2025-07-29 15:29:53 +08:00
Nicolas
37db3b4404
fix: remove time_parser to use default timestamp handling
2025-07-29 14:46:13 +08:00
Nicolas
5479b85968
fix: separate timestamp parsing from json_parser to resolve time parsing error
2025-07-29 14:42:29 +08:00
afb02b4e0c
Merge branch 'master' into Nicolas_local_ops
2025-07-29 06:33:15 +00:00
Nicolas
aa8e626b7a
fix: remove problematic ParseJSON operations from OpenTelemetry transform processor
2025-07-29 14:30:00 +08:00
Nicolas
22ab4b99ef
fix: simplify OpenTelemetry Collector config to resolve timestamp parsing errors
2025-07-29 14:07:39 +08:00
freeleaps-gitops-bot
25cac97e0d
ci(bump): bump devops image version for alpha to snapshot-e7eeaaf
2025-07-29 04:20:45 +00:00
freeleaps-gitops-bot
32399c599d
ci(bump): bump payment image version for alpha to snapshot-e7eeaaf
2025-07-29 04:16:46 +00:00
freeleaps-gitops-bot
ee42b741c1
ci(bump): bump notification image version for alpha to snapshot-e7eeaaf
2025-07-29 04:11:54 +00:00
freeleaps-gitops-bot
a56a2b87ab
ci(bump): bump content image version for alpha to snapshot-e7eeaaf
2025-07-29 04:07:21 +00:00
freeleaps-gitops-bot
9dfcc4104c
ci(bump): bump centralStorage image version for alpha to snapshot-e7eeaaf
2025-07-29 04:00:14 +00:00
freeleaps-gitops-bot
8fa1a8f725
ci(bump): bump authentication image version for alpha to snapshot-e7eeaaf
2025-07-29 03:55:54 +00:00
Nicolas
5ced605a20
fix: improve OpenTelemetry Collector JSON parsing for central storage logs
2025-07-29 10:15:39 +08:00
Nicolas
070f238bdb
merge: resolve conflict in values.alpha.yaml
...
- Choose newer image tag: snapshot-eec7ac2
- Resolve merge conflict between branches
2025-07-29 09:51:04 +08:00
Nicolas
605e66a26b
fix: add missing logging environment variables for central storage K8s deployment
...
- Add LOG_BASE_PATH environment variable
- Add BACKEND_LOG_FILE_NAME environment variable
- Add APPLICATION_ACTIVITY_LOG environment variable
- Fix logging path configuration for K8s environment
2025-07-29 09:36:01 +08:00
freeleaps-gitops-bot
5c45ccc762
ci(bump): bump devops image version for alpha to snapshot-eec7ac2
2025-07-28 14:36:10 +00:00
freeleaps-gitops-bot
b2f834ac6a
ci(bump): bump payment image version for alpha to snapshot-eec7ac2
2025-07-28 14:32:06 +00:00
freeleaps-gitops-bot
23a5cec9ee
ci(bump): bump notification image version for alpha to snapshot-eec7ac2
2025-07-28 14:27:13 +00:00
freeleaps-gitops-bot
d55da085c5
ci(bump): bump content image version for alpha to snapshot-eec7ac2
2025-07-28 14:22:27 +00:00
freeleaps-gitops-bot
08c343780d
ci(bump): bump centralStorage image version for alpha to snapshot-eec7ac2
2025-07-28 14:15:34 +00:00
