Commit Graph

101 Commits

Author SHA1 Message Date
freeleaps-gitops-bot
3f0a26819f ci(bump): bump centralStorage image version for prod to snapshot-804c71f 2025-08-12 04:37:07 +00:00
freeleaps-gitops-bot
8517eb7257 ci(bump): bump centralStorage image version for prod to snapshot-c8a6275 2025-08-11 01:40:45 +00:00
freeleaps-gitops-bot
a5d851f069 ci(bump): bump centralStorage image version for prod to 1.3.1 2025-08-11 01:35:50 +00:00
b797f17816 Merge pull request 'feat: enable log ingest for central storage in prod environment' (#62) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/62
2025-08-08 02:32:13 +00:00
Nicolas
71283aa2da feat: enable log ingest for central storage in prod environment 2025-08-08 10:31:22 +08:00
freeleaps-gitops-bot
1b264fd54c ci(bump): bump centralStorage image version for prod to snapshot-bbfc1ba 2025-08-07 01:10:54 +00:00
freeleaps-gitops-bot
e47a55fa4b ci(bump): bump centralStorage image version for prod to 1.3.0 2025-08-07 01:04:24 +00:00
cb70534764 Merge pull request 'fix: remove invalid k8scluster receiver to resolve OpenTelemetry startup error' (#43) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/43
2025-08-01 00:27:30 +00:00
Nicolas
aa74f6a4f7 fix: remove invalid k8scluster receiver to resolve OpenTelemetry startup error
- Remove k8scluster receiver (invalid type name)
- Remove unused otlp receiver definitions
- Keep only filelog receiver which is actually used in pipeline
- Fixes CrashLoopBackOff issue in central-storage pod
2025-08-01 07:52:37 +08:00
freeleaps-gitops-bot
b85b73c9b2 ci(bump): bump centralStorage image version for alpha to snapshot-12a0d9a 2025-07-31 15:26:49 +00:00
80773c8c82 Merge pull request 'Nicolas_local_ops' (#42) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/42
2025-07-31 15:20:01 +00:00
Nicolas
d85f9408e4 fix: change Chinese comments to English in OpenTelemetry configs
- Replace Chinese comments with English in opentelemetry.yaml files
- Maintain consistent English-only comments in freeleaps-ops repository
- Keep the same functionality while improving code readability
2025-07-31 23:17:45 +08:00
Nicolas
5101e6d2cd fix: optimize OpenTelemetry configuration to prevent duplicate log collection
- Change receivers from [filelog, otlp, k8scluster] to [filelog] only
- Prevent duplicate logs from multiple collection sources
- Keep only filelog receiver to collect logs from application log files
- This eliminates duplicate logs appearing in Grafana for devsvc and central-storage
2025-07-31 23:08:10 +08:00
3092ad0fa1 Merge pull request 'Nicolas_local_ops' (#40) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/40
2025-07-31 03:33:08 +00:00
Nicolas
cc73ad92a9 feat: add container logs collection to OpenTelemetry config for central storage 2025-07-31 11:27:28 +08:00
8d55c49660 Merge pull request 'fix: use hasKey to safely check for logIngest.persistence existence' (#39) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/39
2025-07-31 02:22:46 +00:00
Nicolas
da7e43547f fix: use hasKey to safely check for logIngest.persistence existence 2025-07-31 10:21:50 +08:00
7f7bbfd6d4 Merge pull request 'fix: add default values for logIngest.persistence to prevent nil pointer errors' (#38) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/38
2025-07-31 02:20:11 +00:00
Nicolas
85fa39f8e2 fix: add default values for logIngest.persistence to prevent nil pointer errors 2025-07-31 10:18:47 +08:00
a2ffc1ea4d Merge pull request 'fix: optimize central storage logging configuration to resolve hourly log bursts' (#37) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/37
2025-07-31 02:16:06 +00:00
Nicolas
7a7fcf1398 fix: optimize central storage logging configuration to resolve hourly log bursts
- Change start_at from beginning to end to avoid historical log duplication
- Add poll_interval: 1s for real-time file monitoring
- Optimize batch processing: send_batch_size: 1, timeout: 1s
- Add PVC template for log persistence to reduce log loss risk
- Update deployment to support persistent volume for logs
2025-07-31 10:14:55 +08:00
freeleaps-gitops-bot
184eba16ed ci(bump): bump centralStorage image version for alpha to snapshot-311fd21 2025-07-29 10:30:27 +00:00
Nicolas
f9c2c7e696 Change OTC start_at to beginning to read existing logs 2025-07-29 18:04:53 +08:00
Nicolas
401a2166cd Simplify OTC config: remove timestamp parsing to fix startup issues 2025-07-29 17:57:30 +08:00
Nicolas
7ae5966da1 Fix timestamp parsing: use move operator to extract timestamp from attributes 2025-07-29 17:54:25 +08:00
Nicolas
12a7f1b98c Fix timestamp parsing in OTC config for central-storage logs 2025-07-29 17:40:57 +08:00
Nicolas
c4bd3df730 Fix OTLP exporter config: remove unsupported labels options 2025-07-29 17:22:40 +08:00
Nicolas
18eb4df3fb Revert to OTLP config to fix OTC startup - will investigate Loki config later 2025-07-29 17:16:46 +08:00
Nicolas
d234716697 Comment out Loki labels config to fix OTC startup - can be enabled later 2025-07-29 17:13:01 +08:00
Nicolas
b1c9f59cff Simplify Loki exporter configuration to fix OTC startup issues 2025-07-29 17:08:32 +08:00
Nicolas
a1d5652efb Fix Loki exporter configuration: remove invalid keys 2025-07-29 17:05:24 +08:00
Nicolas
b7b6ddcae4 Fix central-storage logging: change OTLP exporter to Loki HTTP exporter 2025-07-29 16:47:47 +08:00
Nicolas
acd5379c27 fix: restore json_parser with timestamp parsing based on local testing 2025-07-29 15:40:26 +08:00
Nicolas
beab7cd117 fix: remove all parsing operators to use raw log content 2025-07-29 15:29:53 +08:00
Nicolas
37db3b4404 fix: remove time_parser to use default timestamp handling 2025-07-29 14:46:13 +08:00
Nicolas
5479b85968 fix: separate timestamp parsing from json_parser to resolve time parsing error 2025-07-29 14:42:29 +08:00
afb02b4e0c Merge branch 'master' into Nicolas_local_ops 2025-07-29 06:33:15 +00:00
Nicolas
aa8e626b7a fix: remove problematic ParseJSON operations from OpenTelemetry transform processor 2025-07-29 14:30:00 +08:00
Nicolas
22ab4b99ef fix: simplify OpenTelemetry Collector config to resolve timestamp parsing errors 2025-07-29 14:07:39 +08:00
freeleaps-gitops-bot
9dfcc4104c ci(bump): bump centralStorage image version for alpha to snapshot-e7eeaaf 2025-07-29 04:00:14 +00:00
Nicolas
5ced605a20 fix: improve OpenTelemetry Collector JSON parsing for central storage logs 2025-07-29 10:15:39 +08:00
Nicolas
070f238bdb merge: resolve conflict in values.alpha.yaml
- Choose newer image tag: snapshot-eec7ac2
- Resolve merge conflict between branches
2025-07-29 09:51:04 +08:00
Nicolas
605e66a26b fix: add missing logging environment variables for central storage K8s deployment
- Add LOG_BASE_PATH environment variable
- Add BACKEND_LOG_FILE_NAME environment variable
- Add APPLICATION_ACTIVITY_LOG environment variable
- Fix logging path configuration for K8s environment
2025-07-29 09:36:01 +08:00
freeleaps-gitops-bot
08c343780d ci(bump): bump centralStorage image version for alpha to snapshot-eec7ac2 2025-07-28 14:15:34 +00:00
freeleaps-gitops-bot
ecec83f13a ci(bump): bump centralStorage image version for alpha to snapshot-9e2e2fa 2025-07-28 13:19:03 +00:00
Nicolas
c4d8c00f65 feat: update central-storage logging configuration and DEBUG_MODE support 2025-07-28 21:02:55 +08:00
Nicolas
8fc5281e23 feat: add DEBUG_MODE environment variable for central-storage 2025-07-28 21:00:33 +08:00
freeleaps-gitops-bot
e4f73be5ae ci(bump): bump centralStorage image version for alpha to snapshot-baf606d 2025-07-28 10:40:13 +00:00
Nicolas
1aace1577d fix(logging): set logPathPattern to /app/log/central_storage/*.log for sidecar filelog 2025-07-25 14:32:20 +08:00
Nicolas
950c821c19 chore(logging): update logPathPattern to /var/log/pods/*/*/*.log for k8s standard log collection 2025-07-25 03:08:50 +00:00