icecheng/freeleaps-ops
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,187 Commits 1 Branch 0 Tags 29 MiB
90a9337f1a
Commit Graph

145 Commits

Author SHA1 Message Date
freeleaps-gitops-bot
e47a55fa4b ci(bump): bump centralStorage image version for prod to 1.3.0 2025-08-07 01:04:24 +00:00
Nicolas
cb70534764 Merge pull request 'fix: remove invalid k8scluster receiver to resolve OpenTelemetry startup error' (#43) from Nicolas_local_ops into master 
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/43
 2025-08-01 00:27:30 +00:00
Nicolas
aa74f6a4f7 fix: remove invalid k8scluster receiver to resolve OpenTelemetry startup error 
- Remove k8scluster receiver (invalid type name)
- Remove unused otlp receiver definitions
- Keep only filelog receiver which is actually used in pipeline
- Fixes CrashLoopBackOff issue in central-storage pod
 2025-08-01 07:52:37 +08:00
freeleaps-gitops-bot
b85b73c9b2 ci(bump): bump centralStorage image version for alpha to snapshot-12a0d9a 2025-07-31 15:26:49 +00:00
Nicolas
80773c8c82 Merge pull request 'Nicolas_local_ops' (#42) from Nicolas_local_ops into master 
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/42
 2025-07-31 15:20:01 +00:00
Nicolas
d85f9408e4 fix: change Chinese comments to English in OpenTelemetry configs 
- Replace Chinese comments with English in opentelemetry.yaml files
- Maintain consistent English-only comments in freeleaps-ops repository
- Keep the same functionality while improving code readability
 2025-07-31 23:17:45 +08:00
Nicolas
5101e6d2cd fix: optimize OpenTelemetry configuration to prevent duplicate log collection 
- Change receivers from [filelog, otlp, k8scluster] to [filelog] only
- Prevent duplicate logs from multiple collection sources
- Keep only filelog receiver to collect logs from application log files
- This eliminates duplicate logs appearing in Grafana for devsvc and central-storage
 2025-07-31 23:08:10 +08:00
Nicolas
3092ad0fa1 Merge pull request 'Nicolas_local_ops' (#40) from Nicolas_local_ops into master 
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/40
 2025-07-31 03:33:08 +00:00
Nicolas
cc73ad92a9 feat: add container logs collection to OpenTelemetry config for central storage 2025-07-31 11:27:28 +08:00
Nicolas
8d55c49660 Merge pull request 'fix: use hasKey to safely check for logIngest.persistence existence' (#39) from Nicolas_local_ops into master 
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/39
 2025-07-31 02:22:46 +00:00
Nicolas
da7e43547f fix: use hasKey to safely check for logIngest.persistence existence 2025-07-31 10:21:50 +08:00
Nicolas
7f7bbfd6d4 Merge pull request 'fix: add default values for logIngest.persistence to prevent nil pointer errors' (#38) from Nicolas_local_ops into master 
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/38
 2025-07-31 02:20:11 +00:00
Nicolas
85fa39f8e2 fix: add default values for logIngest.persistence to prevent nil pointer errors 2025-07-31 10:18:47 +08:00
Nicolas
a2ffc1ea4d Merge pull request 'fix: optimize central storage logging configuration to resolve hourly log bursts' (#37) from Nicolas_local_ops into master 
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/37
 2025-07-31 02:16:06 +00:00
Nicolas
7a7fcf1398 fix: optimize central storage logging configuration to resolve hourly log bursts 
- Change start_at from beginning to end to avoid historical log duplication
- Add poll_interval: 1s for real-time file monitoring
- Optimize batch processing: send_batch_size: 1, timeout: 1s
- Add PVC template for log persistence to reduce log loss risk
- Update deployment to support persistent volume for logs
 2025-07-31 10:14:55 +08:00
freeleaps-gitops-bot
184eba16ed ci(bump): bump centralStorage image version for alpha to snapshot-311fd21 2025-07-29 10:30:27 +00:00
Nicolas
f9c2c7e696 Change OTC start_at to beginning to read existing logs 2025-07-29 18:04:53 +08:00
Nicolas
401a2166cd Simplify OTC config: remove timestamp parsing to fix startup issues 2025-07-29 17:57:30 +08:00
Nicolas
7ae5966da1 Fix timestamp parsing: use move operator to extract timestamp from attributes 2025-07-29 17:54:25 +08:00
Nicolas
12a7f1b98c Fix timestamp parsing in OTC config for central-storage logs 2025-07-29 17:40:57 +08:00
Nicolas
c4bd3df730 Fix OTLP exporter config: remove unsupported labels options 2025-07-29 17:22:40 +08:00
Nicolas
18eb4df3fb Revert to OTLP config to fix OTC startup - will investigate Loki config later 2025-07-29 17:16:46 +08:00
Nicolas
d234716697 Comment out Loki labels config to fix OTC startup - can be enabled later 2025-07-29 17:13:01 +08:00
Nicolas
b1c9f59cff Simplify Loki exporter configuration to fix OTC startup issues 2025-07-29 17:08:32 +08:00
Nicolas
a1d5652efb Fix Loki exporter configuration: remove invalid keys 2025-07-29 17:05:24 +08:00
Nicolas
b7b6ddcae4 Fix central-storage logging: change OTLP exporter to Loki HTTP exporter 2025-07-29 16:47:47 +08:00
Nicolas
acd5379c27 fix: restore json_parser with timestamp parsing based on local testing 2025-07-29 15:40:26 +08:00
Nicolas
beab7cd117 fix: remove all parsing operators to use raw log content 2025-07-29 15:29:53 +08:00
Nicolas
37db3b4404 fix: remove time_parser to use default timestamp handling 2025-07-29 14:46:13 +08:00
Nicolas
5479b85968 fix: separate timestamp parsing from json_parser to resolve time parsing error 2025-07-29 14:42:29 +08:00
Nicolas
afb02b4e0c Merge branch 'master' into Nicolas_local_ops 2025-07-29 06:33:15 +00:00
Nicolas
aa8e626b7a fix: remove problematic ParseJSON operations from OpenTelemetry transform processor 2025-07-29 14:30:00 +08:00
Nicolas
22ab4b99ef fix: simplify OpenTelemetry Collector config to resolve timestamp parsing errors 2025-07-29 14:07:39 +08:00
freeleaps-gitops-bot
9dfcc4104c ci(bump): bump centralStorage image version for alpha to snapshot-e7eeaaf 2025-07-29 04:00:14 +00:00
Nicolas
5ced605a20 fix: improve OpenTelemetry Collector JSON parsing for central storage logs 2025-07-29 10:15:39 +08:00
Nicolas
070f238bdb merge: resolve conflict in values.alpha.yaml 
- Choose newer image tag: snapshot-eec7ac2
- Resolve merge conflict between branches
 2025-07-29 09:51:04 +08:00
Nicolas
605e66a26b fix: add missing logging environment variables for central storage K8s deployment 
- Add LOG_BASE_PATH environment variable
- Add BACKEND_LOG_FILE_NAME environment variable
- Add APPLICATION_ACTIVITY_LOG environment variable
- Fix logging path configuration for K8s environment
 2025-07-29 09:36:01 +08:00
freeleaps-gitops-bot
08c343780d ci(bump): bump centralStorage image version for alpha to snapshot-eec7ac2 2025-07-28 14:15:34 +00:00
freeleaps-gitops-bot
ecec83f13a ci(bump): bump centralStorage image version for alpha to snapshot-9e2e2fa 2025-07-28 13:19:03 +00:00
Nicolas
c4d8c00f65 feat: update central-storage logging configuration and DEBUG_MODE support 2025-07-28 21:02:55 +08:00
Nicolas
8fc5281e23 feat: add DEBUG_MODE environment variable for central-storage 2025-07-28 21:00:33 +08:00
freeleaps-gitops-bot
e4f73be5ae ci(bump): bump centralStorage image version for alpha to snapshot-baf606d 2025-07-28 10:40:13 +00:00
Nicolas
1aace1577d fix(logging): set logPathPattern to /app/log/central_storage/*.log for sidecar filelog 2025-07-25 14:32:20 +08:00
Nicolas
950c821c19 chore(logging): update logPathPattern to /var/log/pods/*/*/*.log for k8s standard log collection 2025-07-25 03:08:50 +00:00
freeleaps-gitops-bot
3f6d780ab5 ci(bump): bump centralStorage image version for alpha to snapshot-b9f275c 2025-07-24 06:56:55 +00:00
freeleaps-gitops-bot
0a4687f322 ci(bump): bump centralStorage image version for alpha to snapshot-2234571 2025-07-23 13:36:09 +00:00
zhenyus
3aad06eeb7 feat: add Vertical Pod Autoscaler (VPA) configuration across multiple services for improved resource management 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-06-10 23:53:31 +08:00
freeleaps-gitops-bot
a3ba92cefd ci(bump): bump centralStorage image version for prod to snapshot-40e0faf 2025-04-30 07:06:48 +00:00
freeleaps-gitops-bot
e7f3528e54 ci(bump): bump centralStorage image version for prod to 1.2.1 2025-04-30 02:52:05 +00:00
freeleaps-gitops-bot
339a52cf70 ci(bump): bump centralStorage image version for alpha to snapshot-95a525a 2025-04-27 03:09:10 +00:00
freeleaps-gitops-bot
1603e33d44 ci(bump): bump centralStorage image version for prod to snapshot-7d493a3 2025-04-25 03:58:48 +00:00
freeleaps-gitops-bot
459531f064 ci(bump): bump centralStorage image version for prod to 1.2.0 2025-04-25 02:42:42 +00:00
freeleaps-gitops-bot
98ed20c5fc ci(bump): bump centralStorage image version for alpha to snapshot-6286c0f 2025-04-24 07:22:33 +00:00
zhenyus
6d9d15d4d2 Add OpenTelemetry logging support across multiple services 
- Introduced log ingestion configuration in values files for centralStorage, content, notification, and payment services.
- Updated deployment templates to conditionally include OpenTelemetry annotations and volume mounts based on log ingestion settings.
- Added OpenTelemetry RBAC configurations for service accounts and cluster roles to enable logging.
- Implemented OpenTelemetry collector configuration to process logs and export them to Loki.
- Ensured compatibility with existing Helm chart structure and maintained backward compatibility for services without log ingestion enabled.

Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 22:03:00 +08:00
freeleaps-gitops-bot
773f2cd9a5 ci(bump): bump centralStorage image version for alpha to snapshot-ecad36a 2025-04-21 05:39:02 +00:00
freeleaps-gitops-bot
67b7a7ed2c ci(bump): bump centralStorage image version for alpha to snapshot-32c4fe9 2025-04-21 04:02:00 +00:00
freeleaps-gitops-bot
cab603d999 ci(bump): bump centralStorage image version for alpha to 1.1.1 2025-04-21 03:12:53 +00:00
freeleaps-gitops-bot
e0a05e3816 ci(bump): bump centralStorage image version for prod to 1.1.1 2025-04-18 05:01:30 +00:00
zhenyus
6ebdef8933 Update ingress hosts and issuer references for alpha environment 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-11 01:22:29 +08:00
zhenyus
f415b83a85 ci: update execute mode to 'on-demand' in Jenkinsfiles and change MongoDB URIs to use SRV format 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-31 13:51:04 +08:00
freeleaps-gitops-bot
5a732780ff ci(bump): bump centralStorage image version for alpha to snapshot-7940aa2 2025-03-30 23:10:26 +00:00
zhenyus
b3ad25d6e5 fix: update config file paths in config-checksum annotations for deployment templates 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-27 14:51:41 +08:00
zhenyus
df2ab1c3a4 fix: correct config file path in config-checksum annotations for deployment templates 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-27 14:50:08 +08:00
zhenyus
580f3f8d71 feat: add config checksum annotations to deployment templates and update site URL in values files 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-27 14:48:25 +08:00
freeleaps-gitops-bot
900fd72d64 ci(bump): bump centralStorage image version for alpha to snapshot-4dfbab4 2025-03-21 17:21:12 +00:00
zhenyus
6e7417ae00 feat: add migration script and update Helm values for various services with readiness and liveness probes 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-22 01:03:59 +08:00
zhenyus
a90ee717b2 fix: update Prometheus query intervals from 30s to 1m for improved accuracy 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-18 05:59:05 +08:00
zhenyus
336f1fa0e2 fix: remove hardcoded uid values in dashboard templates for consistency 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-18 00:26:16 +08:00
zhenyus
a1ab488cbf fix: update dashboard file names to use dynamic values for consistency 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-18 00:25:04 +08:00
zhenyus
a6803210e0 feat: add dashboard configuration for content, payment, notification, and central storage services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-18 00:22:06 +08:00
zhenyus
56094aa1bd fix: remove version and managed-by labels from service monitor templates for consistency 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:53:49 +08:00
zhenyus
e8a07a08e6 feat: add metricsEnabled and probesEnabled configuration options to payment, content, centralStorage, authentication, and notification services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:51:35 +08:00
zhenyus
96ab638756 fix: remove serviceMonitor.enabled variable from service templates in authentication, centralStorage, content, notification, and payment services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:47:29 +08:00
zhenyus
e7bb64108c fix: rename service monitor resources to use a consistent naming convention 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:45:47 +08:00
zhenyus
bb2bebc164 fix: update service monitor templates to use service-specific values for namespace, labels, interval, and scrapeTimeout 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:45:16 +08:00
zhenyus
c9cfa0827e fix: update service monitor templates to check individual serviceMonitor.enabled values 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:42:46 +08:00
zhenyus
4a726cce49 fix: add serviceMonitor configuration to authentication, centralStorage, content, notification, and payment services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:40:13 +08:00
zhenyus
32198e2f9a fix: remove port definitions from service monitor configurations 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:36:46 +08:00
zhenyus
5c9f74c609 fix: add name label to service monitor configuration 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:26:34 +08:00
zhenyus
c2967c3854 fix: update service monitor configuration to use port instead of targetPort 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:25:43 +08:00
zhenyus
07d4cb7236 fix: update service monitor configurations to use targetPort and remove unnecessary labels 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 23:24:26 +08:00
zhenyus
368c726b0b feat: add METRICS_ENABLED and PROBES_ENABLED environment variables to deployment configurations 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 22:37:27 +08:00
zhenyus
aedddf0f96 fix: update periodSeconds for readiness and liveness probes in authentication, centralStorage, content, notification, and payment services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 21:53:50 +08:00
zhenyus
bb30b8ae7c fix: remove terminationGracePeriodSeconds from readiness probe configurations in authentication, centralStorage, content, notification, and payment services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 21:40:03 +08:00
zhenyus
884d1d1784 feat: add httpGet type for readiness and liveness probes in authentication, centralStorage, content, notification, and payment services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 21:38:09 +08:00
zhenyus
83f8b7f030 feat: enable serviceMonitor configuration for authentication, central-storage, content, notification, and payment services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 21:35:31 +08:00
zhenyus
2f8f0a1a1f fix: update probes enabled logic in service configuration templates 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 21:32:13 +08:00
zhenyus
d3d44ba9df Merge branch 'master' of https://dev.azure.com/freeleaps/freeleaps-ops/_git/freeleaps-ops 2025-03-17 21:24:38 +08:00
zhenyus
2969cafc9d feat: add serviceMonitor configuration for content, payment, notification, central-storage, and authentication services 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-17 21:24:35 +08:00
freeleaps-gitops-bot
76070a779d ci(bump): bump centralStorage image version for prod to 1.1.0 2025-03-17 10:10:38 +00:00
zhenyus
b5318e24d1 fix: increase memory limit for central storage service in production configuration 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-12 02:07:07 +08:00
zhenyus
9b86aae0f6 fix: increase CPU resource requests and limits across multiple services in production configuration 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-11 13:12:14 +08:00
zhenyus
d2927ce4ba fix: update resource requests and limits for multiple services to optimize performance 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-08 20:31:11 +08:00
freeleaps-gitops-bot
2cfa0f2c35 ci(bump): bump centralStorage image version for prod to 1.0.0 2025-03-06 17:46:02 +00:00
zhenyus
2c00823bd7 feat(helm): add central-storage Helm chart and related configurations 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-03-07 01:30:23 +08:00