https://pastein.ru/6thp9e7zm7
Загрузка данных
Running with gitlab-runner 15.8.0 (12335144)
on gitlab-runner-gitlab-runner-6f4d49d99-h585b 8W3Nm2Mz, system ID: r_DYVWgNUEigZr
Preparing the "kubernetes" executor
00:00
Using Kubernetes namespace: gitlab-runners
Using Kubernetes executor with image registry.rshbdev.ru/appfarm/infra/images/kube-client-apps:8.21.18 ...
Using attach strategy to execute scripts...
Preparing environment
00:05
Waiting for pod gitlab-runners/runner-8w3nm2mz-project-73310-concurrent-0kljkj to be running, status is Pending
Waiting for pod gitlab-runners/runner-8w3nm2mz-project-73310-concurrent-0kljkj to be running, status is Pending
ContainersNotReady: "containers with unready status: [build helper]"
ContainersNotReady: "containers with unready status: [build helper]"
Running on runner-8w3nm2mz-project-73310-concurrent-0kljkj via gitlab-runner-gitlab-runner-6f4d49d99-h585b...
Getting source from Git repository
00:02
$ git config --global --add url."https://gitlab-ci-token:${CI_JOB_TOKEN}@${CI_SERVER_HOST}/".insteadOf "https://${CI_SERVER_HOST}" # collapsed multi-line command
Fetching changes with git depth set to 20...
Initialized empty Git repository in /builds/rshbintech/information-security/application-security/threat-intelligence/disk-back-main/.git/
Created fresh repository.
Checking out 43c96700 as stress...
Skipping Git submodules setup
Downloading artifacts
00:01
Downloading artifacts for devsecops_antivirus_scan (25370458)...
Downloading artifacts from coordinator... ok id=25370458 responseStatus=200 OK token=64_jkkxt
Downloading artifacts for dockerfilegen (25370459)...
Downloading artifacts from coordinator... ok id=25370459 responseStatus=200 OK token=64_jkkxt
Executing "step_script" stage of the job script
20:23
$ ( umask 0077; mkdir -p ~/.kube && echo "$KUBECONFIG_COMBINED" | base64 -d > ~/.kube/config )
$ if [[ ${IS_SENSITIVE_SYSTEM} = true ]]; then export K8S_CLUSTERS=$K8S_CLUSTERS_SENSITIVE; fi
$ echo 'IS_SENSITIVE_SYSTEM:' $IS_SENSITIVE_SYSTEM
IS_SENSITIVE_SYSTEM:
$ echo 'TARGET_CLUSTERS:' $K8S_CLUSTERS
TARGET_CLUSTERS: devstbl
$ set -x
++ echo '$ for CLUSTER in $K8S_CLUSTERS; do'
$ for CLUSTER in $K8S_CLUSTERS; do
++ for CLUSTER in $K8S_CLUSTERS
++ echo '$ export CLUSTER=$CLUSTER'
$ export CLUSTER=$CLUSTER
++ export CLUSTER=devstbl
++ CLUSTER=devstbl
++ echo '$ if [[ ${CI_ENVIRONMENT_SLUG} = production ]]; then export NAMESPACE=isys-${ISYS_NAME}; else export NAMESPACE=isys-${ISYS_NAME}-${CI_ENVIRONMENT_SLUG}; fi'
$ if [[ ${CI_ENVIRONMENT_SLUG} = production ]]; then export NAMESPACE=isys-${ISYS_NAME}; else export NAMESPACE=isys-${ISYS_NAME}-${CI_ENVIRONMENT_SLUG}; fi
++ [[ stress = production ]]
++ export NAMESPACE=isys-threat-intelligence-stress
++ NAMESPACE=isys-threat-intelligence-stress
++ echo '$ read -r REVISION STATUS < <(helm --kube-context ${CLUSTER:-default} -n $NAMESPACE history $CI_PROJECT_NAME | tail -1 | cut -f1,3) || true'
$ read -r REVISION STATUS < <(helm --kube-context ${CLUSTER:-default} -n $NAMESPACE history $CI_PROJECT_NAME | tail -1 | cut -f1,3) || true
++ read -r REVISION STATUS
+++ helm --kube-context devstbl -n isys-threat-intelligence-stress history disk-back-main
+++ tail -1
+++ cut -f1,3
++ echo '$ if [[ "$STATUS" =~ "pending" ]]; then helm --kube-context ${CLUSTER:-default} -n $NAMESPACE rollback $CI_PROJECT_NAME $REVISION || true; fi'
$ if [[ "$STATUS" =~ "pending" ]]; then helm --kube-context ${CLUSTER:-default} -n $NAMESPACE rollback $CI_PROJECT_NAME $REVISION || true; fi
++ [[ failed =~ pending ]]
++ echo '$ helmfile ${HELMFILE_DEFAULT_NAMESPACE:+--namespace $HELMFILE_DEFAULT_NAMESPACE} --environment ${CLUSTER:-default} -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set "additionalWorkloadAnnotations.gitlabPipeline=${CI_PIPELINE_URL}" --set "additionalWorkloadAnnotations.gitlabCommit=${CI_COMMIT_SHA}"'
$ helmfile ${HELMFILE_DEFAULT_NAMESPACE:+--namespace $HELMFILE_DEFAULT_NAMESPACE} --environment ${CLUSTER:-default} -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set "additionalWorkloadAnnotations.gitlabPipeline=${CI_PIPELINE_URL}" --set "additionalWorkloadAnnotations.gitlabCommit=${CI_COMMIT_SHA}"
++ helmfile --environment devstbl -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set additionalWorkloadAnnotations.gitlabPipeline=https://gitlab.rshbdev.ru/rshbintech/information-security/application-security/threat-intelligence/disk-back-main/-/pipelines/3644264 --set additionalWorkloadAnnotations.gitlabCommit=43c96700bfdd2c458137dd6ecd0a515925ef68f5
== /usr/local/link/helmfile: Initialize base deploy hierarchy in /builds/rshbintech/information-security/application-security/threat-intelligence/disk-back-main
no matches for path: envs/stress/devstbl/helmfile.yaml.gotmpl
Adding repo rshb-charts https://nexus.rshbdev.ru/repository/charts/
"rshb-charts" has been added to your repositories
Comparing release=vault-secrets-disk-back-main, chart=rshb-charts/raw
Comparing release=psvc-disk-back-main, chart=rshb-charts/raw
isys-threat-intelligence-stress, disk-back-main, PlatformService (production.platform.ckpr.integrations.rshbintech.ru) has changed:
# Source: raw/templates/resources.yaml
apiVersion: production.platform.ckpr.integrations.rshbintech.ru/v1
kind: PlatformService
metadata:
annotations:
ci.build.image.app.farm/version: 22.22.2-bookworm-rshb.0.4.0
ci.runtime.image.app.farm/version: 22.22.2-alpine3.22-rshb.0.2.0
labels:
app: raw
chart: raw-0.2.3-rshb.1.0.0
ci.build.image.app.farm/name: node
ci.kubeclientapps.app.farm/version: 8.21.18
ci.runtime.image.app.farm/name: node-runtime
ci.service.app.farm/lang: typescriptNodejs
ci.service.app.farm/side: backend
- commitShortSHA: 739f8179
+ commitShortSHA: 43c96700
heritage: Helm
release: psvc-disk-back-main
version: stress
name: disk-back-main
spec:
cpuLimits: "1"
cpuRequests: "1"
description: РСХБ диск. Основной бекенд
environment: STRESS
informationSystemId: threat-intelligence-stress
istioSidecarSettings:
limits:
cpu: "1"
- memory: 1Gi
+ memory: 2Gi
requests:
cpu: "1"
memory: 100Mi
name: Disk back main
projectPath: /rshbintech/information-security/application-security/threat-intelligence/disk-back-main
publicDomain: disk-back-main
ramLimits: 1Gi
ramRequests: 512Mi
replicaCount: 1
serviceReference:
name: disk-back-main
namespace: isys-threat-intelligence-stress
side: backend
updateStrategy: Recreate
Comparing release=platform-database-disk-back-main, chart=rshb-charts/raw
Comparing release=disk-back-main-grafana-dashboard, chart=rshb-charts/grafana-dashboards
Comparing release=links-disk-back-main, chart=rshb-charts/raw
Comparing release=disk-back-main, chart=rshb-charts/base
isys-threat-intelligence-stress, disk-back-main, Deployment (apps) has changed:
# Source: base/templates/workload.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: disk-back-main
labels:
app: disk-back-main
fullname: disk-back-main
chart: base-1.15.3
release: disk-back-main
heritage: Helm
isys: "threat-intelligence-stress"
psvc: "disk-back-main"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
annotations:
- gitlabCommit: 7017f1f823a2fa2a51922c915fd150b10c9538e0
- gitlabPipeline: https://gitlab.rshbdev.ru/rshbintech/information-security/application-security/threat-intelligence/disk-back-main/-/pipelines/3468286
- platform.ckpr.integrations.rshbintech.ru/gitlab-commit-sha: 7017f1f8
- platform.ckpr.integrations.rshbintech.ru/gitlab-pipeline-id: "3468286"
+ gitlabCommit: 43c96700bfdd2c458137dd6ecd0a515925ef68f5
+ gitlabPipeline: https://gitlab.rshbdev.ru/rshbintech/information-security/application-security/threat-intelligence/disk-back-main/-/pipelines/3644264
+ platform.ckpr.integrations.rshbintech.ru/gitlab-commit-sha: 43c96700
+ platform.ckpr.integrations.rshbintech.ru/gitlab-pipeline-id: "3644264"
spec:
strategy:
- type: RollingUpdate
+ type: Recreate
replicas: 1
selector:
matchLabels:
app: disk-back-main
fullname: disk-back-main
release: disk-back-main
template:
metadata:
labels:
app: disk-back-main
fullname: disk-back-main
chart: base-1.15.3
release: disk-back-main
heritage: Helm
isys: "threat-intelligence-stress"
psvc: "disk-back-main"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
annotations:
- checksum/configMapsEnv: "86e287d79b9fd98247dd1062bb5deb086ff3ad6dc8f0bcaff883171442796314"
+ checksum/configMapsEnv: "5d51d9b566f39bf12ce1ba8019680353bf1e12219d8660bc2ae71ff3cb15101b"
checksum/secretEnv: "853ba970c48a0e473cc0b2d87cb81941ebc3166c5e7a86ba787d65d842ee3d90"
- ci/commithash: "7017f1f8"
+ ci/commithash: "43c96700"
inject.istio.io/templates: "sidecar,custom"
prometheus.io/path: "/metrics"
prometheus.io/port: "8080"
prometheus.io/scrape: "true"
sidecar.istio.io/proxyCPU: "1"
sidecar.istio.io/proxyCPULimit: "1"
sidecar.istio.io/proxyMemory: "100Mi"
- sidecar.istio.io/proxyMemoryLimit: "1Gi"
+ sidecar.istio.io/proxyMemoryLimit: "2Gi"
sidecar.istio.io/userVolume: "[{\"name\": \"wasmfilters-dir\",\"configMap\": {\"name\": \"threat-intelligence-stress-envoy-filters\"}}]"
sidecar.istio.io/userVolumeMount: "[{\"mountPath\":\"/var/local/lib/wasm-filters\",\"name\":\"wasmfilters-dir\"}]"
spec:
automountServiceAccountToken: false
serviceAccountName: default
nodeSelector:
node-role.kubernetes.io/wload: ""
workload.topology.app.farm/zone: rumsk1
priorityClassName: rumsk1
containers:
- name: app
image: registry.rshbdev.ru/rshbintech/information-security/application-security/threat-intelligence/disk-back-main:stress
imagePullPolicy: Always
envFrom:
- configMapRef:
name: disk-back-main-app-cm-env
- secretRef:
name: disk-back-main-app-secret-env
resources:
limits:
- cpu: 2
- memory: 2Gi
+ cpu: 1
+ memory: 1Gi
requests:
cpu: 1
memory: 512Mi
ports:
livenessProbe:
failureThreshold: 5
httpGet:
path: /health/liveness
port: 8080
initialDelaySeconds: 30
periodSeconds: 5
successThreshold: 1
timeoutSeconds: 1
readinessProbe:
failureThreshold: 3
httpGet:
path: /health/readiness
port: 8080
initialDelaySeconds: 15
periodSeconds: 5
successThreshold: 1
timeoutSeconds: 1
volumeMounts:
- name: app-vault-secrets
mountPath: /secrets
readOnly: true
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
procMount: Default
readOnlyRootFilesystem: false
runAsGroup: 1001
runAsNonRoot: true
runAsUser: 1001
securityContext:
fsGroup: 1001
fsGroupChangePolicy: OnRootMismatch
runAsGroup: 1001
runAsNonRoot: true
runAsUser: 1001
tolerations:
- effect: NoSchedule
key: node-role.kubernetes.io/wload
operator: Exists
- effect: NoSchedule
key: workload.topology.app.farm/zone
operator: Exists
hostNetwork: false
volumes:
- name: app-vault-secrets
csi:
driver: secrets-store.csi.k8s.io
readOnly: true
volumeAttributes:
secretProviderClass: disk-back-main-app-secret-provider
isys-threat-intelligence-stress, disk-back-main-app-cm-env, ConfigMap (v1) has changed:
# Source: base/templates/cm-env.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: disk-back-main-app-cm-env
labels:
app: disk-back-main
fullname: disk-back-main
chart: base-1.15.3
release: disk-back-main
heritage: Helm
isys: "threat-intelligence-stress"
psvc: "disk-back-main"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
data:
APP_API_HOST: "http://disk-back-main.isys-threat-intelligence-stress"
APP_API_PORT: "8080"
- APP_COLLABORA_ADMIN_USER: "admin"
APP_COLLABORA_HOST: "https://10.7.27.25"
- APP_COLLABORA_KIT_STATS_URL: "http://10.7.27.25:9981/cgi-bin/kitmem"
APP_COS_KEYCLOAK_URL: "https://cos.dev.rshbintech.ru"
APP_DB_METRICS_SCHEMA: "diskstressmetrics"
APP_DB_SCHEMA: "diskstress"
APP_DOCUMENT_EDITOR: "r7"
APP_DOCUMENT_SERVER_HOST: "https://10.7.27.25"
APP_ENV: "stress"
APP_EXTERNAL_FRONT_HOST: "https://10.7.221.5"
APP_FRONT_HOST: "https://disk.threat-intelligence.stress.rshbdev.ru"
APP_KAFKA_CLIENT_ID: "disk-main-stress"
APP_KAFKA_GROUP_ID: "disk-main-stress"
APP_KAFKA_HOST: "adapter-threat-intelligence-file-api-cluster.isys-threat-intelligence-stress-links:9092"
APP_KAFKA_TOPIC_NAME: "disk-stress"
APP_KEYCLOAK_URL: "https://auth.rshbdev.ru"
APP_MAIL_OUTSIDE_SMTP_FROM: "noreply@rshb-intech.ru"
APP_MAIL_OUTSIDE_SMTP_HOSTS: "10.30.135.20"
APP_MAIL_OUTSIDE_SMTP_PORT: "25"
APP_MAIL_OUTSIDE_SMTP_SECURE: "false"
APP_MAIL_SMTP_FROM: "disk-noreply@rshb.ru"
APP_MAIL_SMTP_HELO_HOST: "disk-backend"
APP_MAIL_SMTP_HOSTS: "10.18.95.25,10.26.95.25"
APP_MAIL_SMTP_PORT: "25"
APP_MAIL_SMTP_SECURE: "false"
APP_MINIO_HOST: "s3-test.go.rshbank.ru"
APP_MINIO_NAME: "pkr-disk.dev-01"
APP_MINIO_PORT: "80"
APP_MINIO_USE_SSL: "false"
APP_PHONE_REGISTRY_API_URL: "mock"
APP_POSTGRESQL_DISK_BASE_HOST: "10.7.27.8"
APP_POSTGRESQL_DISK_BASE_METRICS_HOST: "10.7.27.8"
APP_POSTGRESQL_DISK_BASE_METRICS_NAME: "mfa_base"
APP_POSTGRESQL_DISK_BASE_METRICS_PORT: "5432"
APP_POSTGRESQL_DISK_BASE_NAME: "mfa_base"
APP_POSTGRESQL_DISK_BASE_PORT: "5432"
APP_POSTGRESQL_DISK_BASE_REPLICATION_HOST: "10.7.27.8"
APP_POSTGRESQL_DISK_BASE_REPLICATION_NAME: "mfa_base"
APP_POSTGRESQL_DISK_BASE_REPLICATION_PORT: "5433"
APP_SEARCH_USERS_COS_HOST: "http://cos-user-auth.isys-cos-stress"
APP_USE_REPLICATION: "false"
APP_VAPID_SUBJECT: "https://disk.threat-intelligence.stress.rshbdev.ru"
Listing releases matching ^pjob-disk-back-main$
Listing releases matching ^exsvc-disk-back-main$
Listing releases matching ^data-disk-back-main$
Listing releases matching ^assets-config-disk-back-main$
Listing releases matching ^disk-back-main-raw$
Listing releases matching ^disk-back-main-prometheus-rules$
Listing releases matching ^disk-back-main-rumsk1$
Listing releases matching ^disk-back-main-rumsk2$
Upgrading release=psvc-disk-back-main, chart=rshb-charts/raw
Release "psvc-disk-back-main" has been upgraded. Happy Helming!
NAME: psvc-disk-back-main
LAST DEPLOYED: Mon Oct 12 11:04:07 2026
NAMESPACE: isys-threat-intelligence-stress
STATUS: deployed
REVISION: 59
TEST SUITE: None
Listing releases matching ^psvc-disk-back-main$
psvc-disk-back-main isys-threat-intelligence-stress 59 2026-10-12 11:04:07.445797324 +0000 UTC deployed raw-0.2.3-rshb.1.0.0 0.2.3
Upgrading release=disk-back-main, chart=rshb-charts/base
UPDATED RELEASES:
NAME CHART VERSION
psvc-disk-back-main rshb-charts/raw 0.2.3-rshb.1.0.0
FAILED RELEASES:
NAME
disk-back-main
in deploy/helmfile.yaml: failed processing release disk-back-main: command "/usr/local/link/helm" exited with non-zero status:
PATH:
/usr/local/link/helm
ARGS:
0: helm (4 bytes)
1: --kube-context (14 bytes)
2: devstbl (7 bytes)
3: upgrade (7 bytes)
4: --install (9 bytes)
5: --reset-values (14 bytes)
6: disk-back-main (14 bytes)
7: rshb-charts/base (16 bytes)
8: --version (9 bytes)
9: 1.15.3 (6 bytes)
10: --wait (6 bytes)
11: --timeout (9 bytes)
12: 600s (4 bytes)
13: --atomic (8 bytes)
14: --kube-context (14 bytes)
15: devstbl (7 bytes)
16: --namespace (11 bytes)
17: isys-threat-intelligence-stress (31 bytes)
18: --values (8 bytes)
19: /tmp/helmfile448746186/isys-threat-intelligence-stress-disk-back-main-values-78c869879 (86 bytes)
20: --values (8 bytes)
21: /tmp/helmfile165010888/isys-threat-intelligence-stress-disk-back-main-values-5865cf5b9c (87 bytes)
22: --set (5 bytes)
23: additionalWorkloadAnnotations.gitlabPipeline=https://gitlab.rshbdev.ru/rshbintech/information-security/application-security/threat-intelligence/disk-back-main/-/pipelines/3644264 (178 bytes)
24: --set (5 bytes)
25: additionalWorkloadAnnotations.gitlabCommit=43c96700bfdd2c458137dd6ecd0a515925ef68f5 (83 bytes)
26: --history-max (13 bytes)
27: 10 (2 bytes)
ERROR:
exit status 1
EXIT STATUS
1
STDERR:
Error: UPGRADE FAILED: an error occurred while rolling back the release. original upgrade error: timed out waiting for the condition: release disk-back-main failed: timed out waiting for the condition
COMBINED OUTPUT:
Error: UPGRADE FAILED: an error occurred while rolling back the release. original upgrade error: timed out waiting for the condition: release disk-back-main failed: timed out waiting for the condition
Uploading artifacts for failed job
00:01
Uploading artifacts...
deploy.env: found 1 matching artifact files and directories
Uploading artifacts as "dotenv" to coordinator... 201 Created id=25370466 responseStatus=201 Created token=64_jkkxt
Cleaning up project directory and file based variables
00:01
ERROR: Job failed: command terminated with exit code 1
dmitriev-aal@VDI-Dmitriev-A:/$ kubectl get pods | grep disk-back-main
disk-back-main-5bf445bcd4-kmh9p 1/2 CrashLoopBackOff 20 (3m39s ago) 87m
disk-back-main-69d4dd6ff8-8v79n 1/2 CrashLoopBackOff 22 (2m49s ago) 96m
dmitriev-aal@VDI-Dmitriev-A:/$ kubectl get events | grep disk-back-main
32m Warning Unhealthy pod/disk-back-main-5bf445bcd4-kmh9p Readiness probe failed: HTTP probe failed with statuscode: 500
33s Normal SecretRotationComplete pod/disk-back-main-5bf445bcd4-kmh9p successfully rotated K8s secret disk-back-main-app-secret-env
119s Warning BackOff pod/disk-back-main-5bf445bcd4-kmh9p Back-off restarting failed container
31m Normal Pulling pod/disk-back-main-69d4dd6ff8-8v79n Pulling image "registry.rshbdev.ru/rshbintech/information-security/application-security/threat-intelligence/disk-back-main:stress"
33s Normal SecretRotationComplete pod/disk-back-main-69d4dd6ff8-8v79n successfully rotated K8s secret disk-back-main-app-secret-env
116s Warning BackOff pod/disk-back-main-69d4dd6ff8-8v79n Back-off restarting failed container
3m48s Normal KEDAScalersStarted scaledobject/disk-back-main Started scalers watch
dmitriev-aal@VDI-Dmitriev-A:/$ 