https://pastein.ru/t/d5J
Загрузка данных
Running with gitlab-runner 15.8.0 (12335144)
on gitlab-runner-gitlab-runner-7d64bfd458-xlzsd u1oHxtyM, system ID: r_OKg3w9r0mqgd
Preparing the "kubernetes" executor
00:00
Using Kubernetes namespace: gitlab-runners
Using Kubernetes executor with image registry.rshbdev.ru/appfarm/infra/images/kube-client-apps:8.21.9 ...
Using attach strategy to execute scripts...
Preparing environment
00:06
Waiting for pod gitlab-runners/runner-u1ohxtym-project-42401-concurrent-2zbhrv to be running, status is Pending
Waiting for pod gitlab-runners/runner-u1ohxtym-project-42401-concurrent-2zbhrv to be running, status is Pending
ContainersNotReady: "containers with unready status: [build helper]"
ContainersNotReady: "containers with unready status: [build helper]"
Running on runner-u1ohxtym-project-42401-concurrent-2zbhrv via gitlab-runner-gitlab-runner-7d64bfd458-xlzsd...
Getting source from Git repository
00:02
$ git config --global --add url."https://gitlab-ci-token:${CI_JOB_TOKEN}@${CI_SERVER_HOST}/".insteadOf "https://${CI_SERVER_HOST}" # collapsed multi-line command
Fetching changes with git depth set to 20...
Initialized empty Git repository in /builds/rshbintech/crft/ckof/ownfin/backend/core/owf-ms-plt-client-profile/.git/
Created fresh repository.
Checking out 494104b2 as stress...
Skipping Git submodules setup
Downloading artifacts
00:02
Downloading artifacts for devsecops_antivirus_scan (22926699)...
Downloading artifacts from coordinator... ok id=22926699 responseStatus=200 OK token=64_uSsTJ
Downloading artifacts for dockerfilegen (22926700)...
Downloading artifacts from coordinator... ok id=22926700 responseStatus=200 OK token=64_uSsTJ
Downloading artifacts for build (22926701)...
Downloading artifacts from coordinator... ok id=22926701 responseStatus=200 OK token=64_uSsTJ
Downloading artifacts for unit (22926705)...
Downloading artifacts from coordinator... ok id=22926705 responseStatus=200 OK token=64_uSsTJ
Executing "step_script" stage of the job script
21:39
$ ( umask 0077; mkdir -p ~/.kube && echo "$KUBECONFIG_COMBINED" | base64 -d > ~/.kube/config )
$ if [[ ${IS_SENSITIVE_SYSTEM} = true ]]; then export K8S_CLUSTERS=$K8S_CLUSTERS_SENSITIVE; fi
$ echo 'IS_SENSITIVE_SYSTEM:' $IS_SENSITIVE_SYSTEM
IS_SENSITIVE_SYSTEM: true
$ echo 'TARGET_CLUSTERS:' $K8S_CLUSTERS
TARGET_CLUSTERS: rcsdstbl
$ set -x
++ echo '$ for CLUSTER in $K8S_CLUSTERS; do'
$ for CLUSTER in $K8S_CLUSTERS; do
++ for CLUSTER in $K8S_CLUSTERS
++ echo '$ export CLUSTER=$CLUSTER'
$ export CLUSTER=$CLUSTER
++ export CLUSTER=rcsdstbl
++ CLUSTER=rcsdstbl
++ echo '$ if [[ ${CI_ENVIRONMENT_SLUG} = production ]]; then export NAMESPACE=isys-${ISYS_NAME}; else export NAMESPACE=isys-${ISYS_NAME}-${CI_ENVIRONMENT_SLUG}; fi'
$ if [[ ${CI_ENVIRONMENT_SLUG} = production ]]; then export NAMESPACE=isys-${ISYS_NAME}; else export NAMESPACE=isys-${ISYS_NAME}-${CI_ENVIRONMENT_SLUG}; fi
++ [[ stress = production ]]
++ export NAMESPACE=isys-ownfin-stress
++ NAMESPACE=isys-ownfin-stress
++ echo '$ read -r REVISION STATUS < <(helm --kube-context ${CLUSTER:-default} -n $NAMESPACE history $CI_PROJECT_NAME | tail -1 | cut -f1,3) || true'
$ read -r REVISION STATUS < <(helm --kube-context ${CLUSTER:-default} -n $NAMESPACE history $CI_PROJECT_NAME | tail -1 | cut -f1,3) || true
++ read -r REVISION STATUS
+++ helm --kube-context rcsdstbl -n isys-ownfin-stress history owf-ms-plt-client-profile
+++ tail -1
+++ cut -f1,3
++ echo '$ if [[ "$STATUS" =~ "pending" ]]; then helm --kube-context ${CLUSTER:-default} -n $NAMESPACE rollback $CI_PROJECT_NAME $REVISION || true; fi'
$ if [[ "$STATUS" =~ "pending" ]]; then helm --kube-context ${CLUSTER:-default} -n $NAMESPACE rollback $CI_PROJECT_NAME $REVISION || true; fi
++ [[ failed =~ pending ]]
++ echo '$ helmfile ${HELMFILE_DEFAULT_NAMESPACE:+--namespace $HELMFILE_DEFAULT_NAMESPACE} --environment ${CLUSTER:-default} -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set "additionalWorkloadAnnotations.gitlabPipeline=${CI_PIPELINE_URL}" --set "additionalWorkloadAnnotations.gitlabCommit=${CI_COMMIT_SHA}"'
$ helmfile ${HELMFILE_DEFAULT_NAMESPACE:+--namespace $HELMFILE_DEFAULT_NAMESPACE} --environment ${CLUSTER:-default} -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set "additionalWorkloadAnnotations.gitlabPipeline=${CI_PIPELINE_URL}" --set "additionalWorkloadAnnotations.gitlabCommit=${CI_COMMIT_SHA}"
++ helmfile --environment rcsdstbl -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set additionalWorkloadAnnotations.gitlabPipeline=https://gitlab.rshbdev.ru/rshbintech/crft/ckof/ownfin/backend/core/owf-ms-plt-client-profile/-/pipelines/3288713 --set additionalWorkloadAnnotations.gitlabCommit=494104b22cce78f3f40c8b752709d104b00c82b1
== /usr/local/link/helmfile: Initialize base deploy hierarchy in /builds/rshbintech/crft/ckof/ownfin/backend/core/owf-ms-plt-client-profile
no matches for path: envs/stress/rcsdstbl/helmfile.yaml.gotmpl
Adding repo rshb-charts https://nexus.rshbdev.ru/repository/charts/
"rshb-charts" has been added to your repositories
Comparing release=vault-secrets-owf-ms-plt-client-profile, chart=rshb-charts/raw
Comparing release=psvc-owf-ms-plt-client-profile, chart=rshb-charts/raw
Comparing release=platform-database-owf-ms-plt-client-profile, chart=rshb-charts/raw
Comparing release=links-owf-ms-plt-client-profile, chart=rshb-charts/raw
Comparing release=owf-ms-plt-client-profile, chart=rshb-charts/base
isys-ownfin-stress, owf-ms-plt-client-profile, Deployment (apps) has changed:
# Source: base/templates/workload.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: owf-ms-plt-client-profile
labels:
app: owf-ms-plt-client-profile
fullname: owf-ms-plt-client-profile
chart: base-1.15.2
release: owf-ms-plt-client-profile
heritage: Helm
isys: "ownfin-stress"
psvc: "owf-ms-plt-client-profile"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
annotations:
- gitlabCommit: da04ed4d7fff71ed0bd9d0cc96024201c48e2ff8
- gitlabPipeline: https://gitlab.rshbdev.ru/rshbintech/crft/ckof/ownfin/backend/core/owf-ms-plt-client-profile/-/pipelines/3266816
- platform.ckpr.integrations.rshbintech.ru/gitlab-commit-sha: da04ed4d
- platform.ckpr.integrations.rshbintech.ru/gitlab-pipeline-id: "3266816"
+ gitlabCommit: 494104b22cce78f3f40c8b752709d104b00c82b1
+ gitlabPipeline: https://gitlab.rshbdev.ru/rshbintech/crft/ckof/ownfin/backend/core/owf-ms-plt-client-profile/-/pipelines/3288713
+ platform.ckpr.integrations.rshbintech.ru/gitlab-commit-sha: 494104b2
+ platform.ckpr.integrations.rshbintech.ru/gitlab-pipeline-id: "3288713"
spec:
strategy:
type: Recreate
replicas: 2
selector:
matchLabels:
app: owf-ms-plt-client-profile
fullname: owf-ms-plt-client-profile
release: owf-ms-plt-client-profile
template:
metadata:
labels:
app: owf-ms-plt-client-profile
fullname: owf-ms-plt-client-profile
chart: base-1.15.2
release: owf-ms-plt-client-profile
heritage: Helm
isys: "ownfin-stress"
psvc: "owf-ms-plt-client-profile"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
annotations:
- checksum/configMapsEnv: "7727afdf1287ef44dd77e135b861c3d3d9a5916f009fe2a0f69c8d5aa2d0a814"
+ checksum/configMapsEnv: "05aa90afd27a6e6196f4290ce90c6fff40ba92fc1aa096dad09a173193dbd8b5"
checksum/secretEnv: "7f2c9110d41a39361407ea98acf7718fd7f3729e37997b926aadcce3eb5fe647"
- ci/commithash: "da04ed4d"
+ ci/commithash: "494104b2"
inject.istio.io/templates: "sidecar,custom"
prometheus.io/path: "/metrics"
prometheus.io/port: "8080"
prometheus.io/scrape: "true"
sidecar.istio.io/proxyCPU: "200m"
sidecar.istio.io/proxyCPULimit: "500m"
sidecar.istio.io/proxyMemory: "256Mi"
sidecar.istio.io/proxyMemoryLimit: "640Mi"
sidecar.istio.io/userVolume: "[{\"name\": \"wasmfilters-dir\",\"configMap\": {\"name\": \"ownfin-stress-envoy-filters\"}}]"
sidecar.istio.io/userVolumeMount: "[{\"mountPath\":\"/var/local/lib/wasm-filters\",\"name\":\"wasmfilters-dir\"}]"
spec:
automountServiceAccountToken: false
serviceAccountName: default
nodeSelector:
node-role.kubernetes.io/wload: ""
workload.topology.app.farm/zone: rumsk1
+ priorityClassName: rumsk1
containers:
- name: app
image: registry.rshbdev.ru/rshbintech/crft/ckof/ownfin/backend/core/owf-ms-plt-client-profile:stress
imagePullPolicy: Always
envFrom:
- configMapRef:
name: owf-ms-plt-client-profile-app-cm-env
- secretRef:
name: owf-ms-plt-client-profile-app-secret-env
resources:
limits:
cpu: 1000m
memory: 4Gi
requests:
cpu: 200m
memory: 512Mi
ports:
livenessProbe:
failureThreshold: 5
httpGet:
path: /health/liveness
port: 8080
initialDelaySeconds: 240
periodSeconds: 5
successThreshold: 1
timeoutSeconds: 1
readinessProbe:
failureThreshold: 3
httpGet:
path: /health/readiness
port: 8080
initialDelaySeconds: 60
periodSeconds: 4
successThreshold: 1
timeoutSeconds: 1
volumeMounts:
- name: app-vault-secrets
mountPath: /secrets
readOnly: true
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
procMount: Default
readOnlyRootFilesystem: false
runAsGroup: 1001
runAsNonRoot: true
runAsUser: 1001
securityContext:
fsGroup: 1001
fsGroupChangePolicy: OnRootMismatch
runAsGroup: 1001
runAsNonRoot: true
runAsUser: 1001
tolerations:
- effect: NoSchedule
key: node-role.kubernetes.io/wload
operator: Exists
- effect: NoSchedule
key: workload.topology.app.farm/zone
operator: Exists
hostNetwork: false
volumes:
- name: app-vault-secrets
csi:
driver: secrets-store.csi.k8s.io
readOnly: true
volumeAttributes:
secretProviderClass: owf-ms-plt-client-profile-app-secret-provider
isys-ownfin-stress, owf-ms-plt-client-profile-app-cm-env, ConfigMap (v1) has changed:
# Source: base/templates/cm-env.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: owf-ms-plt-client-profile-app-cm-env
labels:
app: owf-ms-plt-client-profile
fullname: owf-ms-plt-client-profile
chart: base-1.15.2
release: owf-ms-plt-client-profile
heritage: Helm
isys: "ownfin-stress"
psvc: "owf-ms-plt-client-profile"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
data:
ACCOUNT_DETAILS_REPLICATION_INIT_URL: "http://owf-ms-plt-card-registry/api/card-registry/internal/v1/init-replication"
ACCOUNT_DETAILS_REPLICATION_TOPIC_NAME: "plt_card-registry_account_details_pub"
APP_POSTGRESQL_PG_1_HOST: "10.21.25.43"
APP_POSTGRESQL_PG_1_NAME: "ownfin-stress"
APP_POSTGRESQL_PG_1_PORT: "5432"
APP_POSTGRESQL_PG_2_HOST: "10.21.25.43"
APP_POSTGRESQL_PG_2_NAME: "ownfin-stress"
APP_POSTGRESQL_PG_2_PORT: "5432"
APP_POSTGRESQL_SCHEMA: "owf_ms_plt_client_profile"
APP_SERVICE_NAME: "owf-ms-plt-client-profile.isys-ownfin-stress.app"
APP_TRACING_COLLECTOR: "[MASKED]"
+ AUTH_CLIENT_DEVICE_SESSION_TOPIC_NAME: "prd_auth_client_device_session_pub"
AUTH_CLIENT_SESSION_TOPIC_NAME: "prd_auth_client_session_pub"
AUTH_PUB_KEYS_URL: "https://auth.rshbdev.ru/auth/realms/platform/protocol/openid-connect/certs"
BANK_ROLE_PERMISSION_PUB_REPLICATION_TOPIC: "plt_bank_roles_control_pub"
CDI_CREATE_XREF_REQ_URL: "http://dbo2-flow.isys-flow-adapters-stress/api/CdiCreateXrefRequest"
CDI_GET_PERSON_REQ_TOPIC_NAME: "ownfin.cdi_get_person_req"
CDI_GET_PERSON_RESP_TOPIC_NAME: "ownfin.cdi_get_person_resp"
CDI_PUBLISH_PERSON_RELATION: "cdi.publish-person-relation"
CDI_UPDATE_PERSON_REQ_URL: "http://dbo2-flow.isys-flow-adapters-stress/api/CdiUpdatePersonRequest"
CLIENT_DEVICE_PC_PUB: "plt_client_device_pc_pub"
CLIENT_PRODUCT_DEVICE_TOPIC_NAME: "from_monolith_to_product_device_topic"
CLIENT_PROFILE_CHANGE_NUMBER_PHONE_FROM_MONOLITH_TOPIC_NAME: "plt_client_change_number_from_monolith_req"
CLIENT_PROFILE_CHANGE_ROLE_BY_PASSPORT_ANSWER_TOPIC_NAME: "plt_client_change_role_by_passport_answer"
CLIENT_PROFILE_CHANGE_ROLE_BY_PASSPORT_REQUEST_TOPIC_NAME: "plt_client_change_role_by_passport_request"
CLIENT_PROFILE_INITIALIZATION_TOPIC_NAME: "plt_client_init_pub"
CLIENT_PROFILE_PUBLISH_PERSON_MONOLITH: "plt_client_from_monolith"
CLIENT_PROFILE_REPLICATION_TOPIC_NAME: "plt_client_pub"
CLIENT_REGISTRY_RESULT_PUB_TOPIC_NAME: "plt_client_registry_result_pub"
CLIENT_REGISTRY_TOPIC_NAME: "plt_client_registry"
CLIENT_VERIFIED_CONTACT_TOPIC_NAME: "prd_client_verified_contact_pub"
EMPLOYEE_ROLE_MODEL_HOST: "http://owf-plt-ms-employee-role-model.isys-ownfin-stress"
ENABLE_FLOW_ADAPTER: "true"
FAMILY_ACCESS_TOPIC_NAME: "plt_account-registry_family-access_pub"
FLOW_ADAPTER_KAFKA_BOOTSTRAP_SERVERS: "adapter-flow-adapters-flow-kafka-int.isys-ownfin-stress-links:9092"
JAVA_OPTS: "-XX:MaxRAMPercentage=75.0 -XX:MinRAMPercentage=75.0 -XX:+AlwaysActAsServerClassMachine"
KAFKA_BOOTSTRAP_SERVERS: "adapter-ownfin-cluster.isys-ownfin-stress-links:9092"
KAFKA_MONOLITH_CONN_SVC: "10.21.25.11:9092,10.21.25.20:9092,10.21.25.21:9092"
KAFKA_PRODUCER_ACKS: "all"
KAFKA_PRODUCER_BATCH_SIZE: "32000"
KAFKA_PRODUCER_LINGER_MS: "1000"
MONOLIT_CLIENT_DATA_TOPIC_NAME: "plt_client_to_monolit_client_data_pub"
+ PAY_CONTROL_CALLBACK_URL: "http://owf-ms-plt-client-profile/api/client-profile/external/v1/payControlDeviceData6"
+ PAY_CONTROL_V6_SERVER: "http://owf-ms-plt-stub-service/api/"
+ PAY_CONTROL_V6_SYSTEM_ID: "81cda313-9d0b-41bc-8afd-8453c990f6ca"
PLT_CLIENT_DEVICE_PUB_TOPIC_NAME: "plt_client_device_topic_pub"
PROFILE: "stress"
SCHEDULER_CHECK_PASSPORT_CRON: "0 0 0 * * *"
SCHEDULER_CHECK_PENSIONER_CRON: "0 0 2 * * *"
SUBSCRIPTION_REPLICATION_INIT_URL: "http://owf-ms-prd-subscription-vsesvoe/api/subscription-vsesvoe/internal/v1/init-subscription-users-replication"
SUBSCRIPTION_REPLICATION_TOPIC_NAME: "prd_subscription_users_pub"
TRACING_SAMPLING_PROBABILITY: "0.2"
UPDATE_CLIENT_STATUS_REQ_URL: "http://dbo2-flow.isys-flow-adapters-stress/api/UpdateStatusClientDBORequest"
URL_PRIVATE_REST: "http://10.21.25.10:7777"
Listing releases matching ^pjob-owf-ms-plt-client-profile$
Listing releases matching ^exsvc-owf-ms-plt-client-profile$
Listing releases matching ^data-owf-ms-plt-client-profile$
Listing releases matching ^assets-config-owf-ms-plt-client-profile$
Listing releases matching ^owf-ms-plt-client-profile-raw$
Listing releases matching ^owf-ms-plt-client-profile-grafana-dashboard$
Listing releases matching ^owf-ms-plt-client-profile-rumsk1$
Listing releases matching ^owf-ms-plt-client-profile-rumsk2$
Upgrading release=owf-ms-plt-client-profile, chart=rshb-charts/base
FAILED RELEASES:
NAME
owf-ms-plt-client-profile
in deploy/helmfile.yaml: failed processing release owf-ms-plt-client-profile: command "/usr/local/link/helm" exited with non-zero status:
PATH:
/usr/local/link/helm
ARGS:
0: helm (4 bytes)
1: --kube-context (14 bytes)
2: rcsdstbl (8 bytes)
3: upgrade (7 bytes)
4: --install (9 bytes)
5: --reset-values (14 bytes)
6: owf-ms-plt-client-profile (25 bytes)
7: rshb-charts/base (16 bytes)
8: --version (9 bytes)
9: 1.15.2 (6 bytes)
10: --wait (6 bytes)
11: --timeout (9 bytes)
12: 600s (4 bytes)
13: --atomic (8 bytes)
14: --kube-context (14 bytes)
15: rcsdstbl (8 bytes)
16: --namespace (11 bytes)
17: isys-ownfin-stress (18 bytes)
18: --values (8 bytes)
19: /tmp/helmfile3709891283/isys-ownfin-stress-owf-ms-plt-client-profile-values-68ddb8cc69 (86 bytes)
20: --values (8 bytes)
21: /tmp/helmfile3786235398/isys-ownfin-stress-owf-ms-plt-client-profile-values-547b948f88 (86 bytes)
22: --set (5 bytes)
23: additionalWorkloadAnnotations.gitlabPipeline=https://gitlab.rshbdev.ru/rshbintech/crft/ckof/ownfin/backend/core/owf-ms-plt-client-profile/-/pipelines/3288713 (157 bytes)
24: --set (5 bytes)
25: additionalWorkloadAnnotations.gitlabCommit=494104b22cce78f3f40c8b752709d104b00c82b1 (83 bytes)
26: --history-max (13 bytes)
27: 10 (2 bytes)
ERROR:
exit status 1
EXIT STATUS
1
STDERR:
Error: UPGRADE FAILED: an error occurred while rolling back the release. original upgrade error: timed out waiting for the condition: release owf-ms-plt-client-profile failed: timed out waiting for the condition
COMBINED OUTPUT:
Error: UPGRADE FAILED: an error occurred while rolling back the release. original upgrade error: timed out waiting for the condition: release owf-ms-plt-client-profile failed: timed out waiting for the condition
Uploading artifacts for failed job
00:03
Uploading artifacts...
deploy.env: found 1 matching artifact files and directories
Uploading artifacts as "dotenv" to coordinator... 201 Created id=22931586 responseStatus=201 Created token=64_uSsTJ
Cleaning up project directory and file based variables
00:00
ERROR: Job failed: command terminated with exit code 1