https://pastein.ru/t/siM
Загрузка данных
Running with gitlab-runner 15.8.0 (12335144)
on gitlab-runner-gitlab-runner-64775b4cff-qpdc8 9cgwHtm5, system ID: r_FsAm41LqwxCr
Preparing the "kubernetes" executor
00:00
Using Kubernetes namespace: gitlab-runners
Using Kubernetes executor with image registry.rshbdev.ru/appfarm/infra/images/kube-client-apps:8.21.10 ...
Using attach strategy to execute scripts...
Preparing environment
00:06
Waiting for pod gitlab-runners/runner-9cgwhtm5-project-11544-concurrent-09xwht to be running, status is Pending
Waiting for pod gitlab-runners/runner-9cgwhtm5-project-11544-concurrent-09xwht to be running, status is Pending
ContainersNotReady: "containers with unready status: [build helper]"
ContainersNotReady: "containers with unready status: [build helper]"
Running on runner-9cgwhtm5-project-11544-concurrent-09xwht via gitlab-runner-gitlab-runner-64775b4cff-qpdc8...
Getting source from Git repository
00:02
$ git config --global --add url."https://gitlab-ci-token:${CI_JOB_TOKEN}@${CI_SERVER_HOST}/".insteadOf "https://${CI_SERVER_HOST}" # collapsed multi-line command
Fetching changes with git depth set to 20...
Initialized empty Git repository in /builds/rshbintech/integrations/cki/ip2-services/flow-adapters/ocrm-le-flow/.git/
Created fresh repository.
Checking out 7a9cf71d as stress...
Skipping Git submodules setup
Downloading artifacts
00:01
Downloading artifacts for devsecops_antivirus_scan (23225095)...
Downloading artifacts from coordinator... ok id=23225095 responseStatus=200 OK token=64_BiYmw
Downloading artifacts for dockerfilegen (23225096)...
Downloading artifacts from coordinator... ok id=23225096 responseStatus=200 OK token=64_BiYmw
Downloading artifacts for build (23225098)...
Downloading artifacts from coordinator... ok id=23225098 responseStatus=200 OK token=64_BiYmw
Downloading artifacts for unit (23225100)...
Downloading artifacts from coordinator... ok id=23225100 responseStatus=200 OK token=64_BiYmw
Executing "step_script" stage of the job script
10:14
$ ( umask 0077; mkdir -p ~/.kube && echo "$KUBECONFIG_COMBINED" | base64 -d > ~/.kube/config )
$ if [[ ${IS_SENSITIVE_SYSTEM} = true ]]; then export K8S_CLUSTERS=$K8S_CLUSTERS_SENSITIVE; fi
$ echo 'IS_SENSITIVE_SYSTEM:' $IS_SENSITIVE_SYSTEM
IS_SENSITIVE_SYSTEM: true
$ echo 'TARGET_CLUSTERS:' $K8S_CLUSTERS
TARGET_CLUSTERS: rcsdstbl
$ set -x
++ echo '$ for CLUSTER in $K8S_CLUSTERS; do'
$ for CLUSTER in $K8S_CLUSTERS; do
++ for CLUSTER in $K8S_CLUSTERS
++ echo '$ export CLUSTER=$CLUSTER'
$ export CLUSTER=$CLUSTER
++ export CLUSTER=rcsdstbl
++ CLUSTER=rcsdstbl
++ echo '$ if [[ ${CI_ENVIRONMENT_SLUG} = production ]]; then export NAMESPACE=isys-${ISYS_NAME}; else export NAMESPACE=isys-${ISYS_NAME}-${CI_ENVIRONMENT_SLUG}; fi'
$ if [[ ${CI_ENVIRONMENT_SLUG} = production ]]; then export NAMESPACE=isys-${ISYS_NAME}; else export NAMESPACE=isys-${ISYS_NAME}-${CI_ENVIRONMENT_SLUG}; fi
++ [[ stress = production ]]
++ export NAMESPACE=isys-flow-adapters-stress
++ NAMESPACE=isys-flow-adapters-stress
++ echo '$ read -r REVISION STATUS < <(helm --kube-context ${CLUSTER:-default} -n $NAMESPACE history $CI_PROJECT_NAME | tail -1 | cut -f1,3) || true'
$ read -r REVISION STATUS < <(helm --kube-context ${CLUSTER:-default} -n $NAMESPACE history $CI_PROJECT_NAME | tail -1 | cut -f1,3) || true
++ read -r REVISION STATUS
+++ helm --kube-context rcsdstbl -n isys-flow-adapters-stress history ocrm-le-flow
+++ tail -1
+++ cut -f1,3
++ echo '$ if [[ "$STATUS" =~ "pending" ]]; then helm --kube-context ${CLUSTER:-default} -n $NAMESPACE rollback $CI_PROJECT_NAME $REVISION || true; fi'
$ if [[ "$STATUS" =~ "pending" ]]; then helm --kube-context ${CLUSTER:-default} -n $NAMESPACE rollback $CI_PROJECT_NAME $REVISION || true; fi
++ [[ deployed =~ pending ]]
++ echo '$ helmfile ${HELMFILE_DEFAULT_NAMESPACE:+--namespace $HELMFILE_DEFAULT_NAMESPACE} --environment ${CLUSTER:-default} -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set "additionalWorkloadAnnotations.gitlabPipeline=${CI_PIPELINE_URL}" --set "additionalWorkloadAnnotations.gitlabCommit=${CI_COMMIT_SHA}"'
$ helmfile ${HELMFILE_DEFAULT_NAMESPACE:+--namespace $HELMFILE_DEFAULT_NAMESPACE} --environment ${CLUSTER:-default} -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set "additionalWorkloadAnnotations.gitlabPipeline=${CI_PIPELINE_URL}" --set "additionalWorkloadAnnotations.gitlabCommit=${CI_COMMIT_SHA}"
++ helmfile --environment rcsdstbl -f deploy/helmfile.yaml --log-level info apply --suppress-secrets --set additionalWorkloadAnnotations.gitlabPipeline=https://gitlab.rshbdev.ru/rshbintech/integrations/cki/ip2-services/flow-adapters/ocrm-le-flow/-/pipelines/3332558 --set additionalWorkloadAnnotations.gitlabCommit=7a9cf71dbb25cd6b617d18784e73f330c62e549f
== /usr/local/link/helmfile: Initialize base deploy hierarchy in /builds/rshbintech/integrations/cki/ip2-services/flow-adapters/ocrm-le-flow
no matches for path: envs/stress/rcsdstbl/helmfile.yaml.gotmpl
Adding repo rshb-charts https://nexus.rshbdev.ru/repository/charts/
"rshb-charts" has been added to your repositories
Comparing release=psvc-ocrm-le-flow, chart=rshb-charts/raw
Comparing release=links-ocrm-le-flow, chart=rshb-charts/raw
Comparing release=ocrm-le-flow, chart=rshb-charts/base
isys-flow-adapters-stress, ocrm-le-flow, Deployment (apps) has changed:
# Source: base/templates/workload.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: ocrm-le-flow
labels:
app: ocrm-le-flow
fullname: ocrm-le-flow
- chart: base-1.13.0
+ chart: base-1.15.2
release: ocrm-le-flow
heritage: Helm
isys: "flow-adapters-stress"
psvc: "ocrm-le-flow"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
annotations:
- platform.ckpr.integrations.rshbintech.ru/gitlab-commit-sha: ab1495c6
- platform.ckpr.integrations.rshbintech.ru/gitlab-pipeline-id: "1751262"
+ gitlabCommit: 7a9cf71dbb25cd6b617d18784e73f330c62e549f
+ gitlabPipeline: https://gitlab.rshbdev.ru/rshbintech/integrations/cki/ip2-services/flow-adapters/ocrm-le-flow/-/pipelines/3332558
+ platform.ckpr.integrations.rshbintech.ru/gitlab-commit-sha: 7a9cf71d
+ platform.ckpr.integrations.rshbintech.ru/gitlab-pipeline-id: "3332558"
spec:
strategy:
type: RollingUpdate
replicas: 1
selector:
matchLabels:
app: ocrm-le-flow
fullname: ocrm-le-flow
release: ocrm-le-flow
template:
metadata:
labels:
app: ocrm-le-flow
fullname: ocrm-le-flow
- chart: base-1.13.0
+ chart: base-1.15.2
release: ocrm-le-flow
heritage: Helm
isys: "flow-adapters-stress"
psvc: "ocrm-le-flow"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
annotations:
- checksum/configMapsEnv: "7d6dc993bb90f8b02931be5313dcb46cb46cb9a9adac772d696679a42e44bc29"
+ checksum/configMapsEnv: "dc0eb5ac5a6d700cf83120bdbd896d8b47048cfb4bfb43d376dcb1e5172418e8"
checksum/secretEnv: "01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b"
- ci/commithash: "ab1495c6"
+ ci/commithash: "7a9cf71d"
inject.istio.io/templates: "sidecar,custom"
prometheus.io/path: "/metrics"
prometheus.io/port: "8080"
prometheus.io/scrape: "true"
sidecar.istio.io/userVolume: "[{\"name\": \"wasmfilters-dir\",\"configMap\": {\"name\": \"flow-adapters-stress-envoy-filters\"}}]"
sidecar.istio.io/userVolumeMount: "[{\"mountPath\":\"/var/local/lib/wasm-filters\",\"name\":\"wasmfilters-dir\"}]"
spec:
+ automountServiceAccountToken: false
serviceAccountName: default
nodeSelector:
node-role.kubernetes.io/wload: ""
workload.topology.app.farm/zone: rumsk1
- priorityClassName:
- rumsk1
+ priorityClassName: rumsk1
containers:
- name: app
image: registry.rshbdev.ru/rshbintech/integrations/cki/ip2-services/flow-adapters/ocrm-le-flow:stress
imagePullPolicy: Always
envFrom:
- configMapRef:
name: ocrm-le-flow-app-cm-env
resources:
limits:
cpu: "2"
memory: 2Gi
requests:
cpu: "2"
memory: 2Gi
ports:
startupProbe:
failureThreshold: 60
httpGet:
path: /health/liveness
port: 8080
periodSeconds: 5
successThreshold: 1
timeoutSeconds: 1
livenessProbe:
failureThreshold: 5
httpGet:
path: /health/liveness
port: 8080
initialDelaySeconds: 0
periodSeconds: 5
successThreshold: 1
timeoutSeconds: 3
readinessProbe:
failureThreshold: 3
httpGet:
path: /health/readiness
port: 8080
initialDelaySeconds: 0
periodSeconds: 5
successThreshold: 1
timeoutSeconds: 3
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
procMount: Default
readOnlyRootFilesystem: false
runAsGroup: 1001
runAsNonRoot: true
runAsUser: 1001
securityContext:
fsGroup: 1001
fsGroupChangePolicy: OnRootMismatch
runAsGroup: 1001
runAsNonRoot: true
runAsUser: 1001
tolerations:
- effect: NoSchedule
key: node-role.kubernetes.io/wload
operator: Exists
- effect: NoSchedule
key: workload.topology.app.farm/zone
operator: Exists
hostNetwork: false
volumes:
isys-flow-adapters-stress, ocrm-le-flow, Service (v1) has changed:
# Source: base/templates/svc.yaml
apiVersion: v1
kind: Service
metadata:
name: ocrm-le-flow
labels:
app: ocrm-le-flow
fullname: ocrm-le-flow
- chart: base-1.13.0
+ chart: base-1.15.2
release: ocrm-le-flow
heritage: Helm
isys: "flow-adapters-stress"
psvc: "ocrm-le-flow"
version: "stress"
spec:
ports:
- name: web
port: 80
protocol: TCP
targetPort: 8080
selector:
app: ocrm-le-flow
fullname: ocrm-le-flow
release: ocrm-le-flow
type: ClusterIP
isys-flow-adapters-stress, ocrm-le-flow-app-cm-env, ConfigMap (v1) has changed:
# Source: base/templates/cm-env.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: ocrm-le-flow-app-cm-env
labels:
app: ocrm-le-flow
fullname: ocrm-le-flow
- chart: base-1.13.0
+ chart: base-1.15.2
release: ocrm-le-flow
heritage: Helm
isys: "flow-adapters-stress"
psvc: "ocrm-le-flow"
version: "stress"
workload.topology.app.farm/zone: "rumsk1"
data:
APP_LOG_LEVEL_RU_RSHB: "TRACE"
APP_LOG_LEVEL_RU_RSHBINTECH: "TRACE"
APP_LOG_LEVEL_RU_RSHBINTECH_LOGGING_STARTER_ASPECT: "INFO"
APP_LOG_LEVEL_SPRINGFRAMEWORK: "INFO"
APP_VALIDATOR_URL: "http://bd-validator.isys-integration-core-stress"
CBRF_RATE_URL: "http://cbrf-rate.isys-exchange-rates-stress"
CDI_FLOW_URL: "http://cdi-flow.isys-flow-adapters-stress"
CDI_URL: "http://adapter-cdi.exsys-cdi-stress-links/api/v1/messages"
CFT2_URL: "http://adapter-cft.exsys-cft-stress-links/api/v1/messages"
CFT_FLOW_URL: "http://cft-flow.isys-flow-adapters-stress"
CFT_URL: "http://adapter-cft.exsys-cft-stress-links/api/v1/messages"
CRE_FLOW_URL: "http://cre-flow.isys-flow-adapters-stress"
DATA_HUB_CRAWLER_URL: "http://10.21.108.30:9086"
DBOLE2_URL: "http://adapter-dbole2.exsys-dbole2-stress-links/api/v1/messages"
DBOLE_FLOW_URL: "http://dbole-flow.isys-flow-adapters-stress"
DBOLE_URL: "http://adapter-dbole.exsys-dbole-stress-links/api/v1/messages"
EFRUL_TASKS_SERVICE_URL: "http://tasks-service.isys-efrul-stress"
EPRSHB2_FOS_SERVICE_URL: "http://fos-service.isys-electronic-platform-stress"
EPRSHB_A_CALCULATOR_URL: "http://calculator.isys-electronic-platform-stress"
EPRSHB_B_CLIENT_DIA_URL: "http://client-dia.isys-electronic-platform-stress"
EPRSHB_FLOW_URL: "http://eprshb-flow.isys-flow-adapters-stress"
IP1_URL: "http://adapter-flow-adapters.isys-flow-adapters-stress-links/api/v1/messages"
JAVA_OPTS: "-XX:+PrintFlagsFinal -XX:MaxRAMPercentage=75.0 -XX:MinRAMPercentage=75.0 -XX:+UseTransparentHugePages"
KKRLE_URL: "http://adapter-kkrle.exsys-kkrle-stress-links/api/v1/messages"
KUBERNETES_CLUSTER: "STRESS"
LEA_URL: "http://adapter-lea.exsys-lea-stress-links/api/v1/messages"
LOG_DATE_FORMAT: "yyyy-MM-dd HH:mm:ss.SSS"
LOG_MESSAGEFORMAT: "false"
LOG_ORDER_CLASS: "30"
LOG_ORDER_CLUSTER: "65"
LOG_ORDER_DIRECTION: "40"
LOG_ORDER_ENDPOINT: "45"
LOG_ORDER_LEVEL: "10"
LOG_ORDER_LOGGERNAME: "55"
LOG_ORDER_MESSAGE: "20"
LOG_ORDER_METHOD: "35"
LOG_ORDER_OFFSET: "15"
LOG_ORDER_QUERYSTRING: "50"
LOG_ORDER_THREAD: "60"
LOG_ORDER_TIMESTAMP: "5"
LOG_ORDER_TRACEID: "25"
LOG_SHOW_SENSITIVE_DATA: "true"
NDBOLE_DIGITAL_ACCOUNT_OPENING_URL: "http://digital-account-opening.isys-ndbo-stress"
NDBOLE_INFORM_MANAGEMENT_URL: "http://owb-ms-prd-inform-management.isys-ndbo-stress"
NDBOLE_MS_BUSINESS_CARDS_URL: "http://ms-business-cards.isys-ndbo-stress"
NDBOLE_MS_PRD_AGREEMENTS_URL: "http://owb-ms-prd-agreements.isys-ndbo-stress"
NDBOLE_MS_PRD_REFERENCES_URL: "http://owb-ms-prd-references.isys-ndbo-stress"
NDBOLE_OWB_MS_PRD_QR_ACQUIRING_URL: "http://owb-ms-prd-qr-acquiring.isys-ndbo-stress"
NDBOLE_OWB_MS_PRD_TARIF_PLANS_URL: "http://owb-ms-prd-tariff-plans.isys-ndbo-stress"
OCRM_LE_IT_MSD_CFT_URL: "http://it-msd-cft-adapter.isys-ecp-stress"
OCRM_LE_IT_MSD_SPARK_URL: "http://it-msd-spark-adapter.isys-ecp-stress"
OCRM_LE_URL: "http://adapter-ocrm-le.exsys-ocrm-le-stress-links/api/v1/messages"
PC_FLOW_URL: "http://pc-flow.isys-flow-adapters-stress"
PC_URL: "http://adapter-pc.exsys-pc-stress-links/api/v1/messages"
SITEEXT_URL: "http://adapter-siteext.exsys-siteext-stress-links/api/v1/messages"
SPRING_PROFILES_ACTIVE: "stress"
+ URL_MOCK: "http://10.21.108.22:8093"
WEBKFO_INTEGRATION_URL: "http://integration.isys-cfo-stress"
WEBKFO_NKW_URL: "http://nkw.isys-cfo-stress"
Listing releases matching ^vault-secrets-ocrm-le-flow$
Listing releases matching ^pjob-ocrm-le-flow$
Listing releases matching ^exsvc-ocrm-le-flow$
Listing releases matching ^data-ocrm-le-flow$
Listing releases matching ^assets-config-ocrm-le-flow$
Listing releases matching ^platform-database-ocrm-le-flow$
Listing releases matching ^ocrm-le-flow-raw$
Listing releases matching ^ocrm-le-flow-grafana-dashboard$
Listing releases matching ^ocrm-le-flow-prometheus-rules$
Listing releases matching ^ocrm-le-flow-rumsk1$
Listing releases matching ^ocrm-le-flow-rumsk2$
Upgrading release=ocrm-le-flow, chart=rshb-charts/base
FAILED RELEASES:
NAME
ocrm-le-flow
in deploy/helmfile.yaml: failed processing release ocrm-le-flow: command "/usr/local/link/helm" exited with non-zero status:
PATH:
/usr/local/link/helm
ARGS:
0: helm (4 bytes)
1: --kube-context (14 bytes)
2: rcsdstbl (8 bytes)
3: upgrade (7 bytes)
4: --install (9 bytes)
5: --reset-values (14 bytes)
6: ocrm-le-flow (12 bytes)
7: rshb-charts/base (16 bytes)
8: --version (9 bytes)
9: 1.15.2 (6 bytes)
10: --wait (6 bytes)
11: --timeout (9 bytes)
12: 600s (4 bytes)
13: --atomic (8 bytes)
14: --kube-context (14 bytes)
15: rcsdstbl (8 bytes)
16: --namespace (11 bytes)
17: isys-flow-adapters-stress (25 bytes)
18: --values (8 bytes)
19: /tmp/helmfile3943925358/isys-flow-adapters-stress-ocrm-le-flow-values-56764594f4 (80 bytes)
20: --values (8 bytes)
21: /tmp/helmfile2465567654/isys-flow-adapters-stress-ocrm-le-flow-values-754d569c4d (80 bytes)
22: --set (5 bytes)
23: additionalWorkloadAnnotations.gitlabPipeline=https://gitlab.rshbdev.ru/rshbintech/integrations/cki/ip2-services/flow-adapters/ocrm-le-flow/-/pipelines/3332558 (158 bytes)
24: --set (5 bytes)
25: additionalWorkloadAnnotations.gitlabCommit=7a9cf71dbb25cd6b617d18784e73f330c62e549f (83 bytes)
26: --history-max (13 bytes)
27: 10 (2 bytes)
ERROR:
exit status 1
EXIT STATUS
1
STDERR:
Error: UPGRADE FAILED: release ocrm-le-flow failed, and has been rolled back due to atomic being set: timed out waiting for the condition
COMBINED OUTPUT:
Error: UPGRADE FAILED: release ocrm-le-flow failed, and has been rolled back due to atomic being set: timed out waiting for the condition
Uploading artifacts for failed job
00:01
Uploading artifacts...
deploy.env: found 1 matching artifact files and directories
Uploading artifacts as "dotenv" to coordinator... 201 Created id=23226392 responseStatus=201 Created token=64_BiYmw
Cleaning up project directory and file based variables
00:00
ERROR: Job failed: command terminated with exit code 1