https://pastein.ru/t/3zh
Загрузка данных
Running with gitlab-runner 15.8.0 (12335144)
on gitlab-runner-gitlab-runner-5c5d8dfd84-fc2jj x3T1Qxkg, system ID: r_0t1aE5p8nfLN
Preparing the "kubernetes" executor
00:00
Using Kubernetes namespace: gitlab-runners
Using Kubernetes executor with image registry.rshbdev.ru/appfarm/infra/images/kube-client-apps:8.21.3 ...
Using attach strategy to execute scripts...
Preparing environment
00:08
Waiting for pod gitlab-runners/runner-x3t1qxkg-project-2826-concurrent-09sh6h to be running, status is Pending
Waiting for pod gitlab-runners/runner-x3t1qxkg-project-2826-concurrent-09sh6h to be running, status is Pending
ContainersNotReady: "containers with unready status: [build helper]"
ContainersNotReady: "containers with unready status: [build helper]"
Running on runner-x3t1qxkg-project-2826-concurrent-09sh6h via gitlab-runner-gitlab-runner-5c5d8dfd84-fc2jj...
Getting source from Git repository
00:03
$ git config --global --add url."https://gitlab-ci-token:${CI_JOB_TOKEN}@${CI_SERVER_HOST}/".insteadOf "https://${CI_SERVER_HOST}" # collapsed multi-line command
Fetching changes with git depth set to 50...
Initialized empty Git repository in /builds/rshbintech/it-corp/own-dev/csp/csp-customers-domain/.git/
Created fresh repository.
Checking out 4f785875 as 12.15.0...
Skipping Git submodules setup
Downloading artifacts
00:03
Downloading artifacts for init_dojo (21815107)...
Downloading artifacts from coordinator... ok id=21815107 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for devsecops_antivirus_scan (21815108)...
Downloading artifacts from coordinator... ok id=21815108 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for secrets_gitleaks (21815109)...
Downloading artifacts from coordinator... ok id=21815109 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for sast_semgrep (21815110)...
Downloading artifacts from coordinator... ok id=21815110 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for sast_ptai (21815111)...
Downloading artifacts from coordinator... ok id=21815111 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for dockerfilegen (21815112)...
Downloading artifacts from coordinator... ok id=21815112 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for sca_scan (21815114)...
Downloading artifacts from coordinator... ok id=21815114 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for build (21815116)...
Downloading artifacts from coordinator... ok id=21815116 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for unit (21815118)...
Downloading artifacts from coordinator... ok id=21815118 responseStatus=200 OK token=64_Qqtdx
Downloading artifacts for bca_trivy (21815121)...
Downloading artifacts from coordinator... ok id=21815121 responseStatus=200 OK token=64_Qqtdx
Executing "step_script" stage of the job script
00:47
$ ( umask 0077; mkdir -p ~/.kube && echo "$KUBECONFIG_COMBINED" | base64 -d > ~/.kube/config )
$ if [[ ${IS_SENSITIVE_SYSTEM} = true ]]; then export K8S_CLUSTERS=$K8S_CLUSTERS_SENSITIVE; fi
$ echo 'IS_SENSITIVE_SYSTEM:' $IS_SENSITIVE_SYSTEM
IS_SENSITIVE_SYSTEM: true
$ echo 'TARGET_CLUSTERS:' $K8S_CLUSTERS
TARGET_CLUSTERS: rcsdstbl
$ set -x
++ echo '$ for CLUSTER in $K8S_CLUSTERS; do'
$ for CLUSTER in $K8S_CLUSTERS; do
++ for CLUSTER in $K8S_CLUSTERS
++ echo '$ export CLUSTER=$CLUSTER'
$ export CLUSTER=$CLUSTER
++ export CLUSTER=rcsdstbl
++ CLUSTER=rcsdstbl
++ echo '$ if [[ ${CI_ENVIRONMENT_SLUG} = production ]]; then export NAMESPACE=isys-${ISYS_NAME}; else export NAMESPACE=isys-${ISYS_NAME}-${CI_ENVIRONMENT_SLUG}; fi'
$ if [[ ${CI_ENVIRONMENT_SLUG} = production ]]; then export NAMESPACE=isys-${ISYS_NAME}; else export NAMESPACE=isys-${ISYS_NAME}-${CI_ENVIRONMENT_SLUG}; fi
++ [[ production = production ]]
++ export NAMESPACE=isys-csp
++ NAMESPACE=isys-csp
++ echo '$ read -r REVISION STATUS < <(helm --kube-context ${CLUSTER:-default} -n $NAMESPACE history $CI_PROJECT_NAME | tail -1 | cut -f1,3) || true'
$ read -r REVISION STATUS < <(helm --kube-context ${CLUSTER:-default} -n $NAMESPACE history $CI_PROJECT_NAME | tail -1 | cut -f1,3) || true
++ read -r REVISION STATUS
+++ helm --kube-context rcsdstbl -n isys-csp history csp-customers-domain
+++ tail -1
+++ cut -f1,3
++ echo '$ if [[ "$STATUS" =~ "pending" ]]; then helm --kube-context ${CLUSTER:-default} -n $NAMESPACE rollback $CI_PROJECT_NAME $REVISION || true; fi'
$ if [[ "$STATUS" =~ "pending" ]]; then helm --kube-context ${CLUSTER:-default} -n $NAMESPACE rollback $CI_PROJECT_NAME $REVISION || true; fi
++ [[ deployed =~ pending ]]
++ echo '$ helmfile ${HELMFILE_DEFAULT_NAMESPACE:+--namespace $HELMFILE_DEFAULT_NAMESPACE} --environment ${CLUSTER:-default} -f deploy/helmfile.yaml --log-level info apply --suppress-secrets'
$ helmfile ${HELMFILE_DEFAULT_NAMESPACE:+--namespace $HELMFILE_DEFAULT_NAMESPACE} --environment ${CLUSTER:-default} -f deploy/helmfile.yaml --log-level info apply --suppress-secrets
++ helmfile --environment rcsdstbl -f deploy/helmfile.yaml --log-level info apply --suppress-secrets
== /usr/local/link/helmfile: Initialize base deploy hierarchy in /builds/rshbintech/it-corp/own-dev/csp/csp-customers-domain
no matches for path: envs/production/rcsdstbl/helmfile.yaml.gotmpl
Adding repo rshb-charts https://nexus.rshbdev.ru/repository/charts/
"rshb-charts" has been added to your repositories
Comparing release=vault-secrets-csp-customers-domain, chart=rshb-charts/raw
Comparing release=psvc-csp-customers-domain, chart=rshb-charts/raw
Comparing release=platform-database-csp-customers-domain, chart=rshb-charts/raw
Comparing release=links-csp-customers-domain, chart=rshb-charts/raw
Comparing release=csp-customers-domain-rumsk1, chart=rshb-charts/base
isys-csp, csp-customers-domain-rumsk1, Deployment (apps) has changed:
# Source: base/templates/workload.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: csp-customers-domain-rumsk1
labels:
app: csp-customers-domain
fullname: csp-customers-domain-rumsk1
chart: base-1.14.2
release: csp-customers-domain-rumsk1
heritage: Helm
isys: "csp"
psvc: "csp-customers-domain"
- version: "12.14.11"
+ version: "12.15.0"
workload.topology.app.farm/zone: "rumsk1"
annotations:
- platform.ckpr.integrations.rshbintech.ru/gitlab-commit-sha: 087bbc79
- platform.ckpr.integrations.rshbintech.ru/gitlab-pipeline-id: "3089578"
+ platform.ckpr.integrations.rshbintech.ru/gitlab-commit-sha: 4f785875
+ platform.ckpr.integrations.rshbintech.ru/gitlab-pipeline-id: "3130016"
spec:
strategy:
type: RollingUpdate
replicas: 2
selector:
matchLabels:
app: csp-customers-domain
fullname: csp-customers-domain-rumsk1
release: csp-customers-domain-rumsk1
template:
metadata:
labels:
app: csp-customers-domain
fullname: csp-customers-domain-rumsk1
chart: base-1.14.2
release: csp-customers-domain-rumsk1
heritage: Helm
isys: "csp"
psvc: "csp-customers-domain"
- version: "12.14.11"
+ version: "12.15.0"
workload.topology.app.farm/zone: "rumsk1"
annotations:
- checksum/configMapsEnv: "cea1fe065e70d488e710f18d1085350c17796a6ba66644370dfc744ac5314e40"
- checksum/secretEnv: "bed22e1ed2a3f96e953383e0a189cbb71f9ff168ef86f5aceb12d9ac11a119b3"
+ checksum/configMapsEnv: "8a1f73cba06f268e3c59adfc9c9befe099ca7632d371be8f47c10d5acd639b25"
+ checksum/secretEnv: "53a7db0c652ab34dcc5f188f6e680ef1ac0beed96b86d607de47f9e931b8c388"
inject.istio.io/templates: "sidecar,custom"
prometheus.io/path: "/metrics"
prometheus.io/port: "9010"
prometheus.io/scrape: "true"
sidecar.istio.io/userVolume: "[{\"name\": \"wasmfilters-dir\",\"configMap\": {\"name\": \"csp-envoy-filters\"}}]"
sidecar.istio.io/userVolumeMount: "[{\"mountPath\":\"/var/local/lib/wasm-filters\",\"name\":\"wasmfilters-dir\"}]"
spec:
serviceAccountName: default
nodeSelector:
workload.topology.app.farm/zone: rumsk1
priorityClassName:
rumsk1
containers:
- name: app
- image: registry.rshbdev.ru/rshbintech/it-corp/own-dev/csp/csp-customers-domain:12.14.11
+ image: registry.rshbdev.ru/rshbintech/it-corp/own-dev/csp/csp-customers-domain:12.15.0
imagePullPolicy: IfNotPresent
envFrom:
- configMapRef:
name: csp-customers-domain-rumsk1-app-cm-env
- secretRef:
name: csp-customers-domain-rumsk1-app-secret-env
resources:
limits:
cpu: 800m
memory: 1024Mi
requests:
cpu: 100m
memory: 256Mi
ports:
startupProbe:
failureThreshold: 60
httpGet:
path: /health/liveness
port: 9010
periodSeconds: 5
successThreshold: 1
timeoutSeconds: 1
livenessProbe:
failureThreshold: 30
httpGet:
path: /health/liveness
port: 9010
initialDelaySeconds: 0
periodSeconds: 5
successThreshold: 1
timeoutSeconds: 15
readinessProbe:
failureThreshold: 1
httpGet:
path: /health/readiness
port: 9010
initialDelaySeconds: 15
periodSeconds: 5
successThreshold: 3
timeoutSeconds: 2
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
procMount: Default
readOnlyRootFilesystem: false
runAsGroup: 1001
runAsNonRoot: true
runAsUser: 1001
securityContext:
fsGroup: 1001
fsGroupChangePolicy: OnRootMismatch
runAsGroup: 1001
runAsNonRoot: true
runAsUser: 1001
tolerations:
- effect: NoSchedule
key: workload.topology.app.farm/zone
operator: Exists
hostNetwork: false
volumes:
isys-csp, csp-customers-domain-rumsk1, Service (v1) has changed:
# Source: base/templates/svc.yaml
apiVersion: v1
kind: Service
metadata:
name: csp-customers-domain-rumsk1
labels:
app: csp-customers-domain
fullname: csp-customers-domain-rumsk1
chart: base-1.14.2
release: csp-customers-domain-rumsk1
heritage: Helm
isys: "csp"
psvc: "csp-customers-domain"
- version: "12.14.11"
+ version: "12.15.0"
spec:
ports:
- name: management
port: 9010
protocol: TCP
targetPort: 9010
- name: web
port: 80
protocol: TCP
targetPort: 8080
selector:
app: csp-customers-domain
fullname: csp-customers-domain-rumsk1
release: csp-customers-domain-rumsk1
type: ClusterIP
isys-csp, csp-customers-domain-rumsk1-app-cm-env, ConfigMap (v1) has changed:
# Source: base/templates/cm-env.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: csp-customers-domain-rumsk1-app-cm-env
labels:
app: csp-customers-domain
fullname: csp-customers-domain-rumsk1
chart: base-1.14.2
release: csp-customers-domain-rumsk1
heritage: Helm
isys: "csp"
psvc: "csp-customers-domain"
- version: "12.14.11"
+ version: "12.15.0"
workload.topology.app.farm/zone: "rumsk1"
data:
APP_POSTGRESQL_HOST: "cspfprodpg.go.rshbank.ru"
APP_POSTGRESQL_NAME: "pp_csp_db"
APP_POSTGRESQL_PORT: "5432"
BIQ_15326_CSP_CREATE_DICTIONARY_VALUES_CFT: "true"
BIQ_15326_RETRIES: "3"
BIQ_15326_RETRY_DELAY: "15"
CDI_CREATE_X_REF_URL: "http://csp-flow.isys-flow-adapters/api/CdiCreateXrefRequest"
CDI_EXPIRE_X_REF: "http://csp-flow.isys-flow-adapters/api/CdiExpireXrefRequest"
CDI_FIND_PERSON_URL: "http://csp-flow.isys-flow-adapters/api/CdiFindPersonRequest"
CDI_GET_PERSON_URL: "http://csp-flow.isys-flow-adapters/api/CdiGetPersonRequest"
CONFIG_SERVER_LOCATION: "http://csp-configuration-domain/api"
CSP_ASOA_SYNC_URI: "http://csp-flow.isys-flow-adapters/api/SynchronizeCustomerViewUrlAsoaRequest"
CSP_ASOA_URL_SETCATEGORY: "http://csp-flow.isys-flow-adapters/api/SetClientVIPCategoryRequest"
CSP_ASOA_URL_SETCATEGORY_RESPONSE: "http://csp-flow.isys-flow-adapters/api/SetClientVIPCategoryCSPResponse"
CSP_AUDIT_DOMAIN_URL: "http://csp-audit-domain"
CSP_AUDIT_ENABLED: "true"
+ CSP_AUTHENTICATION_CACHE_1L_INITIAL_CAPACITY: "100"
+ CSP_AUTHENTICATION_CACHE_1L_MAX_SIZE: "10000"
+ CSP_AUTHENTICATION_CACHE_1L_TTL: "5m"
+ CSP_AUTHENTICATION_CACHE_2L_ENABLED: "false"
CSP_CUSTOMERS_SERVICE_PORT: "8080"
CSP_DATAMODEL_SERVICE_URL: "http://csp-datamodel-service"
CSP_FEATURE_CLEAN_XML_NS: "false"
CSP_FEATURE_HAS_ENVELOPING_SIGNATURE: "true"
CSP_NAVIGATOR_URI_FORMAT: "https://csp-front-navigator.csp.rshbdev.ru/objects/%s"
CSP_OBJECTS_DOMAIN_URL: "http://csp-objects-domain"
CSP_RELATIONS_SERVICE_URL: "http://csp-relations-service"
CSP_USERS_DOMAIN_URL: "http://csp-users-domain"
+ CSP_VALKEY_HEALTH_CHECK_CONNECTION_CACHE_TTL: "10m"
+ CSP_VALKEY_HEALTH_CHECK_CONNECTION_TIMEOUT: "2s"
+ CSP_VALKEY_NODES: "cspfprodvalkey1.go.rshbank.ru:6380,cspfprodvalkey2.go.rshbank.ru:6380,cspfprodvalkey3.go.rshbank.ru:6380,cspfprodvalkey4.go.rshbank.ru:6380,cspfprodvalkey5.go.rshbank.ru:6380,cspfprodvalkey6.go.rshbank.ru:6380"
DH_FILES_SERVICE_URL: "http://csp-dh-files"
DUMMY_VARIABLE: "cspfprodpg2.go.rshbank.ru"
EVENTS_SEND_STRATEGY: "kafka"
EVENTS_TIMEOUT_SEC: "60"
EVENT_TOPIC_NAME: "csp-customer-domain-events"
EVENT_TOPIC_PARTITIONS: "3"
EVENT_TOPIC_REPLICATION_FACTOR: "3"
FEATURE_BIQ_18191: "true"
JAVA_OPTS: "-XX:+PrintFlagsFinal -XX:MaxRAMPercentage=75.0 -XX:MinRAMPercentage=75.0 -XX:+UseTransparentHugePages"
+ KEYCLOAK_ISSUER_URL: "https://auth.rshbdev.ru/auth/realms/platform"
LOG_LEVEL: "ERROR"
MANAGEMENT_PORT: "9010"
MAX_RETRY_ATTEMPTS: "6"
NETTY_METRICS_ENABLE: "true"
OBJECT_DOMAIN_RETRY_ATTEMPTS: "5"
OBJECT_DOMAIN_RETRY_BACKOFF: "100"
RETRY_NUM_PARTITIONS: "3"
RETRY_REPLICATION_FACTOR: "3"
SPRING_KAFKA_BOOTSTRAP_SERVERS: "cspfprodkafka1.go.rshbank.ru:9092,cspfprodkafka2.go.rshbank.ru:9092,cspfprodkafka3.go.rshbank.ru:9092,cspfprodkafka4.go.rshbank.ru:9092,cspfprodkafka5.go.rshbank.ru:9092,cspfprodkafka6.go.rshbank.ru:9092,cspfprodkafka7.go.rshbank.ru:9092,cspfprodkafka8.go.rshbank.ru:9092"
SPRING_PROFILES_ACTIVE: "kuber"
+ USER_INFO_URL: "http://csp-users-domain/api/v3/users/userinfo"
isys-csp, csp-customers-domain-rumsk1-app-secret-env, Secret (v1) has changed:
+ Changes suppressed on sensitive content of type Secret
Comparing release=csp-customers-domain-rumsk2, chart=rshb-charts/base
Comparing release=csp-customers-domain, chart=rshb-charts/raw
Listing releases matching ^pjob-csp-customers-domain$
Listing releases matching ^exsvc-csp-customers-domain$
Listing releases matching ^data-csp-customers-domain$
Listing releases matching ^assets-config-csp-customers-domain$
Listing releases matching ^csp-customers-domain-raw$
Listing releases matching ^csp-customers-domain-grafana-dashboard$
Upgrading release=csp-customers-domain-rumsk1, chart=rshb-charts/base
FAILED RELEASES:
NAME
csp-customers-domain-rumsk1
in deploy/helmfile.yaml: failed processing release csp-customers-domain-rumsk1: command "/usr/local/link/helm" exited with non-zero status:
PATH:
/usr/local/link/helm
ARGS:
0: helm (4 bytes)
1: --kube-context (14 bytes)
2: rcsdstbl (8 bytes)
3: upgrade (7 bytes)
4: --install (9 bytes)
5: --reset-values (14 bytes)
6: csp-customers-domain-rumsk1 (27 bytes)
7: rshb-charts/base (16 bytes)
8: --version (9 bytes)
9: 1.14.2 (6 bytes)
10: --wait (6 bytes)
11: --timeout (9 bytes)
12: 600s (4 bytes)
13: --atomic (8 bytes)
14: --kube-context (14 bytes)
15: rcsdstbl (8 bytes)
16: --namespace (11 bytes)
17: isys-csp (8 bytes)
18: --values (8 bytes)
19: /tmp/helmfile3713576432/isys-csp-csp-customers-domain-rumsk1-values-54cd96856b (78 bytes)
20: --values (8 bytes)
21: /tmp/helmfile1595611046/isys-csp-csp-customers-domain-rumsk1-values-56645cdc8 (77 bytes)
22: --values (8 bytes)
23: /tmp/helmfile530673702/isys-csp-csp-customers-domain-rumsk1-values-798497c64d (77 bytes)
24: --history-max (13 bytes)
25: 10 (2 bytes)
ERROR:
exit status 1
EXIT STATUS
1
STDERR:
Error: UPGRADE FAILED: another operation (install/upgrade/rollback) is in progress
COMBINED OUTPUT:
Error: UPGRADE FAILED: another operation (install/upgrade/rollback) is in progress
Uploading artifacts for failed job
00:01
Uploading artifacts...
deploy.env: found 1 matching artifact files and directories
Uploading artifacts as "dotenv" to coordinator... 201 Created id=21843891 responseStatus=201 Created token=64_Qqtdx
Cleaning up project directory and file based variables
00:01
ERROR: Job failed: command terminated with exit code 1