https://pastein.ru/t/Hnp
Загрузка данных
PRISM v5.21.0 [9661e39] [sched=eevdf+pandemonium]
captured: 20260908-134300
SCHEDULER STABILITY
no ejection -- scheduler ran clean
CLEAN-ROOM
state CLEAN -- load 1.6/16cpu, uptime 0.0h
SYSTEM
cpu AMD Ryzen 9 5950X 16-Core Processor (16c/16t)
memory 31,2 GiB
gpu amdgpu (1002:747E)
kernel 7.2.3-1-cachyos
scheduler pandemonium
STALL SUSCEPTIBILITY
kernel 7.2.3-1-cachyos
tick HZ=1000 NO_HZ_FULL preempt=PREEMPT_DYNAMIC
cpus 16 governor=performance deepest-idle=C2 (3 states)
cmdline nohz_full=- isolcpus=-
verdict score 4 -> MODERATE
factors HZ=1000 (tight ticks -- narrows window); idle CPUs go tickless (NO_HZ_IDLE behavior; NO_HZ_FULL built but no nohz_full= mask, so unused); 16 CPUs (many idle at once)
COMPARISON (p99 wake2run, lower is better)
fork-thread EEVDF n/a -> BPF 8131us, ADAPTIVE 5451us
ipc EEVDF n/a -> BPF 33us, ADAPTIVE 107us
pcpu-burst EEVDF n/a -> PANDEMONIUM 26706us
sojourn-pressure EEVDF n/a -> PANDEMONIUM 1872us
cachyos EEVDF n/a -> BPF 464us, ADAPTIVE 427us
POPULATION (montauk cross-run statistics over 3 run(s), per workload)
cachyos-primes pandemonium-adaptive vs pandemonium-bpf: N=3 cliff -0.11 perm p=0.900 power n>20
cachyos-stress-ng-cpu-cache-mem pandemonium-adaptive vs pandemonium-bpf: N=3 cliff +0.78 perm p=0.200 power n=13
cachyos-xz-compression pandemonium-adaptive vs pandemonium-bpf: N=3 cliff -0.11 perm p=1.000 power n>20
fork-thread pandemonium-adaptive vs pandemonium-bpf: N=3 cliff +0.33 perm p=1.000 power n>20
ipc-16c pandemonium-adaptive vs pandemonium-bpf: N=1 cliff +1.00 perm p=1.000 power n>20
ipc-32c pandemonium-adaptive vs pandemonium-bpf: N=2 cliff +1.00 perm p=0.333 power n=3
cachyos-primes MCB best (lower p99): pandemonium-adaptive (tied), pandemonium-bpf (tied)
cachyos-stress-ng-cpu-cache-mem MCB best (lower p99): pandemonium-adaptive (tied), pandemonium-bpf (tied)
cachyos-xz-compression MCB best (lower p99): pandemonium-adaptive (tied), pandemonium-bpf (tied)
fork-thread MCB best (lower p99): pandemonium-adaptive (tied), pandemonium-bpf (tied)
ipc-16c MCB best (lower p99): pandemonium-bpf
ipc-32c MCB best (lower p99): pandemonium-bpf
N<3 per arm -- montauk reports the effect size but the inference is underpowered; repeat runs accumulate here
STORM (cpu_release flood, powersave -- lower storm% is better)
REAL IPI storm (preempt-kick dominant); storm 67/72 intervals (93.1%); reenq/s p50=120911 peak=124146; kick/s=239000 (preempt 111985) reenq/s=113004
WORKLOAD cachyos-PANDEMONIUM-ADAPTIVE-primes
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
hot-cpu 15 l2_miss_share 46.5782 HIGH
long-range-dependent migration-rate hurst 0.61149 MED
migration-avalanche migration-rate runs 17 MED
discord 1061ms profile_vs_mean 1.51255 MED
CAPTURE complete -- 23329 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 18.4k wake2run; p50 4us p99 370us p999 580us worst 752us; 92.3% fast(<100us) / 7.7% mid / 0.0% tick-floor(>=900us); 1.1% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~12343 distinct values; inversion ratio 0.41
WORKLOAD cachyos-PANDEMONIUM-ADAPTIVE-stress-ng-cpu-cache-mem
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
long-range-dependent migration-rate hurst 0.88856 MED
migration-avalanche migration-rate runs 220 MED
discord 8693ms profile_vs_mean 1.51082 MED
long-range-dependent dispatch-rate hurst 0.844292 MED
hot-cpu 2 l2_miss_share 6.81146 LOW
CAPTURE complete -- 188712 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 175k wake2run; p50 4us p99 532us p999 884us worst 3644us; 93.1% fast(<100us) / 6.8% mid / 0.1% tick-floor(>=900us); 1.9% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~147987 distinct values; inversion ratio 0.49
WORKLOAD cachyos-PANDEMONIUM-ADAPTIVE-xz-compression
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
hot-waker 2383 wakes_issued 35 MED
long-range-dependent dispatch-rate hurst 0.733267 MED
migration-avalanche migration-rate runs 134 MED
discord 32ms profile_vs_mean 1.87213 MED
long-range-dependent migration-rate hurst 0.668618 MED
ioctl-slow 2383/xz duration_ms 0.00064 LOW
hot-cpu 1 l2_miss_share 8.92054 LOW
ioctl-slow 2383/xz duration_ms 0.00043 LOW
CAPTURE complete -- 96478 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 34.3k wake2run; p50 4us p99 427us p999 738us worst 2698us; 92.1% fast(<100us) / 7.9% mid / 0.0% tick-floor(>=900us); 2.3% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~29467 distinct values; inversion ratio 0.38
WORKLOAD cachyos-PANDEMONIUM-BPF-primes
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
hot-cpu 15 l2_miss_share 42.808 HIGH
long-range-dependent migration-rate hurst 0.619677 MED
migration-avalanche migration-rate runs 19 MED
discord 412ms profile_vs_mean 1.64321 MED
CAPTURE complete -- 19992 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 15.0k wake2run; p50 4us p99 461us p999 818us worst 1000us; 91.8% fast(<100us) / 8.2% mid / 0.1% tick-floor(>=900us); 1.4% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~12212 distinct values; inversion ratio 0.48
WORKLOAD cachyos-PANDEMONIUM-BPF-stress-ng-cpu-cache-mem
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
long-range-dependent dispatch-rate hurst 0.902725 MED
migration-avalanche migration-rate runs 380 MED
discord 7652ms profile_vs_mean 1.7922 MED
long-range-dependent migration-rate hurst 0.895377 MED
hot-cpu 2 l2_miss_share 6.89675 LOW
CAPTURE complete -- 163567 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 150k wake2run; p50 4us p99 502us p999 997us worst 1676us; 92.3% fast(<100us) / 7.5% mid / 0.2% tick-floor(>=900us); 2.8% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~131191 distinct values; inversion ratio 0.42
WORKLOAD cachyos-PANDEMONIUM-BPF-xz-compression
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
long-range-dependent dispatch-rate hurst 0.773609 MED
migration-avalanche migration-rate runs 38 MED
discord 525ms profile_vs_mean 1.58306 MED
long-range-dependent migration-rate hurst 0.658853 MED
ioctl-slow 2140/xz duration_ms 0.00069 LOW
hot-cpu 3 l2_miss_share 7.67591 LOW
ioctl-slow 2140/xz duration_ms 0.0004 LOW
CAPTURE complete -- 90538 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 28.1k wake2run; p50 4us p99 464us p999 901us worst 1457us; 91.2% fast(<100us) / 8.7% mid / 0.1% tick-floor(>=900us); 1.9% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~22832 distinct values; inversion ratio 0.52
WORKLOAD cold-wake-16c-PANDEMONIUM
THERMAL/POWER
cpu temp peak 52.2 C avg 48.1 C
power avg 69.3 W peak 108.0 W
idle C2 avg 95.5% (dominant)
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
hot-cpu 15 l2_miss_share 43.698 HIGH
kthread-strand comm#cfa26dc0 max_strand_ms 10.4278 MED
CAPTURE complete -- 860 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 42 wake2run; p50 4us p99 111us p999 111us worst 111us; 97.6% fast(<100us) / 2.4% mid / 0.0% tick-floor(>=900us); 0.0% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~37 distinct values; inversion ratio 0.55
REPORT kstrand
VERDICT: 2 strands across 1 per-CPU kthreads; worst HELD strand 10.4ms (I/O-completion freeze signature)
kthread cpu strands max_ms p99_ms held dark held_by
comm#cfa26dc0 15 2 10.4 10.4 2 0 tid=0 0%
COLD-WAKE: cold-cache worst 3.9x at 32KB (0.03ms cold); CPU freq ramp worst +47%
WORKLOAD cold-wake-starve-16c-PANDEMONIUM
THERMAL/POWER
cpu temp peak 57.8 C avg 51.0 C
power avg 85.8 W peak 106.5 W
idle C2 avg 93.7% (dominant)
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
discord 16638ms profile_vs_mean 3.25151 HIGH
hot-cpu 15 l2_miss_share 54.1984 HIGH
mid-trace-death comm#e3e5febe/22826 before_end_s 35.0245 MED
long-range-dependent dispatch-rate hurst 0.920284 MED
mid-trace-death comm#e3e5febe/22855 before_end_s 28.0034 MED
mid-trace-death comm#e3e5febe/22942 before_end_s 7.00039 MED
CAPTURE complete -- 215392 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 97.6k wake2run; p50 2us p99 6us p999 15us worst 740us; 100.0% fast(<100us) / 0.0% mid / 0.0% tick-floor(>=900us); 0.0% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~74733 distinct values; inversion ratio 0.62
LOCATED: 5 structured region(s) NEARLY_SORTED[3%..4%], FEW_UNIQUE[24%..25%], FEW_UNIQUE[27%..28%], FEW_UNIQUE[33%..34%], FEW_UNIQUE[34%..35%]
WORKLOAD fork-thread-PANDEMONIUM-ADAPTIVE
THERMAL/POWER
cpu temp peak 59.5 C avg 54.2 C
power avg 95.2 W peak 162.4 W
idle C2 avg 72.8% (dominant)
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
order-starved tid=6793 passover_picks 1153 HIGH
held-cpu tid=6545 held_ms 4.80483 HIGH
self-preempt tid=6305 stint_wake_ratio 13075 HIGH
self-preempt tid=1716 stint_wake_ratio 8680 HIGH
self-preempt tid=1638 stint_wake_ratio 8671 HIGH
self-preempt tid=1724 stint_wake_ratio 8664 HIGH
order-starved tid=6890 passover_picks 1081 HIGH
held-cpu tid=6356 held_ms 2.95392 HIGH
self-preempt tid=848 stint_wake_ratio 8645 HIGH
self-preempt tid=1725 stint_wake_ratio 8644 HIGH
self-preempt tid=1726 stint_wake_ratio 8618 HIGH
order-starved tid=6541 passover_picks 988 HIGH
held-cpu tid=6717 held_ms 2.13698 HIGH
self-preempt tid=997 stint_wake_ratio 8603 HIGH
long-range-dependent dispatch-rate hurst 0.865232 MED
migration-avalanche migration-rate runs 503 MED
discord 3836ms profile_vs_mean 1.57774 MED
long-range-dependent migration-rate hurst 0.793912 MED
hot-cpu 15 l2_miss_share 9.02272 LOW
CAPTURE complete -- 2136282 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 228k wake2run; p50 205us p99 5451us p999 28491us worst 41724us; 39.5% fast(<100us) / 37.3% mid / 23.2% tick-floor(>=900us); 2.1% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~228196 distinct values; inversion ratio 0.48
LOCATED: 9 structured region(s) NEARLY_SORTED[0%..0%], NEARLY_SORTED[25%..25%], NEARLY_SORTED[27%..27%], NEARLY_SORTED[28%..28%], NEARLY_SORTED[71%..72%] +4 more
REPORT dispatch-stall
VERDICT: 52.9k saturated wakes over the 900us floor; PREEMPT-STARVED 0% (0 intervening picks) / ORDER-STARVED 100% (CPU served others first); avg 51.5 pass-overs, p99 194 pass-overs
WORKLOAD fork-thread-PANDEMONIUM-BPF
THERMAL/POWER
cpu temp peak 58.8 C avg 53.8 C
power avg 94.0 W peak 161.4 W
idle C2 avg 77.7% (dominant)
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
order-starved tid=5504 passover_picks 1399 HIGH
held-cpu tid=5228 held_ms 5.41847 HIGH
self-preempt tid=1716 stint_wake_ratio 8894 HIGH
self-preempt tid=979 stint_wake_ratio 8854 HIGH
self-preempt tid=1723 stint_wake_ratio 8844 HIGH
self-preempt tid=847 stint_wake_ratio 8842 HIGH
order-starved tid=5295 passover_picks 1150 HIGH
held-cpu tid=5212 held_ms 4.85751 HIGH
self-preempt tid=1636 stint_wake_ratio 8830 HIGH
self-preempt tid=1638 stint_wake_ratio 8825 HIGH
self-preempt tid=1724 stint_wake_ratio 8814 HIGH
order-starved tid=5472 passover_picks 803 HIGH
held-cpu tid=5347 held_ms 3.81985 HIGH
self-preempt tid=1725 stint_wake_ratio 8809 HIGH
long-range-dependent dispatch-rate hurst 0.859724 MED
migration-avalanche migration-rate runs 1500 MED
discord 4691ms profile_vs_mean 1.59309 MED
long-range-dependent migration-rate hurst 0.780814 MED
hot-cpu 15 l2_miss_share 7.80202 LOW
CAPTURE complete -- 2113993 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 241k wake2run; p50 90us p99 8131us p999 24230us worst 41991us; 51.3% fast(<100us) / 28.2% mid / 20.5% tick-floor(>=900us); 5.2% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~241215 distinct values; inversion ratio 0.56
LOCATED: 6 structured region(s) NEARLY_SORTED[0%..0%], NEARLY_SORTED[10%..11%], NEARLY_SORTED[18%..18%], NEARLY_SORTED[39%..39%], NEARLY_SORTED[52%..52%] +1 more
REPORT dispatch-stall
VERDICT: 49.4k saturated wakes over the 900us floor; PREEMPT-STARVED 0% (0 intervening picks) / ORDER-STARVED 100% (CPU served others first); avg 53.3 pass-overs, p99 230 pass-overs
WORKLOAD ipc-PANDEMONIUM-ADAPTIVE-16c
THERMAL/POWER
cpu temp peak 55.6 C avg 51.5 C
power avg 115.0 W peak 140.4 W
idle C2 avg 36.2% (dominant)
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
order-starved comm#8a5f93b2 passover_picks 43 HIGH
held-cpu comm#c233d180 held_ms 4.28964 HIGH
hot-waker 19678 wakes_issued 79990 HIGH
self-preempt tid=19602 stint_wake_ratio 32955 HIGH
hot-cpu 0 l2_miss_share 21.2993 HIGH
self-preempt tid=19601 stint_wake_ratio 30442 HIGH
self-preempt tid=19611 stint_wake_ratio 29943 HIGH
self-preempt tid=19608 stint_wake_ratio 16881 HIGH
order-starved comm#8a5f93b2 passover_picks 42 HIGH
held-cpu comm#8a5f93b2 held_ms 1.00096 HIGH
self-preempt tid=19603 stint_wake_ratio 15077 HIGH
self-preempt tid=19621 stint_wake_ratio 11267 HIGH
self-preempt tid=19612 stint_wake_ratio 10312 HIGH
order-starved comm#8a5f93b2 passover_picks 9 HIGH
held-cpu comm#8a5f93b2 held_ms 1.00069 HIGH
self-preempt tid=19610 stint_wake_ratio 10185 HIGH
long-range-dependent dispatch-rate hurst 0.905048 MED
migration-avalanche migration-rate runs 65 MED
discord 2921ms profile_vs_mean 2.00403 MED
long-range-dependent migration-rate hurst 0.815157 MED
recvfrom-slow 19653/pand-ipc duration_ms 2.78933 LOW
recvfrom-slow 19651/pand-ipc duration_ms 2.78456 LOW
recvfrom-slow 19651/pand-ipc duration_ms 2.46742 LOW
recvfrom-slow 19653/pand-ipc duration_ms 2.00043 LOW
recvfrom-slow 19653/pand-ipc duration_ms 1.99777 LOW
ioctl-slow 19669/python3 duration_ms 0.00112 LOW
ioctl-slow 19669/python3 duration_ms 0.00055 LOW
ioctl-slow 19669/python3 duration_ms 0.00047 LOW
ioctl-slow 19669/python3 duration_ms 0.00046 LOW
ioctl-slow 19669/python3 duration_ms 0.00041 LOW
CAPTURE complete -- 1745895 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 224k wake2run; p50 3us p99 107us p999 798us worst 1994us; 99.0% fast(<100us) / 0.9% mid / 0.1% tick-floor(>=900us); 0.5% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~178439 distinct values; inversion ratio 0.46
LOCATED: 16 structured region(s) FEW_UNIQUE[0%..0%], FEW_UNIQUE[3%..3%], FEW_UNIQUE[4%..5%], FEW_UNIQUE[5%..6%], FEW_UNIQUE[6%..6%] +11 more
REPORT dispatch-stall
VERDICT: 151 saturated wakes over the 900us floor; PREEMPT-STARVED 5% (0 intervening picks) / ORDER-STARVED 95% (CPU served others first); avg 1.4 pass-overs, p99 3 pass-overs
WORKLOAD ipc-PANDEMONIUM-BPF-16c
THERMAL/POWER
cpu temp peak 56.8 C avg 51.2 C
power avg 110.7 W peak 141.5 W
idle C2 avg 43.4% (dominant)
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
order-starved comm#8a5f93b2 passover_picks 16 HIGH
held-cpu comm#c233d180 held_ms 6.63441 HIGH
hot-waker 19387 wakes_issued 79997 HIGH
self-preempt tid=19317 stint_wake_ratio 40798 HIGH
self-preempt tid=19315 stint_wake_ratio 38822 HIGH
self-preempt tid=19312 stint_wake_ratio 34667 HIGH
self-preempt tid=19311 stint_wake_ratio 32791 HIGH
order-starved comm#8a5f93b2 passover_picks 5 HIGH
held-cpu comm#c233d180 held_ms 3.16134 HIGH
self-preempt tid=19318 stint_wake_ratio 25632 HIGH
self-preempt tid=19316 stint_wake_ratio 22976 HIGH
self-preempt tid=19314 stint_wake_ratio 15731 HIGH
order-starved comm#8a5f93b2 passover_picks 5 HIGH
held-cpu comm#8a5f93b2 held_ms 1.98642 HIGH
self-preempt tid=19319 stint_wake_ratio 15131 HIGH
long-range-dependent dispatch-rate hurst 0.930015 MED
migration-avalanche migration-rate runs 23 MED
discord 8108ms profile_vs_mean 1.65063 MED
hot-cpu 5 l2_miss_share 15.1851 MED
long-range-dependent migration-rate hurst 0.620896 MED
recvfrom-slow 19362/pand-ipc duration_ms 1.99593 LOW
recvfrom-slow 19360/pand-ipc duration_ms 1.99497 LOW
recvfrom-slow 19360/pand-ipc duration_ms 1.98922 LOW
recvfrom-slow 19362/pand-ipc duration_ms 1.97805 LOW
recvfrom-slow 19360/pand-ipc duration_ms 1.79787 LOW
ioctl-slow 19378/python3 duration_ms 0.00115 LOW
ioctl-slow 19378/python3 duration_ms 0.00049 LOW
ioctl-slow 19378/python3 duration_ms 0.00045 LOW
ioctl-slow 19378/python3 duration_ms 0.00044 LOW
ioctl-slow 19378/python3 duration_ms 0.00041 LOW
CAPTURE complete -- 1896505 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 236k wake2run; p50 3us p99 33us p999 700us worst 2892us; 99.3% fast(<100us) / 0.6% mid / 0.0% tick-floor(>=900us); 0.1% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~184578 distinct values; inversion ratio 0.30
LOCATED: 2 structured region(s) FEW_UNIQUE[12%..12%], FEW_UNIQUE[37%..38%]
REPORT dispatch-stall
VERDICT: 50 saturated wakes over the 900us floor; PREEMPT-STARVED 16% (0 intervening picks) / ORDER-STARVED 84% (CPU served others first); avg 2.3 pass-overs, p99 6 pass-overs
WORKLOAD pcpu-burst-16c-PANDEMONIUM
THERMAL/POWER
cpu temp peak 60.0 C avg 57.1 C
power avg 131.7 W peak 159.5 W
idle C2 avg 30.7% (dominant)
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
order-starved comm#328ab0c6 passover_picks 8903 HIGH
held-cpu comm#8a5f93b2 held_ms 0.995652 HIGH
doublefree-logic 19924/0x000055f75731eb50 bytes 24 HIGH
self-preempt tid=979 stint_wake_ratio 15701 HIGH
doublefree-logic 19923/0x00005558cc894b50 bytes 24 HIGH
doublefree-logic 19922/0x000056127fb22b50 bytes 24 HIGH
self-preempt tid=847 stint_wake_ratio 14697 HIGH
doublefree-logic 19921/0x000055a3e544ab50 bytes 24 HIGH
doublefree-logic 19920/0x0000563e6f9afb50 bytes 24 HIGH
self-preempt tid=1638 stint_wake_ratio 14391 HIGH
doublefree-logic 19919/0x0000561c2d8b7b50 bytes 24 HIGH
doublefree-logic 19918/0x0000563750bc0b50 bytes 24 HIGH
self-preempt tid=1726 stint_wake_ratio 14366 HIGH
doublefree-logic 19917/0x0000561450468b50 bytes 24 HIGH
order-starved comm#328ab0c6 passover_picks 7103 HIGH
doublefree-logic 19916/0x000055ce2d3c7b50 bytes 24 HIGH
self-preempt tid=1725 stint_wake_ratio 14352 HIGH
doublefree-logic 19915/0x0000556f9a6f8b50 bytes 24 HIGH
doublefree-logic 19914/0x0000560f66df4b50 bytes 24 HIGH
self-preempt tid=1723 stint_wake_ratio 14340 HIGH
doublefree-logic 19912/0x0000564e18517b50 bytes 24 HIGH
doublefree-logic 19911/0x000055945cfd3b50 bytes 24 HIGH
self-preempt tid=1715 stint_wake_ratio 14339 HIGH
doublefree-logic 19909/0x000055803a9ffb50 bytes 24 HIGH
doublefree-logic 19906/0x000056440ed5bb50 bytes 24 HIGH
order-starved comm#328ab0c6 passover_picks 4045 HIGH
doublefree-logic 19905/0x000056501a95ab50 bytes 24 HIGH
self-preempt tid=1716 stint_wake_ratio 14335 HIGH
kthread-strand comm#0357dada max_strand_ms 5.99726 MED
long-range-dependent dispatch-rate hurst 0.936047 MED
discord 1764ms profile_vs_mean 2.08661 MED
kthread-strand comm#12f62b72 max_strand_ms 5.99602 MED
kthread-strand comm#288f3d20 max_strand_ms 5.99426 MED
kthread-strand comm#288f4239 max_strand_ms 5.98803 MED
kthread-strand comm#288f4086 max_strand_ms 5.98684 MED
kthread-strand comm#ff850676 max_strand_ms 5.18915 MED
kthread-strand comm#fa4c32b5 max_strand_ms 5.07643 MED
poll-slow 19899/pandemonium duration_ms 0.00152 LOW
hot-cpu 2 l2_miss_share 7.73961 LOW
poll-slow 19901/pandemonium duration_ms 0.00131 LOW
poll-slow 19893/pandemonium duration_ms 0.0013 LOW
poll-slow 19897/pandemonium duration_ms 0.00128 LOW
poll-slow 19895/pandemonium duration_ms 0.00123 LOW
CAPTURE complete -- 843672 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 59.8k wake2run; p50 943us p99 26706us p999 41345us worst 44999us; 37.5% fast(<100us) / 11.6% mid / 50.9% tick-floor(>=900us); 0.0% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~56973 distinct values; inversion ratio 0.34
LOCATED: 2 structured region(s) NEARLY_SORTED[80%..81%], NEARLY_SORTED[90%..91%]
REPORT dispatch-stall
VERDICT: 30.4k saturated wakes over the 900us floor; PREEMPT-STARVED 0% (0 intervening picks) / ORDER-STARVED 100% (CPU served others first); avg 14.3 pass-overs, p99 76 pass-overs
REPORT kstrand
VERDICT: 9 strands across 7 per-CPU kthreads; worst HELD strand 6.0ms (I/O-completion freeze signature)
kthread cpu strands max_ms p99_ms held dark held_by
comm#0357dada 1 2 6.0 6.0 2 0 comm#7e44bede 33%
comm#12f62b72 6 1 6.0 6.0 1 0 comm#8a5f93b2 50%
comm#288f3d20 3 1 6.0 6.0 1 0 comm#8a5f93b2 33%
comm#288f4239 0 2 6.0 6.0 2 0 comm#8a5f93b2 17%
comm#288f4086 1 1 6.0 6.0 1 0 comm#8a5f93b2 17%
comm#ff850676 2 1 5.2 5.2 1 0 comm#8a5f93b2 39%
comm#fa4c32b5 3 1 5.1 5.1 1 0 comm#8a5f93b2 39%
WORKLOAD sojourn-pressure-16c-PANDEMONIUM
THERMAL/POWER
cpu temp peak 59.0 C avg 54.3 C
power avg 115.4 W peak 156.3 W
idle C2 avg 50.0% (dominant)
POORLY-BEHAVING ITEMS (ranked)
kind id metric value sev
order-starved comm#8a5f93b2 passover_picks 13 HIGH
held-cpu comm#8a5f93b2 held_ms 5.07062 HIGH
self-preempt tid=847 stint_wake_ratio 11149 HIGH
self-preempt tid=979 stint_wake_ratio 11086 HIGH
self-preempt tid=1723 stint_wake_ratio 10431 HIGH
self-preempt tid=1637 stint_wake_ratio 9865 HIGH
order-starved comm#8a5f93b2 passover_picks 13 HIGH
held-cpu comm#8a5f93b2 held_ms 3.72857 HIGH
self-preempt tid=1636 stint_wake_ratio 9860 HIGH
self-preempt tid=848 stint_wake_ratio 9831 HIGH
self-preempt tid=1726 stint_wake_ratio 9829 HIGH
order-starved comm#8a5f93b2 passover_picks 11 HIGH
held-cpu comm#8a5f93b2 held_ms 2.95185 HIGH
self-preempt tid=1635 stint_wake_ratio 9825 HIGH
kthread-strand comm#180ccb20 max_strand_ms 5.064 MED
mean-reverting dispatch-rate hurst 0.4009 MED
discord 5930ms profile_vs_mean 1.53522 MED
hot-cpu 1 l2_miss_share 8.49663 LOW
CAPTURE complete -- 548226 events, none dropped
KEY METRICS
REPORT sched
VERDICT: 4.0k wake2run; p50 5us p99 1872us p999 3992us worst 8066us; 85.2% fast(<100us) / 9.3% mid / 5.5% tick-floor(>=900us); 0.0% cross-domain
STRUCTURE: latency-over-trace RANDOM; ~3654 distinct values; inversion ratio 0.60
REPORT dispatch-stall
VERDICT: 221 saturated wakes over the 900us floor; PREEMPT-STARVED 14% (0 intervening picks) / ORDER-STARVED 86% (CPU served others first); avg 1.7 pass-overs, p99 8 pass-overs
REPORT kstrand
VERDICT: 1 strands across 1 per-CPU kthreads; worst HELD strand 5.1ms (I/O-completion freeze signature)
kthread cpu strands max_ms p99_ms held dark held_by
comm#180ccb20 5 1 5.1 5.1 1 0 comm#8a5f93b2 40%
