DoS admin door

[calestyo]

Hey.

I was trying whether I can find out how many \s System@someDomain,System@someOtherDomain,… get hostname can be chained...

Doing:

python3 -c 'print(f"\\s {",".join(["System@pool_lcg-lrz-dc50_7"]*9900)} get hostname")' | ssh admin@localhost ...

Kills the admin interface and it dosn't recover from it (even though log messages indicate it would try):

2026-03-19T04:23:47.314837+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:47+01:00 (admin) [] Restarting due to fatal JVM error: java.lang.StackOverflowError
2026-03-19T04:23:47.330039+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:47+01:00 (c-core1-AAZNWBdrWaA) [lcg-lrz-dc50.grid.lrz.de/[2001:4ca0:0:201:a:0:2:32]:11111] Connection to core1 (lcg-lrz-dc50.grid.lrz.de/[2001:4ca0:0:201:a:0:2:32]:11111) interrupted. Reason: java.lang.InterruptedException
2026-03-19T04:23:47.330545+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:47+01:00 (c-core1-AAZNWBdrWaA) [lcg-lrz-dc50.grid.lrz.de/[2001:4ca0:0:201:a:0:2:32]:11111] Sleeping 17 seconds
2026-03-19T04:23:47.330720+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:47+01:00 (c-core2-AAZNWBdrPkg) [lcg-lrz-dc51.grid.lrz.de/[2001:4ca0:0:201:a:0:2:33]:11111] Connection to core2 (lcg-lrz-dc51.grid.lrz.de/[2001:4ca0:0:201:a:0:2:33]:11111) interrupted. Reason: java.lang.InterruptedException
2026-03-19T04:23:47.330891+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:47+01:00 (c-core2-AAZNWBdrPkg) [lcg-lrz-dc51.grid.lrz.de/[2001:4ca0:0:201:a:0:2:33]:11111] Sleeping 19 seconds
2026-03-19T04:23:47.331247+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:47+01:00 (c-core0-AAZNWBdraUA) [lcg-lrz-dcache0.grid.lrz.de/[2001:4ca0:0:201:a:0:0:0]:11111] Connection to core0 (lcg-lrz-dcache0.grid.lrz.de/[2001:4ca0:0:201:a:0:0:0]:11111) interrupted. Reason: java.lang.InterruptedException
2026-03-19T04:23:47.331534+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:47+01:00 (c-core0-AAZNWBdraUA) [lcg-lrz-dcache0.grid.lrz.de/[2001:4ca0:0:201:a:0:0:0]:11111] Sleeping 11 seconds
2026-03-19T04:23:52.332816+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:52+01:00 (System) [] Still waiting for c-core1-AAZNWBdrWaA to shut down.
2026-03-19T04:23:52.333160+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:52+01:00 (System) [] Still waiting for c-core0-AAZNWBdraUA to shut down.
2026-03-19T04:23:52.333321+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:52+01:00 (System) [] Still waiting for c-core2-AAZNWBdrPkg to shut down.
2026-03-19T04:23:57.335523+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:57+01:00 (System) [] Thread Group "c-core1-AAZNWBdrWaA-threads":
2026-03-19T04:23:57.335979+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: Thread: TunnelConnector-core1 [A--] (5) TIMED_WAITING
2026-03-19T04:23:57.336110+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.sleep0(Native Method)
2026-03-19T04:23:57.336216+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.sleep(Thread.java:509)
2026-03-19T04:23:57.336325+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.network.LocationManagerConnector.run(LocationManagerConnector.java:125)
2026-03-19T04:23:57.336454+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellNucleus.lambda$wrapLoggingContext$2(CellNucleus.java:725)
2026-03-19T04:23:57.336546+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.run(Thread.java:1583)
2026-03-19T04:23:57.336687+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:57+01:00 (System) [] Thread Group "c-core0-AAZNWBdraUA-threads":
2026-03-19T04:23:57.336820+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: Thread: TunnelConnector-core0 [A--] (5) TIMED_WAITING
2026-03-19T04:23:57.336927+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.sleep0(Native Method)
2026-03-19T04:23:57.337021+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.sleep(Thread.java:509)
2026-03-19T04:23:57.337153+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.network.LocationManagerConnector.run(LocationManagerConnector.java:125)
2026-03-19T04:23:57.337242+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellNucleus.lambda$wrapLoggingContext$2(CellNucleus.java:725)
2026-03-19T04:23:57.337336+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.run(Thread.java:1583)
2026-03-19T04:23:57.337426+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:57+01:00 (System) [] Thread Group "c-core2-AAZNWBdrPkg-threads":
2026-03-19T04:23:57.337541+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: Thread: TunnelConnector-core2 [A--] (5) TIMED_WAITING
2026-03-19T04:23:57.337633+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.sleep0(Native Method)
2026-03-19T04:23:57.337722+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.sleep(Thread.java:509)
2026-03-19T04:23:57.337811+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.network.LocationManagerConnector.run(LocationManagerConnector.java:125)
2026-03-19T04:23:57.337900+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellNucleus.lambda$wrapLoggingContext$2(CellNucleus.java:725)
2026-03-19T04:23:57.338010+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.run(Thread.java:1583)
2026-03-19T04:23:57.338100+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:57+01:00 (System) [] Thread Group "Killer-Thread-Group":
2026-03-19T04:23:57.338225+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: Thread: killer-0 [A--] (5) WAITING
2026-03-19T04:23:57.338331+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/jdk.internal.misc.Unsafe.park(Native Method)
2026-03-19T04:23:57.338427+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.locks.LockSupport.park(LockSupport.java:371)
2026-03-19T04:23:57.338520+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:519)
2026-03-19T04:23:57.338610+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3780)
2026-03-19T04:23:57.338701+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3725)
2026-03-19T04:23:57.338817+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1746)
2026-03-19T04:23:57.338946+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
2026-03-19T04:23:57.339044+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1070)
2026-03-19T04:23:57.339134+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
2026-03-19T04:23:57.339224+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
2026-03-19T04:23:57.339333+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.run(Thread.java:1583)
2026-03-19T04:23:57.339479+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: Thread: killer-1 [A--] (5) RUNNABLE
2026-03-19T04:23:57.339576+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.getStackTrace(Thread.java:2451)
2026-03-19T04:23:57.339682+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellGlue.listThreadGroup(CellGlue.java:300)
2026-03-19T04:23:57.339774+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellGlue.listKillerThreadGroup(CellGlue.java:288)
2026-03-19T04:23:57.339864+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellNucleus.listKillerThreadGroup(CellNucleus.java:632)
2026-03-19T04:23:57.339971+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.SystemCell.shutdownCells(SystemCell.java:282)
2026-03-19T04:23:57.340063+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.SystemCell.shutdownSystem(SystemCell.java:220)
2026-03-19T04:23:57.340152+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.SystemCell.stopped(SystemCell.java:112)
2026-03-19T04:23:57.340240+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellAdapter.postRemoval(CellAdapter.java:730)
2026-03-19T04:23:57.340359+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellNucleus.shutdown(CellNucleus.java:1061)
2026-03-19T04:23:57.340465+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellGlue.lambda$doKill$3(CellGlue.java:423)
2026-03-19T04:23:57.340558+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
2026-03-19T04:23:57.340648+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
2026-03-19T04:23:57.340739+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
2026-03-19T04:23:57.340827+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.run(Thread.java:1583)
2026-03-19T04:23:57.340915+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: Thread: killer-2 [A--] (5) WAITING
2026-03-19T04:23:57.341033+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Object.wait0(Native Method)
2026-03-19T04:23:57.341196+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Object.wait(Object.java:366)
2026-03-19T04:23:57.341294+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.join(Thread.java:2079)
2026-03-19T04:23:57.341382+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.join(Thread.java:2155)
2026-03-19T04:23:57.341473+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     com.google.common.util.concurrent.Uninterruptibles.joinUninterruptibly(Uninterruptibles.java:167)
2026-03-19T04:23:57.341564+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.network.LocationManagerConnector.stopped(LocationManagerConnector.java:155)
2026-03-19T04:23:57.341655+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellAdapter.postRemoval(CellAdapter.java:730)
2026-03-19T04:23:57.341743+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellNucleus.shutdown(CellNucleus.java:1061)
2026-03-19T04:23:57.341824+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellGlue.lambda$doKill$3(CellGlue.java:423)
2026-03-19T04:23:57.341914+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
2026-03-19T04:23:57.342003+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
2026-03-19T04:23:57.342092+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
2026-03-19T04:23:57.342182+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.run(Thread.java:1583)
2026-03-19T04:23:57.342295+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: Thread: killer-4 [A--] (5) WAITING
2026-03-19T04:23:57.342433+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Object.wait0(Native Method)
2026-03-19T04:23:57.342512+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Object.wait(Object.java:366)
2026-03-19T04:23:57.342569+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.join(Thread.java:2079)
2026-03-19T04:23:57.342616+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.join(Thread.java:2155)
2026-03-19T04:23:57.342661+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     com.google.common.util.concurrent.Uninterruptibles.joinUninterruptibly(Uninterruptibles.java:167)
2026-03-19T04:23:57.342703+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.network.LocationManagerConnector.stopped(LocationManagerConnector.java:155)
2026-03-19T04:23:57.342748+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellAdapter.postRemoval(CellAdapter.java:730)
2026-03-19T04:23:57.342790+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellNucleus.shutdown(CellNucleus.java:1061)
2026-03-19T04:23:57.342845+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellGlue.lambda$doKill$3(CellGlue.java:423)
2026-03-19T04:23:57.342887+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
2026-03-19T04:23:57.342935+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
2026-03-19T04:23:57.342976+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
2026-03-19T04:23:57.343023+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.run(Thread.java:1583)
2026-03-19T04:23:57.343065+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: Thread: killer-5 [A--] (5) WAITING
2026-03-19T04:23:57.343113+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Object.wait0(Native Method)
2026-03-19T04:23:57.343154+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Object.wait(Object.java:366)
2026-03-19T04:23:57.343195+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.join(Thread.java:2079)
2026-03-19T04:23:57.343248+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.join(Thread.java:2155)
2026-03-19T04:23:57.343290+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     com.google.common.util.concurrent.Uninterruptibles.joinUninterruptibly(Uninterruptibles.java:167)
2026-03-19T04:23:57.343339+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.network.LocationManagerConnector.stopped(LocationManagerConnector.java:155)
2026-03-19T04:23:57.343380+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellAdapter.postRemoval(CellAdapter.java:730)
2026-03-19T04:23:57.343426+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellNucleus.shutdown(CellNucleus.java:1061)
2026-03-19T04:23:57.343467+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     dmg.cells.nucleus.CellGlue.lambda$doKill$3(CellGlue.java:423)
2026-03-19T04:23:57.343521+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
2026-03-19T04:23:57.343565+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
2026-03-19T04:23:57.343624+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
2026-03-19T04:23:57.343667+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]:     java.base/java.lang.Thread.run(Thread.java:1583)
2026-03-19T04:23:57.356425+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: 2026-03-19 04:23:57+01:00 (System) [] Unexpected exception during shutdown.
2026-03-19T04:23:57.356852+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: java.util.NoSuchElementException: No such cell: c-core2-AAZNWBdrPkg-AAZNWBdr1qE
2026-03-19T04:23:57.357025+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at dmg.cells.nucleus.CellGlue.kill(CellGlue.java:249)
2026-03-19T04:23:57.357195+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at dmg.cells.nucleus.CellNucleus.kill(CellNucleus.java:617)
2026-03-19T04:23:57.357292+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.stream.Collectors.lambda$uniqKeysMapAccumulator$1(Collectors.java:180)
2026-03-19T04:23:57.357378+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
2026-03-19T04:23:57.357465+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)
2026-03-19T04:23:57.357550+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
2026-03-19T04:23:57.357635+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
2026-03-19T04:23:57.357733+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)
2026-03-19T04:23:57.357820+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
2026-03-19T04:23:57.357905+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)
2026-03-19T04:23:57.357988+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at dmg.cells.nucleus.SystemCell.shutdownCells(SystemCell.java:251)
2026-03-19T04:23:57.358071+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at dmg.cells.nucleus.SystemCell.shutdownSystem(SystemCell.java:223)
2026-03-19T04:23:57.358155+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at dmg.cells.nucleus.SystemCell.stopped(SystemCell.java:112)
2026-03-19T04:23:57.358238+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at dmg.cells.nucleus.CellAdapter.postRemoval(CellAdapter.java:730)
2026-03-19T04:23:57.358322+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at dmg.cells.nucleus.CellNucleus.shutdown(CellNucleus.java:1061)
2026-03-19T04:23:57.358425+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at dmg.cells.nucleus.CellGlue.lambda$doKill$3(CellGlue.java:423)
2026-03-19T04:23:57.358512+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
2026-03-19T04:23:57.358598+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
2026-03-19T04:23:57.358697+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
2026-03-19T04:23:57.358797+01:00 lcg-lrz-dcache0 dcache@admin0[4108862]: #011at java.base/java.lang.Thread.run(Thread.java:1583)

Interestingly, the number of repetitions which it still can take seems to vary... i.e. once I managed to go up to 10.000 and dCache produced a proper result... sometimes it already fails with 5.000.
In particular it seems that I can "build it up"... like when I have a freshly started admin iface, and do 1000, then 2000 then 3000 ... and so on I can go much higher, as if I would start right away with a high number.

Cheers,
Chris.

[DmitryLitvintsev]

Oh Boy, looks like my advise to use consume / produce got us more work....
Practical question - you whould be fine for the purpose of querying cells w/ 100 processes / threads, right.
IOW this not a show stopper for you.

How much memory domain running admin cell JVM has in your installation?

[calestyo]

No this is absolutely no show stopper for me... in fact, from my side you can simply close the issue if you say this is to obscure.
It was merely meant as a friendly heads up that there is some extreme case where one can bring the service to crash. :-)

Our admin has:

dcache.java.memory.heap=1024M

direct mem is at default.