We've been running a modded server in Linux successfully for days now. A new issue has appeared where upon attempting to start up, the server seems to get stuck at the very end and never finishes starting up. Nothing has changed mod/server/code wise since it last worked 48 hours ago. Hardware allocation seems fine. "Just waiting longer" is not a solution... we left it attempting to boot for >12 hours like this to no avail. Trying to join during this phase returns a "player disconnected. Server still starting" error. No response to input commands (like "list" or "help" for example) and rolling back to older backups does nothing. We have tried Java 17 thru 22. When it was last working, it ran successfully with both... so I imagine it's not a Java issue. No error messages are thrown. What could be the issue? Last few dozen lines from broken server log are below. Attached picture compares a log from a known time that the server is working (left) and a log from the latest broken server (right). We tried removing Stargate Journey, and the startup got a little farther along than what's shown in the image, but upon a user trying to connect they timed out. Console still would not respond to commands. Just to try it, we deleted the world (backups of world are saved elsewhere) and kicked off the server again. This time, the server successfully started and was join-able. We are bewildered.
[26Aug2024 19:59:13.378] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Starting minecraft server version 1.20.1
[26Aug2024 19:59:13.378] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Loading properties
[26Aug2024 19:59:13.378] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Default game type: SURVIVAL
[26Aug2024 19:59:13.378] [Server thread/INFO] [net.minecraft.server.MinecraftServer/]: Generating keypair
[26Aug2024 19:59:13.494] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Starting Minecraft server on *:25565
[26Aug2024 19:59:13.523] [Server thread/INFO] [net.minecraft.server.network.ServerConnectionListener/]: Using epoll channel type
[26Aug2024 19:59:13.703] [Server thread/INFO] [FluxNetworks/Energy]: Energy blacklist loaded: 1 block entries, 0 item entries
[26Aug2024 19:59:14.133] [Server thread/INFO] [Framework/]: Loading server configs...
[26Aug2024 19:59:14.171] [Server thread/INFO] [terrablender/]: Initialized TerraBlender biomes for level stem minecraft:the_nether
[26Aug2024 19:59:14.986] [Server thread/INFO] [terrablender/]: Initialized TerraBlender biomes for level stem minecraft:overworld
[26Aug2024 19:59:14.990] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Preparing level "balls"
[26Aug2024 19:59:15.394] [Server thread/INFO] [com.cupboard.Cupboard/]: Loaded config for: betterchunkloading.json
[26Aug2024 19:59:15.487] [Server thread/INFO] [shetiphian.core.ShetiPhianCore/]: Loading Teams Data
[26Aug2024 19:59:15.487] [Server thread/INFO] [shetiphian.core.ShetiPhianCore/]: Finished Loading Teams Data
[26Aug2024 19:59:15.857] [Server thread/INFO] [net.minecraft.server.MinecraftServer/]: Preparing start region for dimension minecraft:overworld
[26Aug2024 19:59:17.529] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 0%
[26Aug2024 19:59:17.530] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 0%
[26Aug2024 19:59:17.530] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 0%
[26Aug2024 19:59:17.530] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 0%
[26Aug2024 19:59:17.861] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 1%
[26Aug2024 19:59:18.358] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 27%
[26Aug2024 19:59:18.859] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 74%
[26Aug2024 19:59:19.346] [Worker-Main-2/INFO] [ModernFix/]: Made Refined Storage shape cache map thread-safe
[26Aug2024 19:59:19.760] [Server thread/INFO] [FluxNetworks/]: Load 1 chunks by 1 flux devices in minecraft:overworld
[26Aug2024 19:59:19.761] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Time elapsed: 3904 ms
[26Aug2024 19:59:19.762] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Done (6.134s)! For help, type "help"
[26Aug2024 19:59:19.914] [Server thread/INFO] [net.minecraftforge.server.permission.PermissionAPI/]: Successfully initialized permission handler forge:default_handler
[26Aug2024 19:59:19.923] [Server thread/INFO] [net.pttheta.loveandwar.LoveAndWarMod/]: HELLO from server starting
[26Aug2024 19:59:19.929] [Server thread/INFO] [mcp.mobius.waila.config.PluginConfig/]: [WTHIT] Plugin config reloaded
[26Aug2024 19:59:19.987] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Stargate Network is up to date (Version: 8)
[26Aug2024 19:59:19.990] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Deserializing Stargates
[26Aug2024 19:59:19.996] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Finished deserializing Stargates
[26Aug2024 19:59:19.996] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Deserializing Transporters
[26Aug2024 19:59:19.998] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Finished deserializing Transporters
[26Aug2024 20:01:01.641] [Netty Epoll Server IO #1/INFO] [com.cupboard.Cupboard/]: Loaded config for: connectivity.json
[26Aug2024 20:01:01.797] [Netty Epoll Server IO #1/INFO] [mixin/]: Mixing server.MixinServerboundChatCommandPacket from mixins/common/nochatreports.mixins.json into net.minecraft.network.protocol.game.ServerboundChatCommandPacket
[26Aug2024 20:01:01.800] [Netty Epoll Server IO #1/INFO] [mixin/]: Mixing server.MixinServerboundChatPacket from mixins/common/nochatreports.mixins.json into net.minecraft.network.protocol.game.ServerboundChatPacket
[26Aug2024 20:01:01.802] [Netty Epoll Server IO #1/INFO] [mixin/]: Mixing server.MixinServerboundChatSessionUpdatePacket from mixins/common/nochatreports.mixins.json into net.minecraft.network.protocol.game.ServerboundChatSessionUpdatePacket
[26Aug2024 20:01:10.979] [Netty Epoll Server IO #1/INFO] [net.minecraftforge.server.ServerLifecycleHooks/SERVERHOOKS]: Disconnecting Player (server is still starting): literal{Server is still starting! Please wait before reconnecting.}
We've been running a modded server in Linux successfully for days now. A new issue has appeared where upon attempting to start up, the server seems to get stuck at the very end and never finishes starting up. Nothing has changed mod/server/code wise since it last worked 48 hours ago. Hardware allocation seems fine. "Just waiting longer" is not a solution... we left it attempting to boot for >12 hours like this to no avail. Trying to join during this phase returns a "player disconnected. Server still starting" error. No response to input commands (like "list" or "help" for example) and rolling back to older backups does nothing. We have tried Java 17 thru 22. When it was last working, it ran successfully with both... so I imagine it's not a Java issue. No error messages are thrown. What could be the issue? Last few dozen lines from broken server log are below. Attached picture compares a log from a known time that the server is working (left) and a log from the latest broken server (right). We tried removing Stargate Journey, and the startup got a little farther along than what's shown in the image, but upon a user trying to connect they timed out. Console still would not respond to commands. Just to try it, we deleted the world (backups of world are saved elsewhere) and kicked off the server again. This time, the server successfully started and was join-able. We are bewildered.
[26Aug2024 19:59:13.378] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Starting minecraft server version 1.20.1
[26Aug2024 19:59:13.378] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Loading properties
[26Aug2024 19:59:13.378] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Default game type: SURVIVAL
[26Aug2024 19:59:13.378] [Server thread/INFO] [net.minecraft.server.MinecraftServer/]: Generating keypair
[26Aug2024 19:59:13.494] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Starting Minecraft server on *:25565
[26Aug2024 19:59:13.523] [Server thread/INFO] [net.minecraft.server.network.ServerConnectionListener/]: Using epoll channel type
[26Aug2024 19:59:13.703] [Server thread/INFO] [FluxNetworks/Energy]: Energy blacklist loaded: 1 block entries, 0 item entries
[26Aug2024 19:59:14.133] [Server thread/INFO] [Framework/]: Loading server configs...
[26Aug2024 19:59:14.171] [Server thread/INFO] [terrablender/]: Initialized TerraBlender biomes for level stem minecraft:the_nether
[26Aug2024 19:59:14.986] [Server thread/INFO] [terrablender/]: Initialized TerraBlender biomes for level stem minecraft:overworld
[26Aug2024 19:59:14.990] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Preparing level "balls"
[26Aug2024 19:59:15.394] [Server thread/INFO] [com.cupboard.Cupboard/]: Loaded config for: betterchunkloading.json
[26Aug2024 19:59:15.487] [Server thread/INFO] [shetiphian.core.ShetiPhianCore/]: Loading Teams Data
[26Aug2024 19:59:15.487] [Server thread/INFO] [shetiphian.core.ShetiPhianCore/]: Finished Loading Teams Data
[26Aug2024 19:59:15.857] [Server thread/INFO] [net.minecraft.server.MinecraftServer/]: Preparing start region for dimension minecraft:overworld
[26Aug2024 19:59:17.529] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 0%
[26Aug2024 19:59:17.530] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 0%
[26Aug2024 19:59:17.530] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 0%
[26Aug2024 19:59:17.530] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 0%
[26Aug2024 19:59:17.861] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 1%
[26Aug2024 19:59:18.358] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 27%
[26Aug2024 19:59:18.859] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Preparing spawn area: 74%
[26Aug2024 19:59:19.346] [Worker-Main-2/INFO] [ModernFix/]: Made Refined Storage shape cache map thread-safe
[26Aug2024 19:59:19.760] [Server thread/INFO] [FluxNetworks/]: Load 1 chunks by 1 flux devices in minecraft:overworld
[26Aug2024 19:59:19.761] [Server thread/INFO] [net.minecraft.server.level.progress.LoggerChunkProgressListener/]: Time elapsed: 3904 ms
[26Aug2024 19:59:19.762] [Server thread/INFO] [net.minecraft.server.dedicated.DedicatedServer/]: Done (6.134s)! For help, type "help"
[26Aug2024 19:59:19.914] [Server thread/INFO] [net.minecraftforge.server.permission.PermissionAPI/]: Successfully initialized permission handler forge:default_handler
[26Aug2024 19:59:19.923] [Server thread/INFO] [net.pttheta.loveandwar.LoveAndWarMod/]: HELLO from server starting
[26Aug2024 19:59:19.929] [Server thread/INFO] [mcp.mobius.waila.config.PluginConfig/]: [WTHIT] Plugin config reloaded
[26Aug2024 19:59:19.987] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Stargate Network is up to date (Version: 8)
[26Aug2024 19:59:19.990] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Deserializing Stargates
[26Aug2024 19:59:19.996] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Finished deserializing Stargates
[26Aug2024 19:59:19.996] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Deserializing Transporters
[26Aug2024 19:59:19.998] [Server thread/INFO] [net.povstalec.sgjourney.StargateJourney/]: Finished deserializing Transporters
[26Aug2024 20:01:01.641] [Netty Epoll Server IO #1/INFO] [com.cupboard.Cupboard/]: Loaded config for: connectivity.json
[26Aug2024 20:01:01.797] [Netty Epoll Server IO #1/INFO] [mixin/]: Mixing server.MixinServerboundChatCommandPacket from mixins/common/nochatreports.mixins.json into net.minecraft.network.protocol.game.ServerboundChatCommandPacket
[26Aug2024 20:01:01.800] [Netty Epoll Server IO #1/INFO] [mixin/]: Mixing server.MixinServerboundChatPacket from mixins/common/nochatreports.mixins.json into net.minecraft.network.protocol.game.ServerboundChatPacket
[26Aug2024 20:01:01.802] [Netty Epoll Server IO #1/INFO] [mixin/]: Mixing server.MixinServerboundChatSessionUpdatePacket from mixins/common/nochatreports.mixins.json into net.minecraft.network.protocol.game.ServerboundChatSessionUpdatePacket
[26Aug2024 20:01:10.979] [Netty Epoll Server IO #1/INFO] [net.minecraftforge.server.ServerLifecycleHooks/SERVERHOOKS]: Disconnecting Player (server is still starting): literal{Server is still starting! Please wait before reconnecting.}