mirror of
https://github.com/BookStackApp/BookStack.git
synced 2026-02-23 03:09:40 +03:00
Intermittent problems with cache #3929
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @jradikk on GitHub (Jul 24, 2023).
Attempted Debugging
Searched GitHub Issues
Describe the Scenario
The /status page returns 500 with
{"database":true,"cache":false,"session":true}every once in a while. No errors in bookstack logSwitching the cache driver value between file/redis doesn't solve the problem. Number of bookstack application replicas don't affect the problem either (both 1 replica and 2 replicas setups experience the same problem)
With cache and session drivers set to redis, only cache is the one getting errors
Exact BookStack Version
v22.04.02
Log Content
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:55:55 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:55:55 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:05 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:05 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:15 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:15 +0000] "GET /status HTTP/1.1" 500 1496 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:25 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:25 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:35 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:35 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:45 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:45 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:55 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:55 +0000] "GET /status HTTP/1.1" 500 1496 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:05 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:05 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:15 +0000] "GET /status HTTP/1.1" 500 1496 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:15 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:25 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:25 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
PHP Version
8.1.6
Hosting Environment
Kubernetes cluster (1.24), Ubuntu 20.04 OS, solidnerd/bookstack:22.04.02 docker image
@ssddanbrown commented on GitHub (Jul 24, 2023):
Hi @jradikk,
Are you able to replicate this in an easily reproducible manner at all? Like via quick refreshing the status endpoint in the browser, or via hitting the status endpoint via something like
watch -n 0.2 curl https://instance.example.com/status?Have you tried a more up-to-date version of BookStack?
Have you tried the database caching driver option?
@jradikk commented on GitHub (Jul 25, 2023):
Hi @ssddanbrown. Thanks for the quick reply
I am able to reproduce it with a simple bash script. I tested the database caching driver and it didn't help either
I'll try upgrading to the latest bookstack version today and will let you know if that helped
@jradikk commented on GitHub (Jul 26, 2023):
I'm still seeing the same 500 errors after the upgrade to 23.06.2
@ssddanbrown commented on GitHub (Jul 26, 2023):
Are you able to share that script? Or do you mean my watch command?
Also confirm any frequency/pattern you see in the results of the script.
Just want to get in a position where I can run the same test in my environments.
@jradikk commented on GitHub (Jul 26, 2023):
I used the following script, but essentially it's the same thing as your watch command
while true; do curl -vkis 127.0.0.1:8080/status ; sleep 5; doneAround 20% of requests fail. below is the log of healthchecks from the Kubernetes pod in case it helps with understanding the pattern better:
Healthcheck log
bookstack:80 127.0.0.6 - - [26/Jul/2023:11:22:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:22:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24"
@jradikk commented on GitHub (Aug 2, 2023):
@ssddanbrown Do you have any idea what might be the problem with the cache or healthcheck? Thanks
@ssddanbrown commented on GitHub (Aug 2, 2023):
Just had another play with this. I'm able to reproduce when running multiple
watch -n 0.1 curl <url>/statusinstances simultaneously, instead of just one.The cache check at this endpoint is quite simple, it puts a random string into the cache under a specific key, then pulls it back out then compares the result, failing if the new value does not match.
I think this is simply a case of multiple simultaneous requests caching that cache value within the process of another, so the result fails.
There's a couple of things we could do to adjust for this. We could use cache locks, although this does introduce some additional database requirements for us. Alternatively, we could just add a unique/random element to the cache key used to check status to likely limit the chance of conflict.
I'll mark this as something for the next feature release.
If you could add some level of random delay to your checks, or avoid whatever causes simultaneous requests, that may help work around this until cache checks are made unique.
@ssddanbrown commented on GitHub (Aug 17, 2023):
I've now patched this in
e44ef57219, to be part of the next feature release.Could not reproduce via previous means with this patch.
Thanks @jradikk for reporting and providing info!