Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Timeout and Thread deadlock #2833

Open
MrsealIsHotChicken opened this issue Jan 7, 2025 · 0 comments
Open

Timeout and Thread deadlock #2833

MrsealIsHotChicken opened this issue Jan 7, 2025 · 0 comments

Comments

@MrsealIsHotChicken
Copy link

In a .NET 6 application, occasional timeout exceptions occur when using a List to consume a queue, and once a connection times out, all subsequent related Redis operations also timeout. Only a restart of the application resolves the issue. During troubleshooting, I have reviewed relevant documentation and issues, and the root cause may be related to thread starvation. I have already configured asynchronous timeout settings and minimum thread counts. However, I am puzzled as to why a timeout in one operation would lead to all subsequent operations timing out. Shouldn't each command be independent rather than one timeout causing all subsequent operations to become unavailable? I hope someone who has encountered this issue before can help clarify my confusion.

The configuration of the problematic machine is Ubuntu 4C8G:

2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10677ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.1, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xxx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=8,Free=32759,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=0,CompletedItems=3757332,Timers=9), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts)

More error info
2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10677ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.1, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=8,Free=32759,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=0,CompletedItems=3757332,Timers=9), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10774ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.1, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=8,Free=32759,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=0,CompletedItems=3757330,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10936ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.09, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=6,Free=32761,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=0,CompletedItems=3757330,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10563ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.1, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=10,Free=32757,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=1,CompletedItems=3757332,Timers=9), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10383ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.1, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=13,Free=32754,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=1,CompletedItems=3757333,Timers=10), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10634ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.1, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=9,Free=32758,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=1,CompletedItems=3757332,Timers=9), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10710ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.1, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=9,Free=32758,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=1,CompletedItems=3757332,Timers=9), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:28,721 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10388ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21612.1, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=12,Free=32755,Min=200,Max=32767), POOL: (Threads=19,QueuedItems=1,CompletedItems=3757333,Timers=10), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:29,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10949ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21613.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=7,Free=32760,Min=200,Max=32767), POOL: (Threads=18,QueuedItems=0,CompletedItems=3757340,Timers=15), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:29,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10645ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21613.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=12,Free=32755,Min=200,Max=32767), POOL: (Threads=18,QueuedItems=1,CompletedItems=3757340,Timers=15), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:29,707 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10880ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21613.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=9,Free=32758,Min=200,Max=32767), POOL: (Threads=18,QueuedItems=0,CompletedItems=3757340,Timers=15), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:29,707 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10786ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21613.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=10,Free=32757,Min=200,Max=32767), POOL: (Threads=18,QueuedItems=1,CompletedItems=3757340,Timers=15), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:29,707 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10448ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 15, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 60, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198315, serverEndpoint: 10.12.15.11:32379, conn-sec: 21613.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=12,Free=32755,Min=200,Max=32767), POOL: (Threads=18,QueuedItems=2,CompletedItems=3757340,Timers=15), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:30,705 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10308ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 23, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 92, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198323, serverEndpoint: 10.12.15.11:32379, conn-sec: 21614.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=7,Free=32760,Min=200,Max=32767), POOL: (Threads=18,QueuedItems=0,CompletedItems=3757357,Timers=12), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:32,707 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10269ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 29, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 116, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198329, serverEndpoint: 10.12.15.11:32379, conn-sec: 21616.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=7,Free=32760,Min=200,Max=32767), POOL: (Threads=18,QueuedItems=0,CompletedItems=3757369,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:40,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10983ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198330, serverEndpoint: 10.12.15.11:32379, conn-sec: 21624.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=11,Free=32756,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=5,CompletedItems=3757390,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:40,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10983ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198330, serverEndpoint: 10.12.15.11:32379, conn-sec: 21624.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=11,Free=32756,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=4,CompletedItems=3757390,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:40,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10983ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198330, serverEndpoint: 10.12.15.11:32379, conn-sec: 21624.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=11,Free=32756,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=6,CompletedItems=3757390,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:40,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10983ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198330, serverEndpoint: 10.12.15.11:32379, conn-sec: 21624.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=11,Free=32756,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=3,CompletedItems=3757390,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:40,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10983ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198330, serverEndpoint: 10.12.15.11:32379, conn-sec: 21624.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=7,Free=32760,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=1,CompletedItems=3757390,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:40,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10983ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198330, serverEndpoint: 10.12.15.11:32379, conn-sec: 21624.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=8,Free=32759,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=2,CompletedItems=3757390,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:40,707 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10983ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198330, serverEndpoint: 10.12.15.11:32379, conn-sec: 21624.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=10,Free=32757,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=2,CompletedItems=3757390,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:40,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10983ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: False, bw: SpinningDown, rs: ReadAsync, ws: Idle, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198330, serverEndpoint: 10.12.15.11:32379, conn-sec: 21624.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=7,Free=32760,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=0,CompletedItems=3757390,Timers=7), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts) 2025-01-05 05:35:41,706 [.NET ThreadPool Worker] INFO Timeout awaiting response (outbound=0KiB, inbound=0KiB, 10999ms elapsed, timeout is 10000ms), command=LLEN, next: LLEN mq:itnback, inst: 0, qu: 0, qs: 30, aw: True, bw: SpinningDown, rs: ReadAsync, ws: Writing, in: 120, in-pipe: 0, out-pipe: 0, last-in: 1, cur-in: 0, sync-ops: 0, async-ops: 198331, serverEndpoint: 10.12.15.11:32379, conn-sec: 21625.08, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: xx(SE.Redis-v2.7.33.41805), IOCP: (Busy=0,Free=1000,Min=200,Max=1000), WORKER: (Busy=14,Free=32753,Min=200,Max=32767), POOL: (Threads=17,QueuedItems=1,CompletedItems=3757400,Timers=12), v: 2.7.33.41805 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant