<html><head></head><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:12px"><div style="box-sizing: border-box; margin-bottom: 16px; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 14px; line-height: 21px; margin-top: 0px !important;" id="yui_3_16_0_ym19_1_1472189590576_11648">hi</div><div style="box-sizing: border-box; margin-bottom: 16px; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 14px; line-height: 21px; margin-top: 0px !important;" id="yui_3_16_0_ym19_1_1472189590576_11648"><br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11649">almost all "gdb/bt full" contain:</div><div style="box-sizing: border-box; margin-bottom: 16px; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 14px; line-height: 21px; margin-top: 0px !important;" id="yui_3_16_0_ym19_1_1472189590576_11648"><br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11650"><a href="https://github.com/kamailio/kamailio/pull/13" data-id="52784350" data-error-text="Failed to load issue title" data-permission-text="Issue title is private" title="dispatcher: fixing some misspelled words and adding support for custom number of successful probing requests" style="box-sizing: border-box; color: rgb(64, 120, 192); text-decoration: none;" id="yui_3_16_0_ym19_1_1472189590576_11651">#13</a> 0x00000000005f916c in parse_disposition (s=0xa75468 tcp_reader_ltimer+228904, disp=optimized out) at parser/parse_disposition.c:60<br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11652">disp_p = <br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11653">new_p = <br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11654">state = 2<br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11655">saved_state = 2<br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11656">tmp = 0x7f161b681fc0 ""<br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11657">end = 0x4020dd8800000000 error: Cannot access memory at address 0x4020dd8800000000<br style="box-sizing: border-box;" id="yui_3_16_0_ym19_1_1472189590576_11658"><span style="box-sizing: border-box; font-weight: 600;" id="yui_3_16_0_ym19_1_1472189590576_11659">func</span> = "parse_disposition"</div><div style="box-sizing: border-box; margin-top: 0px; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 14px; line-height: 21px; margin-bottom: 0px !important;" dir="ltr" id="yui_3_16_0_ym19_1_1472189590576_11660">A lot of tcp errors in kamailio.log before the crush.</div><div style="box-sizing: border-box; margin-top: 0px; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 14px; line-height: 21px; margin-bottom: 0px !important;" dir="ltr" id="yui_3_16_0_ym19_1_1472189590576_11660"><br></div><div style="box-sizing: border-box; margin-top: 0px; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 14px; line-height: 21px; margin-bottom: 0px !important;" dir="ltr" id="yui_3_16_0_ym19_1_1472189590576_11660"> </div><div style="box-sizing: border-box; margin-top: 0px; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 14px; line-height: 21px; margin-bottom: 0px !important;" dir="ltr" id="yui_3_16_0_ym19_1_1472189590576_11660">How to solve the issue?</div> <div class="qtdSeparateBR"><br><br></div><div class="yahoo_quoted" style="display: block;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 12px;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div dir="ltr"><font size="2" face="Arial"> On Tuesday, August 16, 2016 3:19 PM, Dmitry <mbike2000ru@yahoo.com> wrote:<br></font></div> <br><br> <div class="y_msg_container"><div id="yiv0577440528"><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:12px;"><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3072">hel</div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3024"><br></div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3071"><br></div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3032">From time to time (it does not depend upon traffic) we see in logs:</div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3070"><br></div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3064" dir="ltr"> ERROR: <core> [tcp_read.c:274]: tcp_read_data(): error reading: Bad file descriptor (9) ([ip_address]:49832 -> [ip_address]5060)</div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3065"> ERROR: <core> [tcp_read.c:1303]: tcp_read_req(): ERROR: tcp_read_req: error reading</div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3066">ERROR: <core> [io_wait.h:608]: io_watch_del(): trying to delete already erased entry 3031 in the hash(0, 0, (nil)) flags 10)</div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3067" dir="ltr">CRITICAL: <core> [tcp_read.c:1654]: handle_io(): io_watch_del failed for 0x7f8471c51820 id 867 fd 3031, state 0, flags 4018, main fd 179, refcnt 2 ([ip_address]:49832 -> [ip_address]:5060)</div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3067" dir="ltr"><br></div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3067" dir="ltr">there are a lot of such TCP CRITICAL errors and the kamailio crushes</div><div id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3067" dir="ltr"><br></div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3198">kamailio -v</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3199">version: kamailio 4.3.5 (x86_64/linux)</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3200">flags: STATS: Off, USE_TCP, USE_TLS, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3201">ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3202">poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3203">id: unknown</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3204">compiled on 17:51:55 Mar 8 2016 with gcc 4.4.7</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3205"><br id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3206"></div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3068">It is still not clear - what exactly causes such behaviour.</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3068"><br></div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3068">I want to recriate it in the lab - so what can cause it.?</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3068"><br></div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3068">May be a process erases the file descriptors of TCP connections?</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3068"><br></div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3068">Any help is appreciated.</div><div dir="ltr" id="yiv0577440528yui_3_16_0_ym19_1_1471342032156_3068"><br></div></div></div></div><br><br></div> </div> </div> </div></div></body></html>