<div dir="ltr">Hi Daniel,<div><br></div><div>Thanks.. As a sidenote, If i disable ssl from mongo-c-driver library then i don't have any crash..</div><div><br></div><div>Something changed in my environment. Im not able to get the full backtrace. This is what i'm getting now.</div><div><br></div><div><br></div><div><br></div><div><div>aded symbols for /lib64/liblber-2.4.so.2</div><div>Reading symbols from /lib64/libnss_dns-2.12.so...Reading symbols from /usr/lib/debug/lib64/libnss_dns-2.12.so.debug...done.</div><div>done.</div><div>Loaded symbols for /lib64/<a href="http://libnss_dns-2.12.so">libnss_dns-2.12.so</a></div><div>Core was generated by `/usr/local/kamailio_proxy/sbin/kamailio -f /usr/local/kamailio_proxy/etc/kamail'.</div><div>Program terminated with signal 11, Segmentation fault.</div><div>#0  0x00007f69ffffffff in ?? ()</div><div>Missing separate debuginfos, use: debuginfo-install cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64 cyrus-sasl-plain-2.1.23-15.el6_6.2.x86_64 db4-4.7.25-19.el6_6.x86_64 keyutils-libs-1.4-5.el6.x86_64 krb5-libs-1.10.3-42.el6.x86_64 libcom_err-1.41.12-22.el6.x86_64 libcurl-7.19.7-46.el6.x86_64 libidn-1.18-2.el6.x86_64 libselinux-2.0.94-5.8.el6.x86_64 libssh2-1.4.2-1.el6_6.1.x86_64 libunistring-0.9.3-5.el6.x86_64 libxml2-2.7.6-20.el6.x86_64 mysql-libs-5.1.73-5.el6_6.x86_64 nspr-4.10.8-1.el6_6.x86_64 nss-3.18.0-5.3.el6_6.x86_64 nss-util-3.18.0-1.el6_6.x86_64 openldap-2.4.40-5.el6.x86_64 openssl-1.0.1e-42.el6.x86_64 zlib-1.2.3-29.el6.x86_64</div><div>(gdb) bt</div><div>#0  0x00007f69ffffffff in ?? ()</div><div>#1  0x00000000005fef8e in compat_old_handler (ti=69660042, tl=0x7f693e736d50, data=0x7f693e736d50) at timer.c:996</div><div>#2  0x00000000005ff94c in slow_timer_main () at timer.c:1130</div><div>#3  0x00000000004a8676 in main_loop () at main.c:1628</div><div>#4  0x00000000004ae38e in main (argc=15, argv=0x7ffdd0dc8848) at main.c:2533</div><div>(gdb) </div><div><br></div><div><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Oct 1, 2015 at 2:37 AM, Daniel-Constantin Mierla <span dir="ltr"><<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    The first backtrace is related to pike. Can you get from gdb of
    fisrt trace:<br>
    <br>
    frame 2<br>
    p root->entries[b]<br>
    <br>
    Cheers,<br>
    Daniel<div><div class="h5"><br>
    <br>
    <div>On 30/09/15 16:19, Jijo wrote:<br>
    </div>
    </div></div><blockquote type="cite"><div><div class="h5">
      <div dir="ltr">I'm observing a segmentation fault when mongodb
        & tls enabled. It doesn't happen when one of the module is
        disabled.
        <div>
          <div><span style="font-size:12.8px">OS: centos 6.7   kamailio
              4.3.2</span><span style="font-size:12.8px">  </span>mongo-c-driver
            version 1.1.10.</div>
          <div><br>
          </div>
          <div>It happens immediately after i register a subscriber. The
            location table is updated with the new data and in parallel
            core is generated as well.</div>
          <div><br>
          </div>
          <div><br>
          </div>
          <div>
            <div><br>
            </div>
            <div>Loaded symbols for /lib64/<a href="http://libnss_dns-2.12.so" target="_blank">libnss_dns-2.12.so</a></div>
            <div>Core was generated by
              `/usr/local/kamailio_proxy/sbin/kamailio -f
              /usr/local/kamailio_proxy/etc/kamail'.</div>
            <div>Program terminated with signal 11, Segmentation fault.</div>
            <div>#0  0x00007fd3adf65e69 in atomic_cmpxchg_int
              (var=0x56444e3055445030, old=0, new_v=1) at
              ../../atomic/atomic_x86.h:233</div>
            <div>233<span style="white-space:pre-wrap">   </span>ATOMIC_FUNC_CMPXCHG(cmpxchg,
              "cmpxchgl %2, %1", int , int)</div>
            <div>Missing separate debuginfos, use: debuginfo-install
              cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64
              cyrus-sasl-plain-2.1.23-15.el6_6.2.x86_64
              db4-4.7.25-19.el6_6.x86_64 keyutils-libs-1.4-5.el6.x86_64
              krb5-libs-1.10.3-42.el6.x86_64
              libcom_err-1.41.12-22.el6.x86_64
              libcurl-7.19.7-46.el6.x86_64 libidn-1.18-2.el6.x86_64
              libselinux-2.0.94-5.8.el6.x86_64
              libssh2-1.4.2-1.el6_6.1.x86_64
              libunistring-0.9.3-5.el6.x86_64
              libxml2-2.7.6-20.el6.x86_64
              mysql-libs-5.1.73-5.el6_6.x86_64
              nspr-4.10.8-1.el6_6.x86_64 nss-3.18.0-5.3.el6_6.x86_64
              nss-util-3.18.0-1.el6_6.x86_64
              openldap-2.4.40-5.el6.x86_64 openssl-1.0.1e-42.el6.x86_64
              zlib-1.2.3-29.el6.x86_64</div>
            <div>(gdb) bt</div>
            <div>#0  0x00007fd3adf65e69 in atomic_cmpxchg_int
              (var=0x56444e3055445030, old=0, new_v=1) at
              ../../atomic/atomic_x86.h:233</div>
            <div>#1  0x00007fd3adf65eb6 in futex_get
              (lock=0x56444e3055445030) at ../../futexlock.h:99</div>
            <div>#2  0x00007fd3adf66468 in prv_lock_tree_branch (b=192
              '\300') at ip_tree.c:47</div>
            <div>#3  0x00007fd3adf664e5 in lock_tree_branch (b=192
              '\300') at ip_tree.c:66</div>
            <div>#4  0x00007fd3adf6dda6 in swap_routine
              (ticks=123206032, param=0x0) at pike_funcs.c:293</div>
            <div>#5  0x00000000005fef8e in compat_old_handler
              (ti=1971296512, tl=0x7fd32ccea430, data=0x7fd32ccea430) at
              timer.c:996</div>
            <div>#6  0x00000000005ff94c in slow_timer_main () at
              timer.c:1130</div>
            <div>#7  0x00000000004a8676 in main_loop () at main.c:1628</div>
            <div>#8  0x00000000004ae38e in main (argc=11,
              argv=0x7fff1d97ec28) at main.c:2533</div>
            <div>(gdb) </div>
          </div>
          <div><br>
          </div>
          <div><br>
          </div>
          <div>On Clean up after the core, mongo db does segmentation
            fault as well</div>
          <div><br>
          </div>
          <div>
            <div>Loaded symbols for /lib64/<a href="http://libnss_files-2.12.so" target="_blank">libnss_files-2.12.so</a></div>
            <div>Reading symbols from
              /lib64/libnss_dns-2.12.so...Reading symbols from
              /usr/lib/debug/lib64/libnss_dns-2.12.so.debug...done.</div>
            <div>done.</div>
            <div>Loaded symbols for /lib64/<a href="http://libnss_dns-2.12.so" target="_blank">libnss_dns-2.12.so</a></div>
            <div>Core was generated by
              `/usr/local/kamailio_proxy/sbin/kamailio -f
              /usr/local/kamailio_proxy/etc/kamail'.</div>
            <div>Program terminated with signal 11, Segmentation fault.</div>
            <div>#0  __pthread_mutex_destroy (mutex=0x7fd32cce7be8) at
              pthread_mutex_destroy.c:28</div>
            <div>28<span style="white-space:pre-wrap">    </span>  if
              ((mutex->__data.__kind &
              PTHREAD_MUTEX_ROBUST_NORMAL_NP) == 0</div>
            <div>Missing separate debuginfos, use: debuginfo-install
              cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64
              cyrus-sasl-plain-2.1.23-15.el6_6.2.x86_64
              db4-4.7.25-19.el6_6.x86_64 keyutils-libs-1.4-5.el6.x86_64
              krb5-libs-1.10.3-42.el6.x86_64
              libcom_err-1.41.12-22.el6.x86_64
              libcurl-7.19.7-46.el6.x86_64 libidn-1.18-2.el6.x86_64
              libselinux-2.0.94-5.8.el6.x86_64
              libssh2-1.4.2-1.el6_6.1.x86_64
              libunistring-0.9.3-5.el6.x86_64
              libxml2-2.7.6-20.el6.x86_64
              mysql-libs-5.1.73-5.el6_6.x86_64
              nspr-4.10.8-1.el6_6.x86_64 nss-3.18.0-5.3.el6_6.x86_64
              nss-util-3.18.0-1.el6_6.x86_64
              openldap-2.4.40-5.el6.x86_64 openssl-1.0.1e-42.el6.x86_64
              zlib-1.2.3-29.el6.x86_64</div>
            <div>(gdb) bt</div>
            <div>#0  __pthread_mutex_destroy (mutex=0x7fd32cce7be8) at
              pthread_mutex_destroy.c:28</div>
            <div>#1  0x00007fd32c86f9e6 in _mongoc_ssl_thread_cleanup ()
              at src/mongoc/mongoc-ssl.c:555</div>
            <div>#2  _mongoc_ssl_cleanup () at
              src/mongoc/mongoc-ssl.c:106</div>
            <div>#3  0x00007fd32c8606a9 in _mongoc_do_cleanup () at
              src/mongoc/mongoc-init.c:127</div>
            <div>#4  0x000000344480cdb3 in pthread_once () at
              ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_once.S:104</div>
            <div>#5  0x00007fd32c8523df in __do_global_dtors_aux () from
              /usr/lib64/libmongoc-1.0.so.0.0.0</div>
            <div>#6  0x0000000000000000 in ?? ()</div>
            <div>(gdb) </div>
          </div>
          <div><br>
          </div>
          <div><br>
          </div>
          <div><br>
          </div>
          <div>mongo-c-driver version 1.1.10</div>
          <div><br>
          </div>
          <div>
            <div><span style="font-size:12.8px">version: kamailio 4.3.2
                (x86_64/linux) b5980b-dirty</span></div>
            <div><span style="font-size:12.8px">flags: STATS: Off,
                USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS,
                DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MEM,
                SHM_MMAP, PKG_MALLOC, F_MALLOC, DBG_F_MALLOC, USE_FUTEX,
                FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE,
                USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST,
                HAVE_RESOLV_RES</span></div>
            <div><span style="font-size:12.8px">ADAPTIVE_WAIT_LOOPS=1024,
                MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE
                1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB</span></div>
            <div><span style="font-size:12.8px">poll method support:
                poll, epoll_lt, epoll_et, sigio_rt, select.</span></div>
            <div><span style="font-size:12.8px">id: b5980b -dirty</span></div>
            <div><span style="font-size:12.8px">compiled on 13:35:24 Sep
                28 2015 with gcc 4.</span></div>
          </div>
        </div>
      </div>
      <br>
      <fieldset></fieldset>
      <br>
      </div></div><pre>_______________________________________________
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users</a><span class="HOEnZb"><font color="#888888">
</font></span></pre><span class="HOEnZb"><font color="#888888">
    </font></span></blockquote><span class="HOEnZb"><font color="#888888">
    <br>
    <pre cols="72">-- 
Daniel-Constantin Mierla
<a href="http://twitter.com/#!/miconda" target="_blank">http://twitter.com/#!/miconda</a> - <a href="http://www.linkedin.com/in/miconda" target="_blank">http://www.linkedin.com/in/miconda</a>
Book: SIP Routing With Kamailio - <a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a>
Kamailio Advanced Training, Sep 28-30, 2015, in Berlin - <a href="http://asipto.com/u/kat" target="_blank">http://asipto.com/u/kat</a></pre>
  </font></span></div>

<br>_______________________________________________<br>
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list<br>
<a href="mailto:sr-users@lists.sip-router.org">sr-users@lists.sip-router.org</a><br>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" rel="noreferrer" target="_blank">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users</a><br>
<br></blockquote></div><br></div>