<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    If you recompiled with different souce code or different flags then
    the binary is no longer matching the corefile properly.<br>
    <br>
    Cheers,<br>
    Daniel<br>
    <br>
    <div class="moz-cite-prefix">On 01/10/15 17:00, Jijo wrote:<br>
    </div>
    <blockquote
cite="mid:CAOYmDE_0WekQLd_Twgx78B8+7u7RPvxx+eLKS9m3TLzn2LLkog@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div>Why the backtrace doesn't show the timer function pointer?
          Am i missing something?</div>
        <div><br>
        </div>
        <div>Im building the mongo-c-driver as below</div>
        <div>get the tar file from <a moz-do-not-send="true"
href="https://github.com/mongodb/mongo-c-driver/releases/download/1.1.11/mongo-c-driver-1.1.11.tar.gz">https://github.com/mongodb/mongo-c-driver/releases/download/1.1.11/mongo-c-driver-1.1.11.tar.gz</a></div>
        <div>run the rpm build using the spec file attached. </div>
        <div>To disable the ssl, i have modified  '--enable-ssl=no' in
          the configure  command in the spec file</div>
        <div>%configure --disable-static --disable-silent-rules
          --enable-debug-symbols --enable-man-pages --enable-ssl=yes
          --enable-sasl --with-libbson=bundled --enable-optimizations<br>
        </div>
        <div><br>
        </div>
        <div>In kamailio im using <span style="font-size:12.8px">db_mongodb.
            I'm getting same error  for ndb_mongodb as well.</span></div>
        <div><span style="font-size:12.8px"><br>
          </span></div>
        <div><span style="font-size:12.8px">Please find the kamailio
            config scripts.</span></div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Thu, Oct 1, 2015 at 10:43 AM,
          Daniel-Constantin Mierla <span dir="ltr"><<a
              moz-do-not-send="true" href="mailto:miconda@gmail.com"
              target="_blank"><a class="moz-txt-link-abbreviated" href="mailto:miconda@gmail.com">miconda@gmail.com</a></a>></span> wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div bgcolor="#FFFFFF" text="#000000"> Hello,<br>
              <br>
              the bracktrace is not useful.<br>
              <br>
              How did you compile the mongo-c library before and were
              there any special parameters you set to the modules in
              kamailio config? Are you using db_mongodb or ndb_mongodb?<br>
              <br>
              Cheers,<br>
              Daniel
              <div>
                <div class="h5"><br>
                  <br>
                  <br>
                  <div>On 01/10/15 16:25, Jijo wrote:<br>
                  </div>
                  <blockquote type="cite">
                    <div dir="ltr">Hi Daniel,
                      <div><br>
                      </div>
                      <div>Thanks.. As a sidenote, If i disable ssl from
                        mongo-c-driver library then i don't have any
                        crash..</div>
                      <div><br>
                      </div>
                      <div>Something changed in my environment. Im not
                        able to get the full backtrace. This is what i'm
                        getting now.</div>
                      <div><br>
                      </div>
                      <div><br>
                      </div>
                      <div><br>
                      </div>
                      <div>
                        <div>aded symbols for /lib64/liblber-2.4.so.2</div>
                        <div>Reading symbols from
                          /lib64/libnss_dns-2.12.so...Reading symbols
                          from
                          /usr/lib/debug/lib64/libnss_dns-2.12.so.debug...done.</div>
                        <div>done.</div>
                        <div>Loaded symbols for /lib64/<a
                            moz-do-not-send="true"
                            href="http://libnss_dns-2.12.so"
                            target="_blank">libnss_dns-2.12.so</a></div>
                        <div>Core was generated by
                          `/usr/local/kamailio_proxy/sbin/kamailio -f
                          /usr/local/kamailio_proxy/etc/kamail'.</div>
                        <div>Program terminated with signal 11,
                          Segmentation fault.</div>
                        <div>#0  0x00007f69ffffffff in ?? ()</div>
                        <div>Missing separate debuginfos, use:
                          debuginfo-install
                          cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64
                          cyrus-sasl-plain-2.1.23-15.el6_6.2.x86_64
                          db4-4.7.25-19.el6_6.x86_64
                          keyutils-libs-1.4-5.el6.x86_64
                          krb5-libs-1.10.3-42.el6.x86_64
                          libcom_err-1.41.12-22.el6.x86_64
                          libcurl-7.19.7-46.el6.x86_64
                          libidn-1.18-2.el6.x86_64
                          libselinux-2.0.94-5.8.el6.x86_64
                          libssh2-1.4.2-1.el6_6.1.x86_64
                          libunistring-0.9.3-5.el6.x86_64
                          libxml2-2.7.6-20.el6.x86_64
                          mysql-libs-5.1.73-5.el6_6.x86_64
                          nspr-4.10.8-1.el6_6.x86_64
                          nss-3.18.0-5.3.el6_6.x86_64
                          nss-util-3.18.0-1.el6_6.x86_64
                          openldap-2.4.40-5.el6.x86_64
                          openssl-1.0.1e-42.el6.x86_64
                          zlib-1.2.3-29.el6.x86_64</div>
                        <div>(gdb) bt</div>
                        <div>#0  0x00007f69ffffffff in ?? ()</div>
                        <div>#1  0x00000000005fef8e in
                          compat_old_handler (ti=69660042,
                          tl=0x7f693e736d50, data=0x7f693e736d50) at
                          timer.c:996</div>
                        <div>#2  0x00000000005ff94c in slow_timer_main
                          () at timer.c:1130</div>
                        <div>#3  0x00000000004a8676 in main_loop () at
                          main.c:1628</div>
                        <div>#4  0x00000000004ae38e in main (argc=15,
                          argv=0x7ffdd0dc8848) at main.c:2533</div>
                        <div>(gdb) </div>
                        <div><br>
                        </div>
                        <div><br>
                        </div>
                      </div>
                    </div>
                    <div class="gmail_extra"><br>
                      <div class="gmail_quote">On Thu, Oct 1, 2015 at
                        2:37 AM, Daniel-Constantin Mierla <span
                          dir="ltr"><<a moz-do-not-send="true"
                            href="mailto:miconda@gmail.com"
                            target="_blank">miconda@gmail.com</a>></span>
                        wrote:<br>
                        <blockquote class="gmail_quote" style="margin:0
                          0 0 .8ex;border-left:1px #ccc
                          solid;padding-left:1ex">
                          <div bgcolor="#FFFFFF" text="#000000"> The
                            first backtrace is related to pike. Can you
                            get from gdb of fisrt trace:<br>
                            <br>
                            frame 2<br>
                            p root->entries[b]<br>
                            <br>
                            Cheers,<br>
                            Daniel
                            <div>
                              <div><br>
                                <br>
                                <div>On 30/09/15 16:19, Jijo wrote:<br>
                                </div>
                              </div>
                            </div>
                            <blockquote type="cite">
                              <div>
                                <div>
                                  <div dir="ltr">I'm observing a
                                    segmentation fault when mongodb
                                    & tls enabled. It doesn't happen
                                    when one of the module is disabled.
                                    <div>
                                      <div><span
                                          style="font-size:12.8px">OS:
                                          centos 6.7   kamailio 4.3.2</span><span
                                          style="font-size:12.8px">  </span>mongo-c-driver


                                        version 1.1.10.</div>
                                      <div><br>
                                      </div>
                                      <div>It happens immediately after
                                        i register a subscriber. The
                                        location table is updated with
                                        the new data and in parallel
                                        core is generated as well.</div>
                                      <div><br>
                                      </div>
                                      <div><br>
                                      </div>
                                      <div>
                                        <div><br>
                                        </div>
                                        <div>Loaded symbols for /lib64/<a
                                            moz-do-not-send="true"
                                            href="http://libnss_dns-2.12.so"
                                            target="_blank">libnss_dns-2.12.so</a></div>
                                        <div>Core was generated by
                                          `/usr/local/kamailio_proxy/sbin/kamailio
                                          -f
                                          /usr/local/kamailio_proxy/etc/kamail'.</div>
                                        <div>Program terminated with
                                          signal 11, Segmentation fault.</div>
                                        <div>#0  0x00007fd3adf65e69 in
                                          atomic_cmpxchg_int
                                          (var=0x56444e3055445030,
                                          old=0, new_v=1) at
                                          ../../atomic/atomic_x86.h:233</div>
                                        <div>233<span style="white-space:pre-wrap">       </span>ATOMIC_FUNC_CMPXCHG(cmpxchg,


                                          "cmpxchgl %2, %1", int , int)</div>
                                        <div>Missing separate
                                          debuginfos, use:
                                          debuginfo-install
                                          cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64
                                          cyrus-sasl-plain-2.1.23-15.el6_6.2.x86_64

                                          db4-4.7.25-19.el6_6.x86_64
                                          keyutils-libs-1.4-5.el6.x86_64
                                          krb5-libs-1.10.3-42.el6.x86_64
                                          libcom_err-1.41.12-22.el6.x86_64

                                          libcurl-7.19.7-46.el6.x86_64
                                          libidn-1.18-2.el6.x86_64
                                          libselinux-2.0.94-5.8.el6.x86_64
                                          libssh2-1.4.2-1.el6_6.1.x86_64
                                          libunistring-0.9.3-5.el6.x86_64

                                          libxml2-2.7.6-20.el6.x86_64
                                          mysql-libs-5.1.73-5.el6_6.x86_64
                                          nspr-4.10.8-1.el6_6.x86_64
                                          nss-3.18.0-5.3.el6_6.x86_64
                                          nss-util-3.18.0-1.el6_6.x86_64
                                          openldap-2.4.40-5.el6.x86_64
                                          openssl-1.0.1e-42.el6.x86_64
                                          zlib-1.2.3-29.el6.x86_64</div>
                                        <div>(gdb) bt</div>
                                        <div>#0  0x00007fd3adf65e69 in
                                          atomic_cmpxchg_int
                                          (var=0x56444e3055445030,
                                          old=0, new_v=1) at
                                          ../../atomic/atomic_x86.h:233</div>
                                        <div>#1  0x00007fd3adf65eb6 in
                                          futex_get
                                          (lock=0x56444e3055445030) at
                                          ../../futexlock.h:99</div>
                                        <div>#2  0x00007fd3adf66468 in
                                          prv_lock_tree_branch (b=192
                                          '\300') at ip_tree.c:47</div>
                                        <div>#3  0x00007fd3adf664e5 in
                                          lock_tree_branch (b=192
                                          '\300') at ip_tree.c:66</div>
                                        <div>#4  0x00007fd3adf6dda6 in
                                          swap_routine (ticks=123206032,
                                          param=0x0) at pike_funcs.c:293</div>
                                        <div>#5  0x00000000005fef8e in
                                          compat_old_handler
                                          (ti=1971296512,
                                          tl=0x7fd32ccea430,
                                          data=0x7fd32ccea430) at
                                          timer.c:996</div>
                                        <div>#6  0x00000000005ff94c in
                                          slow_timer_main () at
                                          timer.c:1130</div>
                                        <div>#7  0x00000000004a8676 in
                                          main_loop () at main.c:1628</div>
                                        <div>#8  0x00000000004ae38e in
                                          main (argc=11,
                                          argv=0x7fff1d97ec28) at
                                          main.c:2533</div>
                                        <div>(gdb) </div>
                                      </div>
                                      <div><br>
                                      </div>
                                      <div><br>
                                      </div>
                                      <div>On Clean up after the core,
                                        mongo db does segmentation fault
                                        as well</div>
                                      <div><br>
                                      </div>
                                      <div>
                                        <div>Loaded symbols for /lib64/<a
                                            moz-do-not-send="true"
                                            href="http://libnss_files-2.12.so"
                                            target="_blank">libnss_files-2.12.so</a></div>
                                        <div>Reading symbols from
                                          /lib64/libnss_dns-2.12.so...Reading
                                          symbols from
                                          /usr/lib/debug/lib64/libnss_dns-2.12.so.debug...done.</div>
                                        <div>done.</div>
                                        <div>Loaded symbols for /lib64/<a
                                            moz-do-not-send="true"
                                            href="http://libnss_dns-2.12.so"
                                            target="_blank">libnss_dns-2.12.so</a></div>
                                        <div>Core was generated by
                                          `/usr/local/kamailio_proxy/sbin/kamailio
                                          -f
                                          /usr/local/kamailio_proxy/etc/kamail'.</div>
                                        <div>Program terminated with
                                          signal 11, Segmentation fault.</div>
                                        <div>#0  __pthread_mutex_destroy
                                          (mutex=0x7fd32cce7be8) at
                                          pthread_mutex_destroy.c:28</div>
                                        <div>28<span style="white-space:pre-wrap">        </span>
                                           if ((mutex->__data.__kind
                                          &
                                          PTHREAD_MUTEX_ROBUST_NORMAL_NP)
                                          == 0</div>
                                        <div>Missing separate
                                          debuginfos, use:
                                          debuginfo-install
                                          cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64
                                          cyrus-sasl-plain-2.1.23-15.el6_6.2.x86_64

                                          db4-4.7.25-19.el6_6.x86_64
                                          keyutils-libs-1.4-5.el6.x86_64
                                          krb5-libs-1.10.3-42.el6.x86_64
                                          libcom_err-1.41.12-22.el6.x86_64

                                          libcurl-7.19.7-46.el6.x86_64
                                          libidn-1.18-2.el6.x86_64
                                          libselinux-2.0.94-5.8.el6.x86_64
                                          libssh2-1.4.2-1.el6_6.1.x86_64
                                          libunistring-0.9.3-5.el6.x86_64

                                          libxml2-2.7.6-20.el6.x86_64
                                          mysql-libs-5.1.73-5.el6_6.x86_64
                                          nspr-4.10.8-1.el6_6.x86_64
                                          nss-3.18.0-5.3.el6_6.x86_64
                                          nss-util-3.18.0-1.el6_6.x86_64
                                          openldap-2.4.40-5.el6.x86_64
                                          openssl-1.0.1e-42.el6.x86_64
                                          zlib-1.2.3-29.el6.x86_64</div>
                                        <div>(gdb) bt</div>
                                        <div>#0  __pthread_mutex_destroy
                                          (mutex=0x7fd32cce7be8) at
                                          pthread_mutex_destroy.c:28</div>
                                        <div>#1  0x00007fd32c86f9e6 in
                                          _mongoc_ssl_thread_cleanup ()
                                          at src/mongoc/mongoc-ssl.c:555</div>
                                        <div>#2  _mongoc_ssl_cleanup ()
                                          at src/mongoc/mongoc-ssl.c:106</div>
                                        <div>#3  0x00007fd32c8606a9 in
                                          _mongoc_do_cleanup () at
                                          src/mongoc/mongoc-init.c:127</div>
                                        <div>#4  0x000000344480cdb3 in
                                          pthread_once () at
                                          ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_once.S:104</div>
                                        <div>#5  0x00007fd32c8523df in
                                          __do_global_dtors_aux () from
/usr/lib64/libmongoc-1.0.so.0.0.0</div>
                                        <div>#6  0x0000000000000000 in
                                          ?? ()</div>
                                        <div>(gdb) </div>
                                      </div>
                                      <div><br>
                                      </div>
                                      <div><br>
                                      </div>
                                      <div><br>
                                      </div>
                                      <div>mongo-c-driver version 1.1.10</div>
                                      <div><br>
                                      </div>
                                      <div>
                                        <div><span
                                            style="font-size:12.8px">version:

                                            kamailio 4.3.2
                                            (x86_64/linux) b5980b-dirty</span></div>
                                        <div><span
                                            style="font-size:12.8px">flags:

                                            STATS: Off, USE_TCP,
                                            USE_TLS, USE_SCTP,
                                            TLS_HOOKS, USE_RAW_SOCKS,
                                            DISABLE_NAGLE, USE_MCAST,
                                            DNS_IP_HACK, SHM_MEM,
                                            SHM_MMAP, PKG_MALLOC,
                                            F_MALLOC, DBG_F_MALLOC,
                                            USE_FUTEX,
                                            FAST_LOCK-ADAPTIVE_WAIT,
                                            USE_DNS_CACHE,
                                            USE_DNS_FAILOVER, USE_NAPTR,
                                            USE_DST_BLACKLIST,
                                            HAVE_RESOLV_RES</span></div>
                                        <div><span
                                            style="font-size:12.8px">ADAPTIVE_WAIT_LOOPS=1024,


                                            MAX_RECV_BUFFER_SIZE 262144,
                                            MAX_LISTEN 16, MAX_URI_SIZE
                                            1024, BUF_SIZE 65535,
                                            DEFAULT PKG_SIZE 8MB</span></div>
                                        <div><span
                                            style="font-size:12.8px">poll

                                            method support: poll,
                                            epoll_lt, epoll_et,
                                            sigio_rt, select.</span></div>
                                        <div><span
                                            style="font-size:12.8px">id:
                                            b5980b -dirty</span></div>
                                        <div><span
                                            style="font-size:12.8px">compiled

                                            on 13:35:24 Sep 28 2015 with
                                            gcc 4.</span></div>
                                      </div>
                                    </div>
                                  </div>
                                  <br>
                                  <fieldset></fieldset>
                                  <br>
                                </div>
                              </div>
                              <pre>_______________________________________________
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
<a moz-do-not-send="true" href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a>
<a moz-do-not-send="true" href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users</a><span><font color="#888888">
</font></span></pre>
                              <span><font color="#888888"> </font></span></blockquote>
                            <span><font color="#888888"> <br>
                                <pre cols="72">-- 
Daniel-Constantin Mierla
<a moz-do-not-send="true" href="http://twitter.com/#%21/miconda" target="_blank">http://twitter.com/#!/miconda</a> - <a moz-do-not-send="true" href="http://www.linkedin.com/in/miconda" target="_blank">http://www.linkedin.com/in/miconda</a>
Book: SIP Routing With Kamailio - <a moz-do-not-send="true" href="http://www.asipto.com" target="_blank">http://www.asipto.com</a>
Kamailio Advanced Training, Sep 28-30, 2015, in Berlin - <a moz-do-not-send="true" href="http://asipto.com/u/kat" target="_blank">http://asipto.com/u/kat</a></pre>
                              </font></span></div>
                          <br>
_______________________________________________<br>
                          SIP Express Router (SER) and Kamailio
                          (OpenSER) - sr-users mailing list<br>
                          <a moz-do-not-send="true"
                            href="mailto:sr-users@lists.sip-router.org"
                            target="_blank">sr-users@lists.sip-router.org</a><br>
                          <a moz-do-not-send="true"
                            href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users"
                            rel="noreferrer" target="_blank">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users</a><br>
                          <br>
                        </blockquote>
                      </div>
                      <br>
                    </div>
                  </blockquote>
                  <br>
                  <pre cols="72">-- 
Daniel-Constantin Mierla
<a moz-do-not-send="true" href="http://twitter.com/#%21/miconda" target="_blank">http://twitter.com/#!/miconda</a> - <a moz-do-not-send="true" href="http://www.linkedin.com/in/miconda" target="_blank">http://www.linkedin.com/in/miconda</a>
Book: SIP Routing With Kamailio - <a moz-do-not-send="true" href="http://www.asipto.com" target="_blank">http://www.asipto.com</a>
Kamailio Advanced Training, Sep 28-30, 2015, in Berlin - <a moz-do-not-send="true" href="http://asipto.com/u/kat" target="_blank">http://asipto.com/u/kat</a></pre>
                </div>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Daniel-Constantin Mierla
<a class="moz-txt-link-freetext" href="http://twitter.com/#!/miconda">http://twitter.com/#!/miconda</a> - <a class="moz-txt-link-freetext" href="http://www.linkedin.com/in/miconda">http://www.linkedin.com/in/miconda</a>
Book: SIP Routing With Kamailio - <a class="moz-txt-link-freetext" href="http://www.asipto.com">http://www.asipto.com</a>
Kamailio Advanced Training, Sep 28-30, 2015, in Berlin - <a class="moz-txt-link-freetext" href="http://asipto.com/u/kat">http://asipto.com/u/kat</a></pre>
  </body>
</html>