<div dir="ltr"><div><div><div><div>Hi All,<br><br></div>We have solved this issue now. The problem was the wrong interpretation of the Kamailio Makefile.defs makefile;<br><br>The
ARCH script variable was set to a wrong string by our higher level
makefile. Ea; for powerPC, Kamilio.defs expects 'ppc' as the value while
the higher level makefile sets the ARCH variable to 'powerpc'. So
Kamailio was compiled with wrong and missing GCC arguments. Also some
C-defines were not set correctly which resulted in linking wrong
'locking' routines, like atomic_unknown.h. Instead atomic_ppc.h should
be linked/compiled.<br>
<br></div>Thanks for your support anyway.<br><br></div>Best regards,<br></div>Orhan Yilmaz</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Nov 29, 2013 at 3:02 PM, Daniel-Constantin Mierla <span dir="ltr"><<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Attaching with gdb and getting the backtrace (as Ovidiu said), will be very useful<br>
<br>
The function futex_wait_queue_me() is from kernel, so it might be an operation from the kernel about reading the udp packages. So we cannot tell without the full trace if a kamailio function is blocking the futex or is other standard library function.<br>
<br>
I wanted to mention also that poll methods are for tcp only, for udp kamailio uses recvfrom().<br>
<br>
Can you also provide the output for 'kamailio -I' (that's upper case i)?<br>
<br>
Cheers,<br>
Daniel<div class="HOEnZb"><div class="h5"><br>
<br>
<br>
On 11/27/13 4:44 PM, Ovidiu Sas wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Try to attach gdb to the kamailio processes and run a full backtrace.<br>
<br>
Regards,<br>
Ovidiu Sas<br>
<br>
On Wed, Nov 27, 2013 at 5:16 AM, Sotas Development <<a href="mailto:sotasdev@gmail.com" target="_blank">sotasdev@gmail.com</a>> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi,<br>
<br>
In the mean time we have gathered more information on this problem:<br>
<br>
As given below, kamailio stops grabbing UDP SIP messages (SIP registrations)<br>
after running a while on an embedded ARM and PPC platform (which runs linux<br>
2.6.33 kernel). Some times the hangup occures within hours and some times<br>
after couple of days running.<br>
<br>
NETSTAT OUTPUT:<br>
root# netstat -pl | grep kam<br>
udp 1047968 0 (null):sip (null):*<br>
8416/kamailio<br>
raw 0 0 (null):255 (null):* 255<br>
8416/kamailio<br>
unix 2 [ ACC ] STREAM LISTENING 755205 8429/kamailio<br>
/tmp/kamailio_ctl<br>
<br>
Kamailio is started with the following options = -m 4 -n 3 -f <cfg> -D<br>
<br>
Other relevant info:<br>
- When Kamailio hangs, I also noticed that the flag "inuse_transactions" has<br>
always the value of '1'. Readout with "kamctl monitor".<br>
- A simple cat to /proc/<kamailio_pid>/wchan gives us the function:<br>
futex_wait_queue_me.<br>
- All possible polling methods are used with -W parameter (sigio_rt, poll,<br>
select etc) during these tests. Non of these options did solve this problem.<br>
<br>
I hope the additional info will clarify more. Thanks in advance.<br>
<br>
Best regards,<br>
Orhan Yilmaz<br>
<br>
<br>
<br>
On Wed, Nov 13, 2013 at 6:12 PM, Ovidiu Sas <<a href="mailto:osas@voipembedded.com" target="_blank">osas@voipembedded.com</a>> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
In a previous e-mail, you posted a warning that you had while compiling:<br>
"no native memory barrier implementations, falling back to slow lock<br>
based workarround"<br>
which means that you are already running without atomic locks.<br>
<br>
Regards,<br>
Ovidiu Sas<br>
<br>
On Wed, Nov 13, 2013 at 10:40 AM, Sotas Development <<a href="mailto:sotasdev@gmail.com" target="_blank">sotasdev@gmail.com</a>><br>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi,<br>
<br>
Here's an update of this topic. We've tried again with the latest stable<br>
version 4.0.4. Unfortunately the problem still exists.<br>
<br>
In mails above it is mentioned to use kamailio without atomic locks. How<br>
do<br>
we this (e.g. which makefile options)?<br>
<br>
Kind regards,<br>
<br>
Bert<br>
(on behalf of Michiel Veldkamp)<br>
<br>
<br>
<br>
On Mon, Jan 28, 2013 at 4:44 PM, Ovidiu Sas <<a href="mailto:osas@voipembedded.com" target="_blank">osas@voipembedded.com</a>><br>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
4.0 (current trunk) is in code freeze. I would suggest to test the<br>
trunk version (next 4.0).<br>
Even openser 1.3 requires patches to be properly cross compiled.<br>
<br>
Regards,<br>
Ovidiu Sas<br>
<br>
--<br>
VoIP Embedded, Inc.<br>
<a href="http://www.voipembedded.com" target="_blank">http://www.voipembedded.com</a><br>
<br>
---------- Forwarded message ----------<br>
From: Sotas Development <<a href="mailto:sotasdev@gmail.com" target="_blank">sotasdev@gmail.com</a>><br>
Date: Mon, Jan 28, 2013 at 10:08 AM<br>
Subject: Re: [SR-Users] Kamailio stability/timing problem w.r.t.<br>
registrations?<br>
To: "SIP Router - Kamailio (OpenSER) and SIP Express Router (SER) -<br>
Users Mailing List" <<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a><u></u>><br>
<br>
<br>
Hi Ovidiu,<br>
<br>
Thanks for the warning! We did not yet have much success running the<br>
current master branch, though this may well be a resource problem on<br>
the target platform.<br>
<br>
For the moment, we decided to switch back to openser 1.3.5 and wait<br>
for the official 4.0 release.<br>
<br>
Regards,<br>
Michiel Veldkamp<br>
<br>
<br>
On Thu, Jan 17, 2013 at 7:01 PM, Ovidiu Sas <<a href="mailto:osas@voipembedded.com" target="_blank">osas@voipembedded.com</a>><br>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
If you are running the stable version, there's need for heavy<br>
Makefile<br>
patching in order to properly cross compile (not to include and link<br>
to host libs).<br>
The trunk has everything fixed and it's cross-compiling properly for<br>
most of the modules.<br>
Make sure that your binaries are properly cross compiled.<br>
<br>
Depending on your ARM CPU, atomic locks may or may not work.<br>
I tested openser without atomic locks (using regular locks) and it<br>
worked fine.<br>
<br>
Regards,<br>
Ovidiu Sas<br>
<br>
<br>
--<br>
VoIP Embedded, Inc.<br>
<a href="http://www.voipembedded.com" target="_blank">http://www.voipembedded.com</a><br>
</blockquote>
______________________________<u></u>_________________<br>
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list<br>
<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a><br>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/<u></u>cgi-bin/mailman/listinfo/sr-<u></u>users</a><br>
</blockquote>
<br>
<br>
______________________________<u></u>_________________<br>
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list<br>
<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a><br>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/<u></u>cgi-bin/mailman/listinfo/sr-<u></u>users</a><br>
<br>
</blockquote>
<br>
<br>
--<br>
VoIP Embedded, Inc.<br>
<a href="http://www.voipembedded.com" target="_blank">http://www.voipembedded.com</a><br>
<br>
______________________________<u></u>_________________<br>
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list<br>
<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a><br>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/<u></u>cgi-bin/mailman/listinfo/sr-<u></u>users</a><br>
</blockquote>
<br>
<br>
______________________________<u></u>_________________<br>
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list<br>
<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a><br>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/<u></u>cgi-bin/mailman/listinfo/sr-<u></u>users</a><br>
<br>
</blockquote>
<br>
<br>
</blockquote>
<br>
-- <br></div></div><div class="HOEnZb"><div class="h5">
Daniel-Constantin Mierla - <a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a><br>
<a href="http://twitter.com/#!/miconda" target="_blank">http://twitter.com/#!/miconda</a> - <a href="http://www.linkedin.com/in/miconda" target="_blank">http://www.linkedin.com/in/<u></u>miconda</a><br>
<br>
</div></div></blockquote></div><br></div>