<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">Dan,<br>
There are two cores because of a crash in one process followed by
a crash when the other processes are trying to shutdown.<br>
<br>
What's interesting is that the bt doesn't show useful pointers. If
you have installed from RPMs make sure the kamailio-debuginfo is
from the same build as the other RPMs.<br>
<br>
Also, do the logs say anything? There should be a log entry from
the kernel for the segfault/signal that says which module crashed
(e.g. registrar.so) and possibly (hopefully) an error message just
before that.<br>
<br>
Hugh<br>
<br>
<br>
On 13/03/2014 19:53, Daniel Ciprus wrote:<br>
</div>
<blockquote cite="mid:53220CD3.3050503@acision.com" type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
Jason, <br>
<br>
I've tried multiple combinations for pattern but I'm getting only
2 core files ...
<br>
<br>
Details: <br>
<br>
~]# cat /proc/sys/kernel/core_pattern<br>
/tmp/core.%e.sig%s.%p<br>
<br>
~]# lsb_release -a<br>
LSB Version:
:base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch<br>
Distributor ID: RedHatEnterpriseServer<br>
Description: Red Hat Enterprise Linux Server release 6.5
(Santiago)<br>
Release: 6.5<br>
Codename: Santiago<br>
<br>
<br>
<br>
(gdb) bt<br>
#0 0x00000000005350b0 in ?? ()<br>
#1 0x000000000053542a in ?? ()<br>
#2 0x00000000005356c7 in timer_main ()<br>
#3 0x000000000046d572 in main_loop ()<br>
#4 0x000000000047030b in main ()<br>
(gdb) bt full<br>
#0 0x00000000005350b0 in ?? ()<br>
No symbol table info available.<br>
#1 0x000000000053542a in ?? ()<br>
No symbol table info available.<br>
#2 0x00000000005356c7 in timer_main ()<br>
No symbol table info available.<br>
#3 0x000000000046d572 in main_loop ()<br>
No symbol table info available.<br>
#4 0x000000000047030b in main ()<br>
No symbol table info available.<br>
(gdb)<br>
<br>
(gdb) bt<br>
#0 0x00000031ba432925 in raise () from /lib64/libc.so.6<br>
#1 0x00000031ba434105 in abort () from /lib64/libc.so.6<br>
#2 0x0000000000546750 in ?? ()<br>
#3 0x000000000054853a in qm_free ()<br>
#4 0x00007f23d98f87de in free_local_ack_unsafe
(lack=0x7f23d3319d70) at uac.c:600<br>
#5 0x00007f23d988ea57 in free_cell (dead_cell=0x7f23d3319a70) at
h_table.c:217<br>
#6 0x00007f23d988f2ee in free_hash_table () at h_table.c:441<br>
#7 0x00007f23d98a2fca in tm_shutdown () at t_funcs.c:122<br>
#8 0x00000000004f7c7a in destroy_modules ()<br>
#9 0x0000000000466e63 in cleanup ()<br>
#10 0x0000000000467f65 in ?? ()<br>
#11 0x0000000000469679 in handle_sigs ()<br>
#12 0x000000000046db19 in main_loop ()<br>
#13 0x000000000047030b in main ()<br>
(gdb) bt full<br>
#0 0x00000031ba432925 in raise () from /lib64/libc.so.6<br>
No symbol table info available.<br>
#1 0x00000031ba434105 in abort () from /lib64/libc.so.6<br>
No symbol table info available.<br>
#2 0x0000000000546750 in ?? ()<br>
No symbol table info available.<br>
#3 0x000000000054853a in qm_free ()<br>
No symbol table info available.<br>
#4 0x00007f23d98f87de in free_local_ack_unsafe
(lack=0x7f23d3319d70) at uac.c:600<br>
__FUNCTION__ = "free_local_ack_unsafe"<br>
#5 0x00007f23d988ea57 in free_cell (dead_cell=0x7f23d3319a70) at
h_table.c:217<br>
b = 0x0<br>
i = 0<br>
rpl = 0x0<br>
tt = 0x0<br>
foo = 0x2fd3221000<br>
cbs = 0x0<br>
cbs_tmp = 0x7f23d35386b8<br>
__FUNCTION__ = "free_cell"<br>
#6 0x00007f23d988f2ee in free_hash_table () at h_table.c:441<br>
p_cell = 0x7f23d3319a70<br>
tmp_cell = 0x7f23d353dca0<br>
i = 580<br>
__FUNCTION__ = "free_hash_table"<br>
#7 0x00007f23d98a2fca in tm_shutdown () at t_funcs.c:122<br>
__FUNCTION__ = "tm_shutdown"<br>
#8 0x00000000004f7c7a in destroy_modules ()<br>
No symbol table info available.<br>
#9 0x0000000000466e63 in cleanup ()<br>
No symbol table info available.<br>
#10 0x0000000000467f65 in ?? ()<br>
No symbol table info available.<br>
#11 0x0000000000469679 in handle_sigs ()<br>
No symbol table info available.<br>
#12 0x000000000046db19 in main_loop ()<br>
No symbol table info available.<br>
#13 0x000000000047030b in main ()<br>
No symbol table info available.<br>
(gdb) <br>
<br>
<br>
<br>
<div class="moz-cite-prefix">On 03/13/2014 02:58 PM, Jason Penton
wrote:<br>
</div>
<blockquote style="border-left: 2px solid #009900 !important;
border-right: 2px solid #009900 !important; padding: 0px 15px
0px 15px; margin: 8px 2px;"
cite="mid:CALoGXNWwF39XrOKL_GztZLqb-f3HjAy78Bs0O2wF9FFvqQqxLA@mail.gmail.com"
type="cite">
<!--[if !IE]><DIV style="border-left: 2px solid #009900; border-right: 2px solid #009900; padding: 0px 15px; margin: 2px 0px;"><![endif]-->
<div dir="ltr">I don't think these cores indicate the real
crash... I'd like to get some more detail on what actually
happened? Daniel, can you re-create? Keep in mind that if your
core dump config on your box is not configured to name your
cores according to process id or timestamp one core will
overwrite the other..... as a result you will never see the
core that is the root cause.
<div><br>
</div>
<div>Which OS are you running?</div>
<div><br>
</div>
<div>if Linux, I use the following in /etc/sysctl.conf:</div>
<div><br>
</div>
<div>kernel.core_pattern=/tmp/core.%e.%p.%h.%t<br>
</div>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Thu, Mar 13, 2014 at 8:45 PM,
Carsten Bock <span dir="ltr">
<<a moz-do-not-send="true"
href="mailto:carsten@ng-voice.com" target="_blank">carsten@ng-voice.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="">It looks a little bit like a "double free".<br>
<br>
You could try to disable the call to "abort()" in case
this happens:<br>
</div>
mem_safety=1<br>
See: <a moz-do-not-send="true"
href="http://www.kamailio.org/wiki/cookbooks/devel/core#mem_safety"
target="_blank">
http://www.kamailio.org/wiki/cookbooks/devel/core#mem_safety</a><br>
<br>
Kind regards,<br>
Carsten<br>
<br>
2014-03-13 19:44 GMT+01:00 Carsten Bock <<a
moz-do-not-send="true"
href="mailto:carsten@ng-voice.com">carsten@ng-voice.com</a>>:<br>
<div class="HOEnZb">
<div class="h5">> It looks a little bit like a
"double free".<br>
><br>
> You could try to disable the call to "abort()" in
case this happens:<br>
><br>
><br>
> 2014-03-13 17:22 GMT+01:00 Daniel Ciprus <<a
moz-do-not-send="true"
href="mailto:daniel.ciprus@acision.com">daniel.ciprus@acision.com</a>>:<br>
>> There are no more core files on the
filesystem :-(<br>
>><br>
>> On 03/13/2014 12:18 PM, Jason Penton wrote:<br>
>><br>
>> I'm afraid this is also not the correct core.
Can you check the timestamp on<br>
>> the cores? Can you re-create the crash and
send me the correct core?<br>
>><br>
>><br>
>><br>
>><br>
>> On Thu, Mar 13, 2014 at 5:36 PM, Daniel
Ciprus <<a moz-do-not-send="true"
href="mailto:daniel.ciprus@acision.com">daniel.ciprus@acision.com</a>><br>
>> wrote:<br>
>>><br>
>>> So I cleaned up my junkyard and I got 2
core files:<br>
>>><br>
>>> (gdb) bt<br>
>>> #0 0x00000000005350b0 in ?? ()<br>
>>> #1 0x000000000053542a in ?? ()<br>
>>> #2 0x00000000005356c7 in timer_main ()<br>
>>> #3 0x000000000046d572 in main_loop ()<br>
>>> #4 0x000000000047030b in main ()<br>
>>> (gdb) bt full<br>
>>> #0 0x00000000005350b0 in ?? ()<br>
>>><br>
>>> No symbol table info available.<br>
>>> #1 0x000000000053542a in ?? ()<br>
>>><br>
>>> No symbol table info available.<br>
>>> #2 0x00000000005356c7 in timer_main ()<br>
>>><br>
>>> No symbol table info available.<br>
>>> #3 0x000000000046d572 in main_loop ()<br>
>>><br>
>>> No symbol table info available.<br>
>>> #4 0x000000000047030b in main ()<br>
>>><br>
>>> No symbol table info available.<br>
>>> (gdb)<br>
>>><br>
>>><br>
>>> (gdb) bt full<br>
>>> #0 0x00000031ba432925 in raise () from
/lib64/libc.so.6<br>
>>> No symbol table info available.<br>
>>> #1 0x00000031ba434105 in abort () from
/lib64/libc.so.6<br>
>>> No symbol table info available.<br>
>>> #2 0x0000000000546750 in ?? ()<br>
>>> No symbol table info available.<br>
>>> #3 0x000000000054853a in qm_free ()<br>
>>> No symbol table info available.<br>
>>> #4 0x00007f5bf7d5a7de in
free_local_ack_unsafe (lack=0x7f5bf1894528) at<br>
>>> uac.c:600<br>
>>> __FUNCTION__ =
"free_local_ack_unsafe"<br>
>>> #5 0x00007f5bf7cf0a57 in free_cell
(dead_cell=0x7f5bf1894228) at<br>
>>> h_table.c:217<br>
>>><br>
>>> b = 0x0<br>
>>> i = 0<br>
>>> rpl = 0x0<br>
>>> tt = 0x0<br>
>>> foo = 0x2ff1683000<br>
>>> cbs = 0x0<br>
>>> cbs_tmp = 0x7f5bf198e508<br>
>>> __FUNCTION__ = "free_cell"<br>
>>> #6 0x00007f5bf7cf12ee in free_hash_table
() at h_table.c:441<br>
>>> p_cell = 0x7f5bf1894228<br>
>>> tmp_cell = 0x7f5bf1894228<br>
>>> i = 3533<br>
>>> __FUNCTION__ = "free_hash_table"<br>
>>> #7 0x00007f5bf7d04fca in tm_shutdown ()
at t_funcs.c:122<br>
>>><br>
>>> __FUNCTION__ = "tm_shutdown"<br>
>>> #8 0x00000000004f7c7a in destroy_modules
()<br>
>>> No symbol table info available.<br>
>>> #9 0x0000000000466e63 in cleanup ()<br>
>>> No symbol table info available.<br>
>>> #10 0x0000000000467f65 in ?? ()<br>
>>> No symbol table info available.<br>
>>> #11 0x0000000000469679 in handle_sigs ()<br>
>>> No symbol table info available.<br>
>>> #12 0x000000000046db19 in main_loop ()<br>
>>> No symbol table info available.<br>
>>> #13 0x000000000047030b in main ()<br>
>>> No symbol table info available.<br>
>>> (gdb)<br>
>>><br>
>>><br>
>>> On 03/13/2014 11:18 AM, Jason Penton
wrote:<br>
>>><br>
>>> Hi Daniel,<br>
>>><br>
>>> this is the wrong core file. This is the
one created on shutdown of<br>
>>> kamailio. Can you do a bt on the other
core file that you probably have...<br>
>>><br>
>>> Cheers<br>
>>> Jason<br>
>>><br>
>>><br>
>>> On Thu, Mar 13, 2014 at 5:05 PM, Daniel
Ciprus <<a moz-do-not-send="true"
href="mailto:daniel.ciprus@acision.com">daniel.ciprus@acision.com</a>><br>
>>> wrote:<br>
>>>><br>
>>>> Folks,<br>
>>>><br>
>>>> This is happening during the
registration on SCSCF.<br>
>>>><br>
>>>> Server:: kamailio (4.2.0-dev2
(x86_64/linux))<br>
>>>> Build:: mi_core.c compiled on
10:01:09 Mar 13 2014 with gcc 4.4.6<br>
>>>> Flags:: STATS: Off, USE_TCP, USE_TLS,
TLS_HOOKS, USE_RAW_SOCKS,<br>
>>>> DISABLE_NAGLE, USE_MCAST,
DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC,<br>
>>>> DBG_QM_MALLOC, USE_FUTEX,
FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE,<br>
>>>> USE_DNS_FAILOVER, USE_NAPTR,
USE_DST_BLACKLIST, HAVE_RESOLV_RES<br>
>>>> GIT:: unknown<br>
>>>> Now:: Thu Mar 13 11:04:47 2014<br>
>>>> Up since:: Thu Mar 13 10:58:12 2014<br>
>>>> Up time:: 395 [sec]<br>
>>>><br>
>>>> (gdb) bt<br>
>>>> #0 0x00000031ba432925 in raise ()
from /lib64/libc.so.6<br>
>>>> #1 0x00000031ba434105 in abort ()
from /lib64/libc.so.6<br>
>>>> #2 0x0000000000546750 in ?? ()<br>
>>>> #3 0x000000000054853a in qm_free ()<br>
>>>> #4 0x00007fb4def5b7de in
free_local_ack_unsafe (lack=0x7fb4d8b31728) at<br>
>>>> uac.c:600<br>
>>>> #5 0x00007fb4deef1a57 in free_cell
(dead_cell=0x7fb4d8b31428) at<br>
>>>> h_table.c:217<br>
>>>> #6 0x00007fb4deef22ee in
free_hash_table () at h_table.c:441<br>
>>>> #7 0x00007fb4def05fca in tm_shutdown
() at t_funcs.c:122<br>
>>>> #8 0x00000000004f7c7a in
destroy_modules ()<br>
>>>> #9 0x0000000000466e63 in cleanup ()<br>
>>>> #10 0x0000000000467f65 in ?? ()<br>
>>>> #11 0x0000000000469679 in handle_sigs
()<br>
>>>> #12 0x000000000046db19 in main_loop
()<br>
>>>> #13 0x000000000047030b in main ()<br>
>>>> (gdb) bt full<br>
>>>> #0 0x00000031ba432925 in raise ()
from /lib64/libc.so.6<br>
>>>> No symbol table info available.<br>
>>>> #1 0x00000031ba434105 in abort ()
from /lib64/libc.so.6<br>
>>>> No symbol table info available.<br>
>>>> #2 0x0000000000546750 in ?? ()<br>
>>>> No symbol table info available.<br>
>>>> #3 0x000000000054853a in qm_free ()<br>
>>>> No symbol table info available.<br>
>>>> #4 0x00007fb4def5b7de in
free_local_ack_unsafe (lack=0x7fb4d8b31728) at<br>
>>>> uac.c:600<br>
>>>> __FUNCTION__ =
"free_local_ack_unsafe"<br>
>>>> #5 0x00007fb4deef1a57 in free_cell
(dead_cell=0x7fb4d8b31428) at<br>
>>>> h_table.c:217<br>
>>>> b = 0x0<br>
>>>> i = 0<br>
>>>> rpl = 0x0<br>
>>>> tt = 0x0<br>
>>>> foo = 0x2fd8a8b000<br>
>>>> cbs = 0x0<br>
>>>> cbs_tmp = 0x7fb4d8d9c9e0<br>
>>>> __FUNCTION__ = "free_cell"<br>
>>>> #6 0x00007fb4deef22ee in
free_hash_table () at h_table.c:441<br>
>>>> p_cell = 0x7fb4d8b31428<br>
>>>> tmp_cell = 0x7fb4d8b31428<br>
>>>> i = 11517<br>
>>>> __FUNCTION__ =
"free_hash_table"<br>
>>>> #7 0x00007fb4def05fca in tm_shutdown
() at t_funcs.c:122<br>
>>>> __FUNCTION__ = "tm_shutdown"<br>
>>>> #8 0x00000000004f7c7a in
destroy_modules ()<br>
>>>> No symbol table info available.<br>
>>>> #9 0x0000000000466e63 in cleanup ()<br>
>>>> No symbol table info available.<br>
>>>> #10 0x0000000000467f65 in ?? ()<br>
>>>> No symbol table info available.<br>
>>>> #11 0x0000000000469679 in handle_sigs
()<br>
>>>> No symbol table info available.<br>
>>>> #12 0x000000000046db19 in main_loop
()<br>
>>>> No symbol table info available.<br>
>>>> #13 0x000000000047030b in main ()<br>
>>>> No symbol table info available.<br>
>>>> (gdb)<br>
>>>><br>
>>>><br>
>>>><br>
>>>><br>
>>>><br>
>>>> --<br>
>>>> Daniel Ciprus<br>
>>>> Integration engineer<br>
>>>> <a moz-do-not-send="true"
href="http://www.acision.com" target="_blank">http://www.acision.com</a><br>
>>>><br>
>>>> 9954 Mayland Dr<br>
>>>> Suite 3100<br>
>>>> Richmond, VA 23233<br>
>>>> USA<br>
>>>> T: <a moz-do-not-send="true"
href="tel:%2B1%20804%20762%205601"
value="+18047625601">
+1 804 762 5601</a><br>
>>>> E: <a moz-do-not-send="true"
href="mailto:daniel.ciprus@acision.com">daniel.ciprus@acision.com</a><br>
>>>><br>
>>>> ________________________________<br>
>>>> This e-mail and any attachment is for
authorised use by the intended<br>
>>>> recipient(s) only. It may contain
proprietary material, confidential<br>
>>>> information and/or be subject to
legal privilege. It should not be copied,<br>
>>>> disclosed to, retained or used by,
any other party. If you are not an<br>
>>>> intended recipient then please
promptly delete this e-mail and any<br>
>>>> attachment and all copies and inform
the sender. Thank you for<br>
>>>> understanding.<br>
>>>><br>
>>>><br>
>>>>
_______________________________________________<br>
>>>> sr-dev mailing list<br>
>>>> <a moz-do-not-send="true"
href="mailto:sr-dev@lists.sip-router.org">sr-dev@lists.sip-router.org</a><br>
>>>> <a moz-do-not-send="true"
href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-dev"
target="_blank">
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-dev</a><br>
>>>><br>
>>><br>
>>><br>
>>> --<br>
>>> Daniel Ciprus<br>
>>> Integration engineer<br>
>>> <a moz-do-not-send="true"
href="http://www.acision.com" target="_blank">http://www.acision.com</a><br>
>>><br>
>>> 9954 Mayland Dr<br>
>>> Suite 3100<br>
>>> Richmond, VA 23233<br>
>>> USA<br>
>>> T: <a moz-do-not-send="true"
href="tel:%2B1%20804%20762%205601"
value="+18047625601">
+1 804 762 5601</a><br>
>>> E: <a moz-do-not-send="true"
href="mailto:daniel.ciprus@acision.com">daniel.ciprus@acision.com</a><br>
>>><br>
>>> ________________________________<br>
>>> This e-mail and any attachment is for
authorised use by the intended<br>
>>> recipient(s) only. It may contain
proprietary material, confidential<br>
>>> information and/or be subject to legal
privilege. It should not be copied,<br>
>>> disclosed to, retained or used by, any
other party. If you are not an<br>
>>> intended recipient then please promptly
delete this e-mail and any<br>
>>> attachment and all copies and inform the
sender. Thank you for<br>
>>> understanding.<br>
>>><br>
>>><br>
>>>
_______________________________________________<br>
>>> sr-dev mailing list<br>
>>> <a moz-do-not-send="true"
href="mailto:sr-dev@lists.sip-router.org">sr-dev@lists.sip-router.org</a><br>
>>> <a moz-do-not-send="true"
href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-dev"
target="_blank">
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-dev</a><br>
>>><br>
>><br>
>><br>
>> --<br>
>> Daniel Ciprus<br>
>> Integration engineer<br>
>> <a moz-do-not-send="true"
href="http://www.acision.com" target="_blank">http://www.acision.com</a><br>
>><br>
>> 9954 Mayland Dr<br>
>> Suite 3100<br>
>> Richmond, VA 23233<br>
>> USA<br>
>> T: <a moz-do-not-send="true"
href="tel:%2B1%20804%20762%205601"
value="+18047625601">
+1 804 762 5601</a><br>
>> E: <a moz-do-not-send="true"
href="mailto:daniel.ciprus@acision.com">daniel.ciprus@acision.com</a><br>
>><br>
>> ________________________________<br>
>> This e-mail and any attachment is for
authorised use by the intended<br>
>> recipient(s) only. It may contain proprietary
material, confidential<br>
>> information and/or be subject to legal
privilege. It should not be copied,<br>
>> disclosed to, retained or used by, any other
party. If you are not an<br>
>> intended recipient then please promptly
delete this e-mail and any<br>
>> attachment and all copies and inform the
sender. Thank you for<br>
>> understanding.<br>
>><br>
>><br>
>>
_______________________________________________<br>
>> sr-dev mailing list<br>
>> <a moz-do-not-send="true"
href="mailto:sr-dev@lists.sip-router.org">sr-dev@lists.sip-router.org</a><br>
>> <a moz-do-not-send="true"
href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-dev"
target="_blank">
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-dev</a><br>
>><br>
><br>
><br>
><br>
> --<br>
> Carsten Bock<br>
> CEO (Geschäftsführer)<br>
><br>
> ng-voice GmbH<br>
> Schomburgstr. 80<br>
> D-22767 Hamburg / Germany<br>
><br>
> <a moz-do-not-send="true"
href="http://www.ng-voice.com" target="_blank">http://www.ng-voice.com</a><br>
> mailto:<a moz-do-not-send="true"
href="mailto:carsten@ng-voice.com">carsten@ng-voice.com</a><br>
><br>
> Office <a moz-do-not-send="true"
href="tel:%2B49%2040%2034927219"
value="+494034927219">
+49 40 34927219</a><br>
> Fax <a moz-do-not-send="true"
href="tel:%2B49%2040%2034927220"
value="+494034927220">
+49 40 34927220</a><br>
><br>
> Sitz der Gesellschaft: Hamburg<br>
> Registergericht: Amtsgericht Hamburg, HRB 120189<br>
> Geschäftsführer: Carsten Bock<br>
> Ust-ID: DE279344284<br>
><br>
> Hier finden Sie unsere handelsrechtlichen
Pflichtangaben:<br>
> <a moz-do-not-send="true"
href="http://www.ng-voice.com/imprint/"
target="_blank">
http://www.ng-voice.com/imprint/</a><br>
<br>
<br>
<br>
--<br>
Carsten Bock<br>
CEO (Geschäftsführer)<br>
<br>
ng-voice GmbH<br>
Schomburgstr. 80<br>
D-22767 Hamburg / Germany<br>
<br>
<a moz-do-not-send="true"
href="http://www.ng-voice.com" target="_blank">http://www.ng-voice.com</a><br>
mailto:<a moz-do-not-send="true"
href="mailto:carsten@ng-voice.com">carsten@ng-voice.com</a><br>
<br>
Office <a moz-do-not-send="true"
href="tel:%2B49%2040%2034927219"
value="+494034927219">
+49 40 34927219</a><br>
Fax <a moz-do-not-send="true"
href="tel:%2B49%2040%2034927220"
value="+494034927220">
+49 40 34927220</a><br>
<br>
Sitz der Gesellschaft: Hamburg<br>
Registergericht: Amtsgericht Hamburg, HRB 120189<br>
Geschäftsführer: Carsten Bock<br>
Ust-ID: DE279344284<br>
<br>
Hier finden Sie unsere handelsrechtlichen
Pflichtangaben:<br>
<a moz-do-not-send="true"
href="http://www.ng-voice.com/imprint/"
target="_blank">http://www.ng-voice.com/imprint/</a><br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
<!--[if !IE]></DIV><![endif]--></blockquote>
<br>
<div class="moz-signature">-- <br>
<b>Daniel Ciprus</b><br>
Integration engineer<br>
<a moz-do-not-send="true" href="http://www.acision.com">http://www.acision.com</a><br>
<br>
9954 Mayland Dr<br>
Suite 3100<br>
Richmond, VA 23233<br>
USA<br>
T: +1 804 762 5601<br>
E: <a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:daniel.ciprus@acision.com">daniel.ciprus@acision.com</a><br>
</div>
<br>
<hr>
<font size="1" color="Gray" face="Arial">This e-mail and any
attachment is for authorised use by the intended recipient(s)
only. It may contain proprietary material, confidential
information and/or be subject to legal privilege. It should not
be copied, disclosed to, retained or used by, any other party.
If you are not an intended recipient then please promptly delete
this e-mail and any attachment and all copies and inform the
sender. Thank you for understanding.<br>
</font>
<br clear="all">
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
sr-dev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:sr-dev@lists.sip-router.org">sr-dev@lists.sip-router.org</a>
<a class="moz-txt-link-freetext" href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-dev">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-dev</a>
</pre>
</blockquote>
<br>
<br>
<pre class="moz-signature" cols="72">--
Hugh Waite
Principal Design Engineer
Crocodile RCS Ltd.</pre>
</body>
</html>