<div dir="ltr"><div>Hi Daniel,<br><br></div>Here is the output. <br><br>(gdb) p *shm_block<br>$1 = {size = 268435456, used = 4889264, real_used = 5313920,<br> max_real_used = 8245552, first_frag = 0x7f5394df3830,<br> last_frag_end = 0x7f53a4de8ff0, free_hash = {{head = {size = 0, u = {<br>
nxt_free = 0x7f539524ed60, is_free = 139996961238368}}, tail = {<br> size = 0, prev_free = 0x7f5395178340}, no = 29}, {head = {size = 0,<br> u = {nxt_free = 0x7f53951cd4c0, is_free = 139996960707776}}, tail = {<br>
size = 0, prev_free = 0x7f53952e4170}, no = 65}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9080, is_free = 139996956627072}}, tail = {<br> size = 0, prev_free = 0x7f5394de9080}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f539537c110, is_free = 139996962472208}}, tail = {<br> size = 0, prev_free = 0x7f53953b4470}, no = 307}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395220d30, is_free = 139996961049904}}, tail = {<br>
size = 0, prev_free = 0x7f53952a7410}, no = 125}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de90f8, is_free = 139996956627192}}, tail = {<br> size = 0, prev_free = 0x7f5394de90f8}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53951a1920, is_free = 139996960528672}}, tail = {<br> size = 0, prev_free = 0x7f5395387aa0}, no = 29}, {head = {size = 0,<br> u = {nxt_free = 0x7f53951cdc40, is_free = 139996960709696}}, tail = {<br>
size = 0, prev_free = 0x7f53954325f0}, no = 44}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395311110, is_free = 139996962033936}}, tail = {<br> size = 0, prev_free = 0x7f5395175d20}, no = 48}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de9198, is_free = 139996956627352}}, tail = {<br> size = 0, prev_free = 0x7f5394de9198}, no = 0}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f5394de91c0, is_free = 139996956627392}}, tail = {<br> size = 0, prev_free = 0x7f5394de91c0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de91e8, is_free = 139996956627432}}, tail = {<br>
size = 0, prev_free = 0x7f5394de91e8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9210, is_free = 139996956627472}}, tail = {<br> size = 0, prev_free = 0x7f5394de9210}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53952b1920, is_free = 139996961642784}}, tail = {<br> size = 0, prev_free = 0x7f539531ac30}, no = 27}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9260, is_free = 139996956627552}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9260}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9288, is_free = 139996956627592}}, tail = {<br> size = 0, prev_free = 0x7f5394de9288}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395231960, is_free = 139996961118560}}, tail = {<br> size = 0, prev_free = 0x7f53952f4c10}, no = 20}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395401440, is_free = 139996963017792}}, tail = {<br>
size = 0, prev_free = 0x7f5395324f90}, no = 31}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395471770, is_free = 139996963477360}}, tail = {<br> size = 0, prev_free = 0x7f539522a180}, no = 11}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395253e60, is_free = 139996961259104}}, tail = {<br> size = 0, prev_free = 0x7f5395253e60}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9350, is_free = 139996956627792}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9350}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f539523afc0, is_free = 139996961157056}}, tail = {<br>---Type <return> to continue, or q <return> to quit---<br>
size = 0, prev_free = 0x7f539540bd70}, no = 4}, {head = {size = 0,<br> u = {nxt_free = 0x7f539528b7e0, is_free = 139996961486816}}, tail = {<br> size = 0, prev_free = 0x7f53952602c0}, no = 6}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de93c8, is_free = 139996956627912}}, tail = {<br> size = 0, prev_free = 0x7f5394de93c8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de93f0, is_free = 139996956627952}}, tail = {<br>
size = 0, prev_free = 0x7f5394de93f0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9418, is_free = 139996956627992}}, tail = {<br> size = 0, prev_free = 0x7f5394de9418}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de9440, is_free = 139996956628032}}, tail = {<br> size = 0, prev_free = 0x7f5394de9440}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f53951de260, is_free = 139996960776800}}, tail = {<br>
size = 0, prev_free = 0x7f53951de260}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9490, is_free = 139996956628112}}, tail = {<br> size = 0, prev_free = 0x7f5394de9490}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de94b8, is_free = 139996956628152}}, tail = {<br> size = 0, prev_free = 0x7f5394de94b8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395339790, is_free = 139996962199440}}, tail = {<br>
size = 0, prev_free = 0x7f5395339790}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395485bc0, is_free = 139996963560384}}, tail = {<br> size = 0, prev_free = 0x7f53953ee1d0}, no = 3}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53953ba130, is_free = 139996962726192}}, tail = {<br> size = 0, prev_free = 0x7f53952aa6e0}, no = 6}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f539525b350, is_free = 139996961289040}}, tail = {<br> size = 0, prev_free = 0x7f53954711e0}, no = 40}, {head = {size = 0,<br> u = {nxt_free = 0x7f539542b650, is_free = 139996963190352}}, tail = {<br>
size = 0, prev_free = 0x7f53951c06e0}, no = 6}, {head = {size = 0,<br> u = {nxt_free = 0x7f53953b3340, is_free = 139996962698048}}, tail = {<br> size = 0, prev_free = 0x7f53952b8330}, no = 11}, {head = {size = 0,<br>
u = {nxt_free = 0x7f539546daa0, is_free = 139996963461792}}, tail = {<br> size = 0, prev_free = 0x7f53953b13f0}, no = 54}, {head = {size = 0,<br> u = {nxt_free = 0x7f53952b98b0, is_free = 139996961675440}}, tail = {<br>
size = 0, prev_free = 0x7f53952bb0d0}, no = 98}, {head = {size = 0,<br> u = {nxt_free = 0x7f53950de6b0, is_free = 139996959729328}}, tail = {<br> size = 0, prev_free = 0x7f539526d3a0}, no = 3}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395485dd0, is_free = 139996963560912}}, tail = {<br> size = 0, prev_free = 0x7f53953030c0}, no = 2}, {head = {size = 0,<br> u = {nxt_free = 0x7f53953fe1c0, is_free = 139996963004864}}, tail = {<br>
size = 0, prev_free = 0x7f5395345870}, no = 2}, {head = {size = 0,<br> u = {nxt_free = 0x7f53951ff540, is_free = 139996960912704}}, tail = {<br> size = 0, prev_free = 0x7f5395368ad0}, no = 3}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395235d10, is_free = 139996961135888}}, tail = {<br> size = 0, prev_free = 0x7f539546e180}, no = 7}, {head = {size = 0,<br> u = {nxt_free = 0x7f53952e7dd0, is_free = 139996961865168}}, tail = {<br>
size = 0, prev_free = 0x7f53954602a0}, no = 3}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9710, is_free = 139996956628752}}, tail = {<br>---Type <return> to continue, or q <return> to quit---<br>
size = 0, prev_free = 0x7f5394de9710}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9738, is_free = 139996956628792}}, tail = {<br> size = 0, prev_free = 0x7f5394de9738}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53954b00d0, is_free = 139996963733712}}, tail = {<br> size = 0, prev_free = 0x7f53954d4790}, no = 5}, {head = {size = 0,<br> u = {nxt_free = 0x7f539536b9b0, is_free = 139996962404784}}, tail = {<br>
size = 0, prev_free = 0x7f5395334930}, no = 3}, {head = {size = 0,<br> u = {nxt_free = 0x7f539537c720, is_free = 139996962473760}}, tail = {<br> size = 0, prev_free = 0x7f539528bc30}, no = 14}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395339460, is_free = 139996962198624}}, tail = {<br> size = 0, prev_free = 0x7f5395353dd0}, no = 8}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9800, is_free = 139996956628992}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9800}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395432180, is_free = 139996963217792}}, tail = {<br> size = 0, prev_free = 0x7f5395432180}, no = 1}, {head = {size = 0,<br>
u = {nxt_free = 0x7f539528cc00, is_free = 139996961491968}}, tail = {<br> size = 0, prev_free = 0x7f5395210520}, no = 3}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9878, is_free = 139996956629112}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9878}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395206a20, is_free = 139996960942624}}, tail = {<br> size = 0, prev_free = 0x7f5395206a20}, no = 1}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de98c8, is_free = 139996956629192}}, tail = {<br> size = 0, prev_free = 0x7f5394de98c8}, no = 0}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f5394de98f0, is_free = 139996956629232}}, tail = {<br> size = 0, prev_free = 0x7f5394de98f0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9918, is_free = 139996956629272}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9918}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9940, is_free = 139996956629312}}, tail = {<br> size = 0, prev_free = 0x7f5394de9940}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de9968, is_free = 139996956629352}}, tail = {<br> size = 0, prev_free = 0x7f5394de9968}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9990, is_free = 139996956629392}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9990}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de99b8, is_free = 139996956629432}}, tail = {<br> size = 0, prev_free = 0x7f5394de99b8}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de99e0, is_free = 139996956629472}}, tail = {<br> size = 0, prev_free = 0x7f5394de99e0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9a08, is_free = 139996956629512}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9a08}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9a30, is_free = 139996956629552}}, tail = {<br> size = 0, prev_free = 0x7f5394de9a30}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de9a58, is_free = 139996956629592}}, tail = {<br> size = 0, prev_free = 0x7f5394de9a58}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9a80, is_free = 139996956629632}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9a80}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9aa8, is_free = 139996956629672}}, tail = {<br>---Type <return> to continue, or q <return> to quit---<br>
size = 0, prev_free = 0x7f5394de9aa8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9ad0, is_free = 139996956629712}}, tail = {<br> size = 0, prev_free = 0x7f5394de9ad0}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de9af8, is_free = 139996956629752}}, tail = {<br> size = 0, prev_free = 0x7f5394de9af8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f539530a5d0, is_free = 139996962006480}}, tail = {<br>
size = 0, prev_free = 0x7f539530a5d0}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9b48, is_free = 139996956629832}}, tail = {<br> size = 0, prev_free = 0x7f5394de9b48}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395410d00, is_free = 139996963081472}}, tail = {<br> size = 0, prev_free = 0x7f53954ce130}, no = 10}, {head = {size = 0,<br> u = {nxt_free = 0x7f53951b3380, is_free = 139996960600960}}, tail = {<br>
size = 0, prev_free = 0x7f5395419370}, no = 2}, {head = {size = 0,<br> u = {nxt_free = 0x7f53953d9c30, is_free = 139996962855984}}, tail = {<br> size = 0, prev_free = 0x7f5395430a00}, no = 20}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de9be8, is_free = 139996956629992}}, tail = {<br> size = 0, prev_free = 0x7f5394de9be8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f539543b400, is_free = 139996963255296}}, tail = {<br>
size = 0, prev_free = 0x7f53954362d0}, no = 12}, {head = {size = 0,<br> u = {nxt_free = 0x7f539521f2d0, is_free = 139996961043152}}, tail = {<br> size = 0, prev_free = 0x7f539531a740}, no = 51}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53954d1db0, is_free = 139996963872176}}, tail = {<br> size = 0, prev_free = 0x7f53954ef540}, no = 326}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f53954bd450, is_free = 139996963787856}}, tail = {<br> size = 0, prev_free = 0x7f53954227e0}, no = 10}, {head = {size = 0,<br> u = {nxt_free = 0x7f53954154c0, is_free = 139996963099840}}, tail = {<br>
size = 0, prev_free = 0x7f53954cc7f0}, no = 12}, {head = {size = 0,<br> u = {nxt_free = 0x7f539531d6e0, is_free = 139996962084576}}, tail = {<br> size = 0, prev_free = 0x7f5395476b50}, no = 2}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395427580, is_free = 139996963173760}}, tail = {<br> size = 0, prev_free = 0x7f5395205410}, no = 3}, {head = {size = 0,<br> u = {nxt_free = 0x7f53953dc290, is_free = 139996962865808}}, tail = {<br>
size = 0, prev_free = 0x7f53954869a0}, no = 10}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9d50, is_free = 139996956630352}}, tail = {<br> size = 0, prev_free = 0x7f5394de9d50}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394de9d78, is_free = 139996956630392}}, tail = {<br> size = 0, prev_free = 0x7f5394de9d78}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395550770, is_free = 139996964390768}}, tail = {<br>
size = 0, prev_free = 0x7f53953a7ce0}, no = 5}, {head = {size = 0,<br> u = {nxt_free = 0x7f53952257e0, is_free = 139996961069024}}, tail = {<br> size = 0, prev_free = 0x7f53952257e0}, no = 1}, {head = {size = 0,<br>
u = {nxt_free = 0x7f539534fcc0, is_free = 139996962290880}}, tail = {<br> size = 0, prev_free = 0x7f539528bf50}, no = 6}, {head = {size = 0,<br> u = {nxt_free = 0x7f539529f880, is_free = 139996961568896}}, tail = {<br>
size = 0, prev_free = 0x7f539529f880}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f539544bd70, is_free = 139996963323248}}, tail = {<br>---Type <return> to continue, or q <return> to quit---<br>
size = 0, prev_free = 0x7f539536f510}, no = 2}, {head = {size = 0,<br> u = {nxt_free = 0x7f539544d230, is_free = 139996963328560}}, tail = {<br> size = 0, prev_free = 0x7f53951de920}, no = 3}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53953537f0, is_free = 139996962306032}}, tail = {<br> size = 0, prev_free = 0x7f53955caa40}, no = 3}, {head = {size = 0,<br> u = {nxt_free = 0x7f53952d99f0, is_free = 139996961806832}}, tail = {<br>
size = 0, prev_free = 0x7f53952d99f0}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9ee0, is_free = 139996956630752}}, tail = {<br> size = 0, prev_free = 0x7f5394de9ee0}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53954d0380, is_free = 139996963865472}}, tail = {<br> size = 0, prev_free = 0x7f53954d0380}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395374320, is_free = 139996962439968}}, tail = {<br>
size = 0, prev_free = 0x7f5395374320}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f53951ffb30, is_free = 139996960914224}}, tail = {<br> size = 0, prev_free = 0x7f53951ffb30}, no = 1}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53954d53d0, is_free = 139996963886032}}, tail = {<br> size = 0, prev_free = 0x7f5395221e10}, no = 3}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9fa8, is_free = 139996956630952}}, tail = {<br>
size = 0, prev_free = 0x7f5394de9fa8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394de9fd0, is_free = 139996956630992}}, tail = {<br> size = 0, prev_free = 0x7f5394de9fd0}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395329030, is_free = 139996962132016}}, tail = {<br> size = 0, prev_free = 0x7f53952191f0}, no = 2}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f53954b42e0, is_free = 139996963750624}}, tail = {<br> size = 0, prev_free = 0x7f53954b42e0}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea048, is_free = 139996956631112}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea048}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395471b20, is_free = 139996963478304}}, tail = {<br> size = 0, prev_free = 0x7f5395471b20}, no = 1}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea098, is_free = 139996956631192}}, tail = {<br> size = 0, prev_free = 0x7f5394dea098}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea0c0, is_free = 139996956631232}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea0c0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea0e8, is_free = 139996956631272}}, tail = {<br> size = 0, prev_free = 0x7f5394dea0e8}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea110, is_free = 139996956631312}}, tail = {<br> size = 0, prev_free = 0x7f5394dea110}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea138, is_free = 139996956631352}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea138}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea160, is_free = 139996956631392}}, tail = {<br> size = 0, prev_free = 0x7f5394dea160}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea188, is_free = 139996956631432}}, tail = {<br> size = 0, prev_free = 0x7f5394dea188}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea1b0, is_free = 139996956631472}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea1b0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea1d8, is_free = 139996956631512}}, tail = {<br>---Type <return> to continue, or q <return> to quit---<br>
size = 0, prev_free = 0x7f5394dea1d8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f53952ad000, is_free = 139996961624064}}, tail = {<br> size = 0, prev_free = 0x7f53952ad000}, no = 1}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea228, is_free = 139996956631592}}, tail = {<br> size = 0, prev_free = 0x7f5394dea228}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f539554c700, is_free = 139996964374272}}, tail = {<br>
size = 0, prev_free = 0x7f53954465f0}, no = 2}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea278, is_free = 139996956631672}}, tail = {<br> size = 0, prev_free = 0x7f5394dea278}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53955cb020, is_free = 139996964892704}}, tail = {<br> size = 0, prev_free = 0x7f53955cb020}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea2c8, is_free = 139996956631752}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea2c8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea2f0, is_free = 139996956631792}}, tail = {<br> size = 0, prev_free = 0x7f5394dea2f0}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea318, is_free = 139996956631832}}, tail = {<br> size = 0, prev_free = 0x7f5394dea318}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea340, is_free = 139996956631872}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea340}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea368, is_free = 139996956631912}}, tail = {<br> size = 0, prev_free = 0x7f5394dea368}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea390, is_free = 139996956631952}}, tail = {<br> size = 0, prev_free = 0x7f5394dea390}, no = 0}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f5394dea3b8, is_free = 139996956631992}}, tail = {<br> size = 0, prev_free = 0x7f5394dea3b8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea3e0, is_free = 139996956632032}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea3e0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea408, is_free = 139996956632072}}, tail = {<br> size = 0, prev_free = 0x7f5394dea408}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea430, is_free = 139996956632112}}, tail = {<br> size = 0, prev_free = 0x7f5394dea430}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea458, is_free = 139996956632152}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea458}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea480, is_free = 139996956632192}}, tail = {<br> size = 0, prev_free = 0x7f5394dea480}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea4a8, is_free = 139996956632232}}, tail = {<br> size = 0, prev_free = 0x7f5394dea4a8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea4d0, is_free = 139996956632272}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea4d0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea4f8, is_free = 139996956632312}}, tail = {<br> size = 0, prev_free = 0x7f5394dea4f8}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea520, is_free = 139996956632352}}, tail = {<br> size = 0, prev_free = 0x7f5394dea520}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f53951f6220, is_free = 139996960875040}}, tail = {<br>
size = 0, prev_free = 0x7f53951f6220}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea570, is_free = 139996956632432}}, tail = {<br>---Type <return> to continue, or q <return> to quit---<br>
size = 0, prev_free = 0x7f5394dea570}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f539523d3c0, is_free = 139996961166272}}, tail = {<br> size = 0, prev_free = 0x7f539523d3c0}, no = 1}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53952138e0, is_free = 139996960995552}}, tail = {<br> size = 0, prev_free = 0x7f53951f2350}, no = 4}, {head = {size = 0,<br> u = {nxt_free = 0x7f539544e700, is_free = 139996963333888}}, tail = {<br>
size = 0, prev_free = 0x7f539526fe70}, no = 4}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395298610, is_free = 139996961539600}}, tail = {<br> size = 0, prev_free = 0x7f53955e7950}, no = 4}, {head = {size = 0,<br>
u = {nxt_free = 0x7f53954bd960, is_free = 139996963789152}}, tail = {<br> size = 0, prev_free = 0x7f53954bd960}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395480560, is_free = 139996963538272}}, tail = {<br>
size = 0, prev_free = 0x7f5395369260}, no = 4}, {head = {size = 0,<br> u = {nxt_free = 0x7f53952f85b0, is_free = 139996961932720}}, tail = {<br> size = 0, prev_free = 0x7f539524b1a0}, no = 3}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea6b0, is_free = 139996956632752}}, tail = {<br> size = 0, prev_free = 0x7f5394dea6b0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f539553a230, is_free = 139996964299312}}, tail = {<br>
size = 0, prev_free = 0x7f539543a5f0}, no = 47}, {head = {size = 0,<br> u = {nxt_free = 0x7f53955fa230, is_free = 139996965085744}}, tail = {<br> size = 0, prev_free = 0x7f53953a2b10}, no = 2}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5395462be0, is_free = 139996963417056}}, tail = {<br> size = 0, prev_free = 0x7f53951b98d0}, no = 7}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f53951fe260, is_free = 139996960907872}}, tail = {<br> size = 0, prev_free = 0x7f53953e2c20}, no = 2}, {head = {size = 0,<br> u = {nxt_free = 0x7f5395300330, is_free = 139996961964848}}, tail = {<br>
size = 0, prev_free = 0x7f53953658d0}, no = 2}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea7a0, is_free = 139996956632992}}, tail = {<br> size = 0, prev_free = 0x7f5394dea7a0}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f539522bd30, is_free = 139996961094960}}, tail = {<br> size = 0, prev_free = 0x7f539522bd30}, no = 1}, {head = {size = 0,<br> u = {nxt_free = 0x7f53954c5ea0, is_free = 139996963823264}}, tail = {<br>
size = 0, prev_free = 0x7f539522c6c0}, no = 2}, {head = {size = 0,<br> u = {nxt_free = 0x7f53953c94e0, is_free = 139996962788576}}, tail = {<br> size = 0, prev_free = 0x7f53953c94e0}, no = 1}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea840, is_free = 139996956633152}}, tail = {<br> size = 0, prev_free = 0x7f5394dea840}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea868, is_free = 139996956633192}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea868}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea890, is_free = 139996956633232}}, tail = {<br> size = 0, prev_free = 0x7f5394dea890}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea8b8, is_free = 139996956633272}}, tail = {<br> size = 0, prev_free = 0x7f5394dea8b8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea8e0, is_free = 139996956633312}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea8e0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea908, is_free = 139996956633352}}, tail = {<br>---Type <return> to continue, or q <return> to quit---<br>
size = 0, prev_free = 0x7f5394dea908}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea930, is_free = 139996956633392}}, tail = {<br> size = 0, prev_free = 0x7f5394dea930}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea958, is_free = 139996956633432}}, tail = {<br> size = 0, prev_free = 0x7f5394dea958}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea980, is_free = 139996956633472}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea980}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea9a8, is_free = 139996956633512}}, tail = {<br> size = 0, prev_free = 0x7f5394dea9a8}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dea9d0, is_free = 139996956633552}}, tail = {<br> size = 0, prev_free = 0x7f5394dea9d0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dea9f8, is_free = 139996956633592}}, tail = {<br>
size = 0, prev_free = 0x7f5394dea9f8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deaa20, is_free = 139996956633632}}, tail = {<br> size = 0, prev_free = 0x7f5394deaa20}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deaa48, is_free = 139996956633672}}, tail = {<br> size = 0, prev_free = 0x7f5394deaa48}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deaa70, is_free = 139996956633712}}, tail = {<br>
size = 0, prev_free = 0x7f5394deaa70}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deaa98, is_free = 139996956633752}}, tail = {<br> size = 0, prev_free = 0x7f5394deaa98}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deaac0, is_free = 139996956633792}}, tail = {<br> size = 0, prev_free = 0x7f5394deaac0}, no = 0}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f5394deaae8, is_free = 139996956633832}}, tail = {<br> size = 0, prev_free = 0x7f5394deaae8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deab10, is_free = 139996956633872}}, tail = {<br>
size = 0, prev_free = 0x7f5394deab10}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deab38, is_free = 139996956633912}}, tail = {<br> size = 0, prev_free = 0x7f5394deab38}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deab60, is_free = 139996956633952}}, tail = {<br> size = 0, prev_free = 0x7f5394deab60}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deab88, is_free = 139996956633992}}, tail = {<br>
size = 0, prev_free = 0x7f5394deab88}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deabb0, is_free = 139996956634032}}, tail = {<br> size = 0, prev_free = 0x7f5394deabb0}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deabd8, is_free = 139996956634072}}, tail = {<br> size = 0, prev_free = 0x7f5394deabd8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deac00, is_free = 139996956634112}}, tail = {<br>
size = 0, prev_free = 0x7f5394deac00}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deac28, is_free = 139996956634152}}, tail = {<br> size = 0, prev_free = 0x7f5394deac28}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deac50, is_free = 139996956634192}}, tail = {<br> size = 0, prev_free = 0x7f5394deac50}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deac78, is_free = 139996956634232}}, tail = {<br>
size = 0, prev_free = 0x7f5394deac78}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deaca0, is_free = 139996956634272}}, tail = {<br>---Type <return> to continue, or q <return> to quit---<br>
size = 0, prev_free = 0x7f5394deaca0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deacc8, is_free = 139996956634312}}, tail = {<br> size = 0, prev_free = 0x7f5394deacc8}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deacf0, is_free = 139996956634352}}, tail = {<br> size = 0, prev_free = 0x7f5394deacf0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dead18, is_free = 139996956634392}}, tail = {<br>
size = 0, prev_free = 0x7f5394dead18}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dead40, is_free = 139996956634432}}, tail = {<br> size = 0, prev_free = 0x7f5394dead40}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394dead68, is_free = 139996956634472}}, tail = {<br> size = 0, prev_free = 0x7f5394dead68}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394dead90, is_free = 139996956634512}}, tail = {<br>
size = 0, prev_free = 0x7f5394dead90}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deadb8, is_free = 139996956634552}}, tail = {<br> size = 0, prev_free = 0x7f5394deadb8}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deade0, is_free = 139996956634592}}, tail = {<br> size = 0, prev_free = 0x7f5394deade0}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deae08, is_free = 139996956634632}}, tail = {<br>
size = 0, prev_free = 0x7f5394deae08}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deae30, is_free = 139996956634672}}, tail = {<br> size = 0, prev_free = 0x7f5394deae30}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deae58, is_free = 139996956634712}}, tail = {<br> size = 0, prev_free = 0x7f5394deae58}, no = 0}, {head = {size = 0,<br>---Type <return> to continue, or q <return> to quit---<br>
u = {nxt_free = 0x7f5394deae80, is_free = 139996956634752}}, tail = {<br> size = 0, prev_free = 0x7f5394deae80}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deaea8, is_free = 139996956634792}}, tail = {<br>
size = 0, prev_free = 0x7f5394deaea8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deaed0, is_free = 139996956634832}}, tail = {<br> size = 0, prev_free = 0x7f5394deaed0}, no = 0}, {head = {size = 0,<br>
u = {nxt_free = 0x7f5394deaef8, is_free = 139996956634872}}, tail = {<br> size = 0, prev_free = 0x7f5394deaef8}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deaf20, is_free = 139996956634912}}, tail = {<br>
size = 0, prev_free = 0x7f5394deaf20}, no = 0}, {head = {size = 0,<br> u = {nxt_free = 0x7f5394deaf48, is_free = 139996956634952}}, tail = {<br> size = 0, prev_free = 0x7f5394deaf48}, no = 0}...}}<br>
(gdb)<br><br><br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Oct 29, 2013 at 9:56 AM, Daniel-Constantin Mierla <span dir="ltr"><<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
Hello,<br>
<br>
going to look over it. Do you still have the core file? If yes,
provide the output of:<br>
<br>
p *shm_block<br>
<br>
from inside gdb.<br>
<br>
Cheers,<br>
Daniel<div><div class="h5"><br>
<br>
<div>On 10/28/13 1:00 PM, Morten Isaksen
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>Hi,<br>
<br>
We upgraded to 4.0.4 and now we got a new core dump in
q_malloc.c:269. It has been stable for about 5 days after the
upgrade.<br>
<br>
</div>
/Morten<br>
<div><br>
The full backtrace is here:<br>
<br>
Loaded symbols for /lib64/libnss_files.so.2<br>
Core was generated by `/usr/local/sbin/kamailio -P
/var/run/kamailio/kamailio.pid -m 256 -M 8 -u kamai'.<br>
Program terminated with signal 11, Segmentation fault.<br>
#0 qm_detach_free (qm=0x7f5394de9000, size=0) at
mem/q_malloc.c:269<br>
269 FRAG_END(next)->prev_free=prev;<br>
Missing separate debuginfos, use: debuginfo-install
glibc-2.12-1.107.el6.x86_64 hiredis-0.10.1-3.el6.x86_64
keyutils-libs-1.4-4.el6.x86_64 krb5-libs-1.10.3-10.el6.x86_64
libcom_err-1.41.12-14.el6.x86_64
libselinux-2.0.94-5.3.el6.x86_64
libxml2-2.7.6-12.el6_4.1.x86_64
mysql-libs-5.1.67-1.el6_3.x86_64
nss-softokn-freebl-3.12.9-11.el6.x86_64
openssl-1.0.0-27.el6_4.2.x86_64 zlib-1.2.3-29.el6.x86_64<br>
(gdb) bt full<br>
#0 qm_detach_free (qm=0x7f5394de9000, size=0) at
mem/q_malloc.c:269<br>
prev = 0x7f539524ed60<br>
next = 0x0<br>
#1 qm_malloc (qm=0x7f5394de9000, size=0) at
mem/q_malloc.c:386<br>
f = 0x7f539524ed60<br>
hash = 0<br>
#2 0x00007f53a5662950 in shm_malloc (size=0) at
../../mem/shm_mem.h:262<br>
p = <value optimized out><br>
#3 0x00007f53a566b49b in dlg_set_leg_info (dlg=<value
optimized out>, tag=0x7ffff680b9a0, rr=0x7ffff680b860,
contact=0x7ffff680b870, cseq=0x7ffff680b880, leg=1) at
dlg_hash.c:498<br>
p = <value optimized out><br>
__FUNCTION__ = "dlg_set_leg_info"<br>
#4 0x00007f53a5659e88 in populate_leg_info
(dlg=0x7f53952312b0, msg=<value optimized out>,
t=<value optimized out>, leg=1, tag=0x7ffff680b9a0) at
dlg_handlers.c:276<br>
skip_recs = 4<br>
cseq = {s = 0x0, len = 0}<br>
contact = {<br>
s = 0x8da2c0 "<a href="http://sip:65993777@178.21.249.22:5060" target="_blank">sip:65993777@178.21.249.22:5060</a>>\r\nContent-Type:
application/sdp\r\nRequire: timer\r\nContent-Length:
252\r\n\r\nv=0\r\no=- <a href="tel:2042480911" value="+12042480911" target="_blank">2042480911</a> <a href="tel:2042480911" value="+12042480911" target="_blank">2042480911</a> IN IP4
178.21.249.22\r\ns=Hosted PBX\r\nc=IN IP4 178.21.249.22\r\nt=0
0"..., len = 31}<br>
rr_set = {s = 0x7f53ab927c20 <incomplete sequence
\361\237\215>, len = 0}<br>
__FUNCTION__ = "populate_leg_info"<br>
#5 0x00007f53a565b949 in dlg_onreply (t=0x7f5395245030,
type=<value optimized out>, param=<value optimized
out>) at dlg_handlers.c:500<br>
dlg = 0x7f53952312b0<br>
iuid = <value optimized out><br>
new_state = 3<br>
old_state = 1<br>
unref = 0<br>
event = 3<br>
tag = {<br>
s = 0x8da1bc "as77c791c9\r\nCall-ID:
0dd71e51-ba5d-1231-c79f-00095200eb1e\r\nCSeq: 1206140
INVITE\r\nServer: one-connect\r\nAllow: INVITE, ACK, CANCEL,
OPTIONS, BYE, REFER, SUBSCRIBE, NOTIFY, INFO,
PUBLISH\r\nSupported: repl"..., len = 10}<br>
req = 0x7f5395640090<br>
rpl = 0x7f53ab8cd7a0<br>
__FUNCTION__ = "dlg_onreply"<br>
#6 0x00007f53aa1f58ad in run_trans_callbacks_internal
(cb_lst=<value optimized out>, type=1048576,
trans=0x7f5395245030, params=0x7ffff680baa0) at t_hooks.c:290<br>
cbp = 0x7f5395311260<br>
backup_from = 0x8e9ed0<br>
backup_to = 0x8e9ed8<br>
backup_dom_from = 0x8e9ee0<br>
backup_dom_to = 0x8e9ee8<br>
backup_uri_from = 0x8e9ec0<br>
backup_uri_to = 0x8e9ec8<br>
backup_xavps = 0x8e9fd0<br>
__FUNCTION__ = "run_trans_callbacks_internal"<br>
#7 0x00007f53aa1f5a94 in run_trans_callbacks_with_buf
(type=<value optimized out>, rbuf=0x7f53952450f0,
req=<value optimized out>, repl=<value optimized
out>, flags=<value optimized out>) at t_hooks.c:336<br>
params = {req = 0x7f5395640090, rpl = 0x7f53ab8cd7a0,
param = 0x7f5395311270, code = 200, flags = 200, branch = 0,
t_rbuf = 0x7f53952450f0, dst = 0x7f5395245140, send_buf = {<br>
s = 0x7f53953ac460 "SIP/2.0 200 OK\r\nVia:
SIP/2.0/UDP
178.21.248.30;rport=5060;branch=z9hG4bKd24f.32134635.0\r\nVia:
SIP/2.0/UDP
178.21.248.8;rport=5060;branch=z9hG4bKd24f.b20f4bb3.0\r\nVia:
SIP/2.0/UDP 178.21.248.20;branch=z"..., len = 1341}}<br>
trans = <value optimized out><br>
#8 0x00007f53aa22728c in relay_reply (t=<value optimized
out>, p_msg=<value optimized out>, branch=0,
msg_status=200, cancel_data=0x7ffff680be40, do_put_on_wait=1)
at t_reply.c:1867<br>
relay = 0<br>
save_clone = 0<br>
buf = 0x7f53ab9361a0 "SIP/2.0 200 OK\r\nVia:
SIP/2.0/UDP
178.21.248.30;rport=5060;branch=z9hG4bKd24f.32134635.0\r\nVia:
SIP/2.0/UDP
178.21.248.8;rport=5060;branch=z9hG4bKd24f.b20f4bb3.0\r\nVia:
SIP/2.0/UDP 178.21.248.20;branch=z"...<br>
res_len = 1341<br>
relayed_code = 200<br>
relayed_msg = 0x7f53ab8cd7a0<br>
reply_bak = <value optimized out><br>
bm = {to_tag_val = {s = 0x7f5395600c50
"P\233\365\224S\177", len = -1440728525}}<br>
totag_retr = 0<br>
reply_status = RPS_COMPLETED<br>
uas_rb = <value optimized out><br>
to_tag = <value optimized out><br>
reason = {s = 0x3 <Address 0x3 out of bounds>,
len = -159334788}<br>
onsend_params = {req = 0x7f53aa45e594, rpl =
0x7ffff680be78, param = 0x0, code = 0, flags = 0, branch = 0,
t_rbuf = 0x10, dst = 0x7f53aa200a91, send_buf = {s =
0x7f5395601f38 "", len = -1440601726}}<br>
---Type <return> to continue, or q <return> to
quit---<br>
__FUNCTION__ = "relay_reply"<br>
#9 0x00007f53aa227da6 in reply_received
(p_msg=0x7f53ab8cd7a0) at t_reply.c:2374<br>
msg_status = 200<br>
last_uac_status = 100<br>
ack = 0x1 <Address 0x1 out of bounds><br>
ack_len = 0<br>
branch = 0<br>
reply_status = <value optimized out><br>
onreply_route = <value optimized out><br>
cancel_data = {cancel_bitmap = 0, reason = {cause =
200, u = {text = {s = 0x0, len = -1416571248}, e2e_cancel =
0x0, packed_hdrs = {s = 0x0, len = -1416571248}}}}<br>
uac = 0x7f5395245198<br>
t = 0x7f5395245030<br>
lack_dst = {send_sock = 0x0, to = {s = {sa_family =
48720, sa_data =
"\200\366\377\177\000\000\000\000\000\000\000\000\000"}, sin =
{sin_family = 48720, sin_port = 63104, sin_addr = {<br>
s_addr = 32767}, sin_zero =
"\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 48720,
sin6_port = 63104, sin6_flowinfo = 32767, sin6_addr = {__in6_u
= {<br>
__u6_addr8 =
"\000\000\000\000\000\000\000\000\260kq\253S\177\000",
__u6_addr16 = {0, 0, 0, 0, 27568, 43889, 32595, 0},
__u6_addr32 = {0, 0, 2876337072, 32595}}},<br>
sin6_scope_id = 2878134176}}, id = 32595, proto
= -76 '\264', send_flags = {f = 5 '\005', blst_imask = 0
'\000'}}<br>
backup_user_from = <value optimized out><br>
backup_user_to = <value optimized out><br>
backup_domain_from = <value optimized out><br>
backup_domain_to = <value optimized out><br>
backup_uri_from = <value optimized out><br>
backup_uri_to = <value optimized out><br>
backup_xavps = <value optimized out><br>
replies_locked = <value optimized out><br>
branch_ret = <value optimized out><br>
prev_branch = <value optimized out><br>
blst_503_timeout = <value optimized out><br>
hf = <value optimized out><br>
onsend_params = {req = 0x8da424, rpl = 0x543274, param
= 0x10, code = -1416833120, flags = 32595, branch = 0, t_rbuf
= 0x7ffff680be50, dst = 0x7f53a566690b, send_buf = {<br>
s = 0x4ff1e7b00000000 <Address
0x4ff1e7b00000000 out of bounds>, len = 0}}<br>
ctx = {rec_lev = 0, run_flags = 0, last_retcode = 1,
jmp_env = {{__jmpbuf = {140737329020144, -5577311537021373234,
139997336902320, 139997337147296, 200, 139996961202968,
5577292203380126926,<br>
-5577312076254333746}, __mask_was_saved = 0,
__saved_mask = {__val = {139997337420128, 9281488,
139997335445253, 1, 140737329020496, 6191275, 5978073,
8591616, 9281252, 68728758110,<br>
5548121, 9281656, 9281173, 139997337409168,
9282596, 139997337519904}}}}}<br>
__FUNCTION__ = "reply_received"<br>
#10 0x0000000000456d54 in do_forward_reply
(msg=0x7f53ab8cd7a0, mode=<value optimized out>) at
forward.c:799<br>
new_buf = 0x0<br>
dst = {send_sock = 0x0, to = {s = {sa_family = 0,
sa_data = '\000' <repeats 13 times>}, sin = {sin_family
= 0, sin_port = 0, sin_addr = {s_addr = 0}, sin_zero =
"\000\000\000\000\000\000\000"},<br>
sin6 = {sin6_family = 0, sin6_port = 0,
sin6_flowinfo = 0, sin6_addr = {__in6_u = {__u6_addr8 = '\000'
<repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0, 0}}},<br>
sin6_scope_id = 0}}, id = 0, proto = 0 '\000',
send_flags = {f = 0 '\000', blst_imask = 0 '\000'}}<br>
new_len = <value optimized out><br>
r = <value optimized out><br>
s = <value optimized out><br>
len = <value optimized out><br>
__FUNCTION__ = "do_forward_reply"<br>
#11 0x000000000049f4be in receive_msg (<br>
buf=0x8d9e80 "SIP/2.0 200 OK\r\nVia: SIP/2.0/UDP
178.21.249.20;branch=z9hG4bKd24f.20eeb764.0;received=178.21.249.20;rport=5060\r\nVia:
SIP/2.0/UDP
178.21.248.30;rport=5060;branch=z9hG4bKd24f.32134635.0\r\nVia:
SIP/2.0/UD"..., len=<value optimized out>,
rcv_info=0x7ffff680c100) at receive.c:272<br>
msg = 0x7f53ab8cd7a0<br>
ctx = {rec_lev = 12, run_flags = 0, last_retcode =
-1517756399, jmp_env = {{__jmpbuf = {139996960369776, 12,
219309716216, 139997343567872, 140737329021424, 4294967295,
140737329021551, 1},<br>
__mask_was_saved = 8581896, __saved_mask =
{__val = {0, 28, 16, 0, 219305533392, 1, 0, 139997335309296,
219309716216, 139996960369776, 139997337398864,
139997343565480, 139997337398872,<br>
140737329021320, 219305559701,
140737329021192}}}}}<br>
ret = <value optimized out><br>
inb = {<br>
s = 0x8d9e80 "SIP/2.0 200 OK\r\nVia: SIP/2.0/UDP
178.21.249.20;branch=z9hG4bKd24f.20eeb764.0;received=178.21.249.20;rport=5060\r\nVia:
SIP/2.0/UDP
178.21.248.30;rport=5060;branch=z9hG4bKd24f.32134635.0\r\nVia:
SIP/2.0/UD"..., len = 1444}<br>
__FUNCTION__ = "receive_msg"<br>
#12 0x0000000000532306 in udp_rcv_loop () at udp_server.c:557<br>
len = 1444<br>
buf = "SIP/2.0 200 OK\r\nVia: SIP/2.0/UDP
178.21.249.20;branch=z9hG4bKd24f.20eeb764.0;received=178.21.249.20;rport=5060\r\nVia:
SIP/2.0/UDP
178.21.248.30;rport=5060;branch=z9hG4bKd24f.32134635.0\r\nVia:
SIP/2.0/UD"...<br>
from = 0x7f53ab90ae50<br>
fromlen = 16<br>
ri = {src_ip = {af = 2, len = 4, u = {addrl =
{385422770, 0}, addr32 = {385422770, 0, 0, 0}, addr16 = {5554,
5881, 0, 0, 0, 0, 0, 0}, addr = "\262\025\371\026", '\000'
<repeats 11 times>}},<br>
---Type <return> to continue, or q <return> to
quit---<br>
dst_ip = {af = 2, len = 4, u = {addrl = {351868338,
0}, addr32 = {351868338, 0, 0, 0}, addr16 = {5554, 5369, 0, 0,
0, 0, 0, 0}, addr = "\262\025\371\024", '\000' <repeats 11
times>}},<br>
src_port = 5060, dst_port = 5060, proto_reserved1 =
0, proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data
= "\023IJ\025\371\026\000\000\000\000\000\000\000"}, sin =
{sin_family = 2,<br>
sin_port = 50195, sin_addr = {s_addr =
385422770}, sin_zero = "\000\000\000\000\000\000\000"}, sin6 =
{sin6_family = 2, sin6_port = 50195, sin6_flowinfo =
385422770, sin6_addr = {__in6_u = {<br>
__u6_addr8 = '\000' <repeats 15
times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32
= {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address =
0x7f53ab8cec10, proto = 1 '\001'}<br>
__FUNCTION__ = "udp_rcv_loop"<br>
#13 0x0000000000467a7a in main_loop () at main.c:1638<br>
i = <value optimized out><br>
pid = <value optimized out><br>
si = <value optimized out><br>
si_desc = "udp receiver child=3 sock=<a href="http://178.21.249.20:5060" target="_blank">178.21.249.20:5060</a>\000\000\000\000@\\\220\253S\177\000\000\000\000\000\000\000\000\000\000\003\000\000\000\000\000\000\000\001\000\000\000\001\000\000\000\300\375\216\000\000\000\000\000\001\000\000\000\000\000\000\000\000\376\216\000\000\000\000\000\000\000\200\020",
'\000' <repeats 12 times>,
"\005\000\000\000\000\000\000"<br>
nrprocs = <value optimized out><br>
__FUNCTION__ = "main_loop"<br>
#14 0x000000000046a912 in main (argc=<value optimized
out>, argv=<value optimized out>) at main.c:2566<br>
cfg_stream = <value optimized out><br>
c = <value optimized out><br>
r = <value optimized out><br>
tmp = 0x7ffff680d89a ""<br>
tmp_len = 0<br>
options = 0x5c1de8
":f:cm:M:dVIhEeb:l:L:n:vKrRDTN:W:w:t:u:g:P:G:SQ:O:a:A:"<br>
ret = -1<br>
seed = 1043769636<br>
rfd = <value optimized out><br>
debug_save = <value optimized out><br>
debug_flag = <value optimized out><br>
dont_fork_cnt = <value optimized out><br>
n_lst = <value optimized out><br>
p = <value optimized out><br>
__FUNCTION__ = "main"<br>
<br>
</div>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Mon, Oct 21, 2013 at 8:15 PM,
Daniel-Constantin Mierla <span dir="ltr"><<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"> Hello,<br>
<br>
can you upgrade to 4.0.4? there were some fixes related to
new fields in sip message structure that resulted in some
out bound memory inside transactions.<br>
<br>
The config file and database is the same, so just
re-install over the previous installation.<br>
<br>
Cheers,<br>
Daniel
<div>
<div><br>
<br>
<div>On 10/21/13 11:10 AM, Morten Isaksen wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">
<div>
<div>
<div>Hi,<br>
<br>
</div>
Our Kamailio has stopped with a segmentation
fault 4 times the last week.<br>
<br>
</div>
There has been no changes to the configuration
file the last 15 days, so I suspect a SIP phone
is sending a SIP packet that Kamailio does not
like.<br>
<br>
</div>
<div>We have a core dump file but I cannot read
anything usefull from the backtrace. Can you see
what is wrong from the backtrace?<br>
<br>
</div>
<div>Regards<br>
</div>
<div>Morten<br>
</div>
<div><br>
</div>
The output from gdb (bt full):<br>
<br>
Core was generated by `/usr/local/sbin/kamailio -P
/var/run/kamailio/kamailio.pid -m 256 -M 8 -u
kamai'.<br>
Program terminated with signal 11, Segmentation
fault.<br>
#0 0x00007f0e10de17b2 in cancel_branch
(t=0x7f0dfbf38e10, branch=0, reason=<value
optimized out>, flags=4) at t_cancel.c:284<br>
284 if (cfg_get(tm, tm_cfg,
reparse_invite) ||<br>
Missing separate debuginfos, use:
debuginfo-install glibc-2.12-1.107.el6.x86_64
hiredis-0.10.1-3.el6.x86_64
keyutils-libs-1.4-4.el6.x86_64
krb5-libs-1.10.3-10.el6.x86_64
libcom_err-1.41.12-14.el6.x86_64
libselinux-2.0.94-5.3.el6.x86_64
libxml2-2.7.6-12.el6_4.1.x86_64
mysql-libs-5.1.67-1.el6_3.x86_64
nss-softokn-freebl-3.12.9-11.el6.x86_64
openssl-1.0.0-27.el6_4.2.x86_64
zlib-1.2.3-29.el6.x86_64<br>
(gdb) bt full<br>
#0 0x00007f0e10de17b2 in cancel_branch
(t=0x7f0dfbf38e10, branch=0, reason=<value
optimized out>, flags=4) at t_cancel.c:284<br>
cancel = <value optimized out><br>
len = <value optimized out><br>
crb = 0x7f0dfbf39008<br>
irb = 0x7f0dfbf38f80<br>
ret = 1<br>
tmp_cd = {cancel_bitmap = 0, reason =
{cause = 0, u = {text = {s = 0x0, len = 0},
e2e_cancel = 0x0, packed_hdrs = {s = 0x0, len =
0}}}}<br>
pcbuf = <value optimized out><br>
__FUNCTION__ = "cancel_branch"<br>
#1 0x00007f0e10e298ab in reply_received
(p_msg=0x7f0e124ce760) at t_reply.c:2194<br>
msg_status = <value optimized out><br>
last_uac_status = 408<br>
ack = 0x7f0dfbf38e10 "Ð<br>
\267\373\r\177"<br>
ack_len = <value optimized out><br>
branch = 0<br>
reply_status = <value optimized out><br>
onreply_route = <value optimized
out><br>
cancel_data = {cancel_bitmap = 0, reason =
{cause = 408, u = {text = {s = 0x0, len =
307468800}, e2e_cancel = 0x0, packed_hdrs = {s =
0x0, len = 307468800}}}}<br>
uac = <value optimized out><br>
t = 0x7f0dfbf38e10<br>
lack_dst = {send_sock = 0x0, to = {s =
{sa_family = 6704, sa_data =
"\\#\377\177\000\000\000\000\000\000\000\000\000"},
sin = {sin_family = 6704, sin_port = 9052,
sin_addr = {s_addr = 32767},<br>
sin_zero =
"\000\000\000\000\000\000\000"}, sin6 =
{sin6_family = 6704, sin6_port = 9052,
sin6_flowinfo = 32767, sin6_addr = {__in6_u = {<br>
__u6_addr8 =
"\000\000\000\000\000\000\000\000p{1\022\016\177\000",
__u6_addr16 = {0, 0, 0, 0, 31600, 4657, 32526, 0},
__u6_addr32 = {0, 0, 305232752, 32526}}},<br>
sin6_scope_id = 307029856}}, id =
32526, proto = 28 '\034', send_flags = {f = 0
'\000', blst_imask = 0 '\000'}}<br>
backup_user_from = <value optimized
out><br>
backup_user_to = <value optimized
out><br>
backup_domain_from = <value optimized
out><br>
backup_domain_to = <value optimized
out><br>
backup_uri_from = <value optimized
out><br>
backup_uri_to = <value optimized
out><br>
backup_xavps = <value optimized out><br>
replies_locked = 0<br>
branch_ret = <value optimized out><br>
prev_branch = <value optimized out><br>
blst_503_timeout = <value optimized
out><br>
hf = <value optimized out><br>
onsend_params = {req = 0x8d8a39, rpl =
0x541db4, param = 0x7f0e1253e528, code =
307029856, flags = 32526, branch = 0, t_rbuf =
0x7fff235c1a30, dst = 0x7f0e12317b70, send_buf = {<br>
s = 0x375311000000000 <Address
0x375311000000000 out of bounds>, len = 0}}<br>
ctx = {rec_lev = 307491008, run_flags =
32526, last_retcode = 5674412, jmp_env =
{{__jmpbuf = {140733786626256, 63331951475841423,
139698413054576, 139698413299552, 9276465,
139698039855608,<br>
-63254168797292145,
63332490682325391}, __mask_was_saved = 0,
__saved_mask = {__val = {139698413734928, 0,
139698411522821, 1, 140733786626608, 6185835,
5972697, 8586176, 9275699,<br>
69026945952, 3, 9276465,
9275673, 139698413738496, 9275961,
139698413760704}}}}}<br>
__FUNCTION__ = "reply_received"<br>
#2 0x0000000000456444 in do_forward_reply
(msg=0x7f0e124ce760, mode=<value optimized
out>) at forward.c:799<br>
new_buf = 0x0<br>
dst = {send_sock = 0x0, to = {s =
{sa_family = 0, sa_data = '\000' <repeats 13
times>}, sin = {sin_family = 0, sin_port = 0,
sin_addr = {s_addr = 0}, sin_zero =
"\000\000\000\000\000\000\000"},<br>
sin6 = {sin6_family = 0, sin6_port =
0, sin6_flowinfo = 0, sin6_addr = {__in6_u =
{__u6_addr8 = '\000' <repeats 15 times>,
__u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0},
__u6_addr32 = {0, 0, 0, 0}}},<br>
sin6_scope_id = 0}}, id = 0, proto =
0 '\000', send_flags = {f = 0 '\000', blst_imask =
0 '\000'}}<br>
new_len = <value optimized out><br>
r = <value optimized out><br>
s = <value optimized out><br>
len = <value optimized out><br>
__FUNCTION__ = "do_forward_reply"<br>
#3 0x000000000049e15e in receive_msg
(buf=<value optimized out>, len=313,
rcv_info=0x7fff235c1cd0) at receive.c:270<br>
msg = 0x7f0e124ce760<br>
ctx = {rec_lev = 11, run_flags = 0,
last_retcode = 206110737, jmp_env = {{__jmpbuf =
{139698036884436, 11, 219309716216,
139698419720192, 140733786627520, 4294967295,
140733786627647, 1},<br>
__mask_was_saved = 8576456,
__saved_mask = {__val = {0, 28, 16, 0,
219305533392, 1, 0, 139698411461552, 219309716216,
139698036884436, 139698413732672, 139698419717800,
139698413732680,<br>
140733786627416, 219305559701,
140733786627288}}}}}<br>
ret = <value optimized out><br>
inb = {<br>
s = 0x8d8900 "SIP/2.0 100 Trying\r\nVia:
SIP/2.0/UDP
178.21.249.20;branch=z9hG4bK8149.c6575a95.0\r\nTo:
<a href="mailto:sip%3A201@78799865.pbx.one-connect.dk" target="_blank">sip:201@78799865.pbx.one-connect.dk</a>;tag=07c44e68\r\nFrom:
<a href="mailto:sip%3A201@78799865.pbx.one-connect.dk" target="_blank">sip:201@78799865.pbx.one-connect.dk</a>;tag=a6a1c5f60faecf035a"...,
len = 313}<br>
__FUNCTION__ = "receive_msg"<br>
#4 0x0000000000530e46 in udp_rcv_loop () at
udp_server.c:557<br>
---Type <return> to continue, or q
<return> to quit---<br>
len = 313<br>
buf = "SIP/2.0 100 Trying\r\nVia:
SIP/2.0/UDP
178.21.249.20;branch=z9hG4bK8149.c6575a95.0\r\nTo:
<a href="mailto:sip%3A201@78799865.pbx.one-connect.dk" target="_blank">sip:201@78799865.pbx.one-connect.dk</a>;tag=07c44e68\r\nFrom:
<a href="mailto:sip%3A201@78799865.pbx.one-connect.dk" target="_blank">sip:201@78799865.pbx.one-connect.dk</a>;tag=a6a1c5f60faecf035a"...<br>
from = 0x7f0e12538340<br>
fromlen = 16<br>
ri = {src_ip = {af = 2, len = 4, u =
{addrl = {2993962576, 0}, addr32 = {2993962576, 0,
0, 0}, addr16 = {15952, 45684, 0, 0, 0, 0, 0, 0},
addr = "P>t\262", '\000' <repeats 11
times>}}, dst_ip = {<br>
af = 2, len = 4, u = {addrl =
{351868338, 0}, addr32 = {351868338, 0, 0, 0},
addr16 = {5554, 5369, 0, 0, 0, 0, 0, 0}, addr =
"\262\025\371\024", '\000' <repeats 11
times>}}, src_port = 35754,<br>
dst_port = 5060, proto_reserved1 = 0,
proto_reserved2 = 0, src_su = {s = {sa_family = 2,
sa_data =
"\213\252P>t\262\000\000\000\000\000\000\000"},
sin = {sin_family = 2, sin_port = 43659,<br>
sin_addr = {s_addr = 2993962576},
sin_zero = "\000\000\000\000\000\000\000"}, sin6 =
{sin6_family = 2, sin6_port = 43659, sin6_flowinfo
= 2993962576, sin6_addr = {__in6_u = {<br>
__u6_addr8 = '\000' <repeats
15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id =
0}}, bind_address = 0x7f0e124cfbd0, proto = 1
'\001'}<br>
__FUNCTION__ = "udp_rcv_loop"<br>
#5 0x000000000046716a in main_loop () at
main.c:1638<br>
i = <value optimized out><br>
pid = <value optimized out><br>
si = <value optimized out><br>
si_desc = "udp receiver child=2 sock=<a href="http://178.21.249.20:5060" target="_blank">178.21.249.20:5060</a>\000\000\000\000\200\303P\022\016\177\000\000\000\000\000\000\000\000\000\000\003\000\000\000\000\000\000\000\001\000\000\000\001\000\000\000@\350\216\000\000\000\000\000\001\000\000\000\000\000\000\000\200\350\216\000\000\000\000\000\000\000\200\020",
'\000' <repeats 12 times>,
"\005\000\000\000\000\000\000"<br>
nrprocs = <value optimized out><br>
__FUNCTION__ = "main_loop"<br>
#6 0x000000000046a002 in main (argc=<value
optimized out>, argv=<value optimized
out>) at main.c:2566<br>
cfg_stream = <value optimized out><br>
c = <value optimized out><br>
r = <value optimized out><br>
tmp = 0x7fff235c377f ""<br>
tmp_len = 0<br>
options = 0x5c08c8
":f:cm:M:dVIhEeb:l:L:n:vKrRDTN:W:w:t:u:g:P:G:SQ:O:a:A:"<br>
ret = -1<br>
seed = 1722854551<br>
rfd = <value optimized out><br>
debug_save = <value optimized out><br>
debug_flag = <value optimized out><br>
dont_fork_cnt = <value optimized
out><br>
n_lst = <value optimized out><br>
p = <value optimized out><br>
__FUNCTION__ = "main"<br>
(gdb)<br>
<br>
<br>
<br>
<div>
<div><br clear="all">
<div>
<div>
<div><br>
-- <br>
Morten Isaksen<br>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset></fieldset>
<br>
</div>
</div>
<pre>_______________________________________________
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users</a><span><font color="#888888">
</font></span></pre>
<span><font color="#888888"> </font></span></blockquote>
<span><font color="#888888"> <br>
<pre cols="72">--
Daniel-Constantin Mierla - <a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a>
<a href="http://twitter.com/#%21/miconda" target="_blank">http://twitter.com/#!/miconda</a> - <a href="http://www.linkedin.com/in/miconda" target="_blank">http://www.linkedin.com/in/miconda</a>
Kamailio Advanced Trainings - Berlin, Nov 25-28; Miami, Nov 18-20, 2013
- more details about Kamailio trainings at <a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a> -
</pre>
</font></span></div>
<br>
_______________________________________________<br>
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users
mailing list<br>
<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a><br>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users</a><br>
<br>
</blockquote>
</div>
<br>
<br clear="all">
<br>
-- <br>
Morten Isaksen<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
<a href="mailto:sr-users@lists.sip-router.org" target="_blank">sr-users@lists.sip-router.org</a>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
</blockquote>
<br>
<pre cols="72">--
Daniel-Constantin Mierla - <a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a>
<a href="http://twitter.com/#!/miconda" target="_blank">http://twitter.com/#!/miconda</a> - <a href="http://www.linkedin.com/in/miconda" target="_blank">http://www.linkedin.com/in/miconda</a>
Kamailio Advanced Trainings - Berlin, Nov 25-28
- more details about Kamailio trainings at <a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a> -
</pre>
</div></div></div>
<br>_______________________________________________<br>
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list<br>
<a href="mailto:sr-users@lists.sip-router.org">sr-users@lists.sip-router.org</a><br>
<a href="http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>Morten Isaksen<br>
</div>