VoIP Mailing List Archives

[email.list.subscriber ...]

Anthony,

I increased the ulimit parameters as suggested. I then ran into a few
other Freeswitch errors that required me to edit switch.conf.xml to
increase the max sessions, and max sessions per second parameters (to
100000, and 100, respectively).

Now, after a few minutes of running calls at 20 calls per second with
a 3 min. duration, I start seeing an influx of "480 Temporarily
Unavailable" SIP error messages.

Here is a snip of the log:


-------------------------------------------
2009-09-16 19:35:19.18798 [DEBUG] switch_core_session.c:932 Send
signal sofia/external/2015692700@72.245.84.150 [BREAK]
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:434
(sofia/internal/9726074300@72.245.84.24:5060) State HANGUP
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:398
(sofia/external/2015692700@72.245.84.150) Running State Change
CS_REPORTING
2009-09-16 19:35:19.18798 [DEBUG] mod_sofia.c:338 Channel
sofia/internal/9726074300@72.245.84.24:5060 hanging up, cause:
NORMAL_CLEARING
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:612
(sofia/external/2015692700@72.245.84.150) State REPORTING
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:53
sofia/external/2015692700@72.245.84.150 Standard REPORTING, cause:
NO_ANSWER
2009-09-16 19:35:19.18798 [DEBUG] mod_sofia.c:417 Responding to INVITE
with: 480
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:612
(sofia/external/2015692700@72.245.84.150) State REPORTING going to
sleep
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:411
(sofia/external/2015692700@72.245.84.150) State Change CS_REPORTING ->
CS_DESTROY
2009-09-16 19:35:19.18798 [DEBUG] switch_core_session.c:1068 Session
3395 (sofia/external/2015692700@72.245.84.150) Locked, Waiting on
external entities
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:46
sofia/internal/9726074300@72.245.84.24:5060 Standard HANGUP, cause:
NORMAL_CLEARING
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:434
(sofia/internal/9726074300@72.245.84.24:5060) State HANGUP going to
sleep
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:434
(sofia/external/2015692915@72.245.84.150) State HANGUP
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:46
sofia/external/2015692915@72.245.84.150 Standard HANGUP, cause:
NO_ANSWER
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:434
(sofia/external/2015692915@72.245.84.150) State HANGUP going to sleep
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:476
(sofia/internal/9726074300@72.245.84.24:5060) State Change CS_HANGUP
-> CS_REPORTING
2009-09-16 19:35:19.18798 [DEBUG] switch_core_session.c:932 Send
signal sofia/internal/9726074300@72.245.84.24:5060 [BREAK]
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:398
(sofia/internal/9726074300@72.245.84.24:5060) Running State Change
CS_REPORTING
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:612
(sofia/internal/9726074300@72.245.84.24:5060) State REPORTING
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:53
sofia/internal/9726074300@72.245.84.24:5060 Standard REPORTING, cause:
NORMAL_CLEARING
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:612
(sofia/internal/9726074300@72.245.84.24:5060) State REPORTING going to
sleep
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:411
(sofia/internal/9726074300@72.245.84.24:5060) State Change
CS_REPORTING -> CS_DESTROY
2009-09-16 19:35:19.18798 [DEBUG] switch_core_session.c:1068 Session
3392 (sofia/internal/9726074300@72.245.84.24:5060) Locked, Waiting on
external entities
2009-09-16 19:35:19.18798 [NOTICE] switch_core_session.c:1086 Session
3392 (sofia/internal/9726074300@72.245.84.24:5060) Ended
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:434
(sofia/external/2015692915@72.245.84.150) State HANGUP
2009-09-16 19:35:19.18798 [NOTICE] switch_core_session.c:1088 Close
Channel sofia/internal/9726074300@72.245.84.24:5060 [CS_DESTROY]
2009-09-16 19:35:19.18798 [DEBUG] mod_sofia.c:338 Channel
sofia/external/2015692915@72.245.84.150 hanging up, cause: NO_ANSWER
2009-09-16 19:35:19.18798 [DEBUG] mod_sofia.c:406 Sending CANCEL to
sofia/external/2015692915@72.245.84.150
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:46
sofia/external/2015692915@72.245.84.150 Standard HANGUP, cause:
NO_ANSWER
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:434
(sofia/external/2015692915@72.245.84.150) State HANGUP going to sleep
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:564
(sofia/internal/9726074300@72.245.84.24:5060) State DESTROY
2009-09-16 19:35:19.18798 [DEBUG] mod_sofia.c:255
sofia/internal/9726074300@72.245.84.24:5060 SOFIA DESTROY
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:60
sofia/internal/9726074300@72.245.84.24:5060 Standard DESTROY
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:564
(sofia/internal/9726074300@72.245.84.24:5060) State DESTROY going to
sleep
2009-09-16 19:35:19.18798 [DEBUG] switch_core_state_machine.c:434
(sofia/internal/2126822269@72.245.84.24:5060) State HANGUP
2009-09-16 19:35:19.18798 [DEBUG] mod_sofia.c:338 Channel
sofia/internal/2126822269@72.245.84.24:5060 hanging up, cause:
NORMAL_CLEARING
2009-09-16 19:35:19.18798 [DEBUG] mod_sofia.c:417 Responding to INVITE
with: 480
-------------------------------------------


Is there some other limitation on freeswitch I may be hitting? I
tried throttling down to 10 calls per second (3 min. duration) and
here are some snippets from tailing the log file:


-------------------------------------------
2009-09-16 20:01:47.422656 [DEBUG] switch_ivr_originate.c:2138
Originate Resulted in Error Cause: 102 [RECOVERY_ON_TIMER_EXPIRE]
2009-09-16 20:01:47.496066 [DEBUG] switch_ivr_originate.c:2138
Originate Resulted in Error Cause: 102 [RECOVERY_ON_TIMER_EXPIRE]
2009-09-16 20:01:47.623316 [DEBUG] switch_ivr_originate.c:2138
Originate Resulted in Error Cause: 102 [RECOVERY_ON_TIMER_EXPIRE]
2009-09-16 20:02:59.777664 [CRIT] mod_sofia.c:2601 Error Creating
Session
2009-09-16 20:02:59.777664 [CRIT] mod_sofia.c:2601 Error Creating
Session
2009-09-16 20:02:59.777664 [CRIT] mod_sofia.c:2601 Error Creating
Session
2009-09-16 20:02:59.788134 [CRIT] mod_sofia.c:2601 Error Creating
Session
nta: sent 503 Maximum Calls In Progress for INVITE (1)
nta: sent 503 Maximum Calls In Progress for INVITE (1)
nta: sent 503 Maximum Calls In Progress for INVITE (1)
nta: sent 503 Maximum Calls In Progress for INVITE (1)
nta: sent 502 Bad Gateway for INVITE (1)
nta: sent 502 Bad Gateway for INVITE (1)
nta: sent 502 Bad Gateway for INVITE (1)
nta: sent 503 Maximum Calls In Progress for INVITE (1)
2009-09-16 20:02:59.788134 [CRIT] mod_sofia.c:2601 Error Creating
Session
2009-09-16 20:02:59.788134 [CRIT] mod_sofia.c:2601 Error Creating
Session
2009-09-16 20:02:59.788134 [CRIT] mod_sofia.c:2601 Error Creating
Session
nta: sent 502 Bad Gateway for INVITE (1)
nta: sent 502 Bad Gateway for INVITE (1)
nta: sent 502 Bad Gateway for INVITE (1)
nta: sent 502 Bad Gateway for INVITE (1)
2009-09-16 20:02:59.861110 [CRIT] switch_time.c:500 Over Session Rate
of 100!
nta: sent 480 Temporarily Unavailable for INVITE (1)
nta: sent 480 Temporarily Unavailable for INVITE (1)
nta: sent 480 Temporarily Unavailable for INVITE (1)
nta: sent 480 Temporarily Unavailable for INVITE (1)
nta: sent 480 Temporarily Unavailable for INVITE (1)
nta: sent 480 Temporarily Unavailable for INVITE (1)
-------------------------------------------


I'm going to try increasing the "session rate", but I'm wondering if
there are other limitations I'm running into.

Any thoughts/suggestions?

Vladimir


________________________________________
From: freeswitch-users-bounces@lists.freeswitch.org
[freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of Anthony
Minessale [anthony.minessale@gmail.com]
Sent: Tuesday, September 15, 2009 6:32 PM
To: freeswitch-users@lists.freeswitch.org
Subject: Re: [Freeswitch-users] 502 Bad Gateway: Destination out of
order error

It's probably from this

2009-09-15 14:34:55.838365 [ERR] sofia_glue.c:2503 AUDIO RTP REPORTS
ERROR: [Socket Error!]
2009-09-15 14:34:55.838365 [NOTICE] sofia_glue.c:2504 Hangup
sofia/external/411@192.168.0.150<mailto:411@192.168.0.150>
[CS_CONSUME_MEDIA][DESTINATION_OUT_OF_ORDER
]
2009-09-15 14:34:55.838365 [ERR] sofia.c:3796 RTP Error!

your machine failed to produce a socket when requested.

My blind guess, you are on a 32 bit machine and you do not have the
ulimits set for enough file descriptors etc..


ulimit -c unlimited
ulimit -d unlimited
ulimit -f unlimited
ulimit -i unlimited
ulimit -n 999999
ulimit -q unlimited
ulimit -u unlimited
ulimit -v unlimited
ulimit -x unlimited
ulimit -s 244

ulimit -l unlimited


On Tue, Sep 15, 2009 at 5:22 PM, email lists
<email.list.subscriber@gmail.com<mailto:email.list.subscriber@gmail.co
m>> wrote:

Hello All,



Wondering if anyone has experienced this issue before. I've attached
a snip of the log file where the error occurs and could use some leads
on this. What's interesting is that the call appears to complete as
normal, and a radius stop message even gets generated, though the
duration is ~1 second.



<snip>

h323-disconnect-time = "h323-disconnect-time=14:35:01.000 UTC Tue Sep
15 2009"

h323-connect-time = "h323-connect-time=14:34:59.000 UTC Tue Sep 15
2009"

</snip>



While there are a lot of pieces involved, the call scenario is pretty
basic (no transfers, no holds, etc.), just a few redirects that
Freeswitch appears to be able to handle without issue. Attached is a
dumb'd down call ladder.



I tried different rates at which I generate the calls, but it didn't
seem to correlate to the amount of errors I am seeing.



Sending a total of 100 calls, with a call duration of 10 seconds:

@10 calls per second = 14 "502" errors.

@5 calls per second = 4 "502" errors.

@4 calls per second = NO ERRORS (1st run)

@4 calls per second = 39 "502" errors.



Please let me know if any additional information is needed.



Thanks in advance for all help.



Vladimir





_______________________________________________
FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org<mailto:FreeSWITCH-users@lists.fr
eeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-use
rs
http://www.freeswitch.org




--
Anthony Minessale II

FreeSWITCH http://www.freeswitch.org/
ClueCon http://www.cluecon.com/
Twitter: http://twitter.com/FreeSWITCH_wire

AIM: anthm
MSN:anthony_minessale@hotmail.com<mailto:MSN%3Aanthony_minessale@hotma
il.com>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com<mailto:PAYPAL%3Aanthon
y.minessale@gmail.com>
IRC: irc.freenode.net<http://irc.freenode.net> #freeswitch

FreeSWITCH Developer Conference
sip:888@conference.freeswitch.org<mailto:sip%3A888@conference.freeswit
ch.org>
iax:guest@conference.freeswitch.org/888<http://iax:guest@conference.fr
eeswitch.org/888>
googletalk:conf+888@conference.freeswitch.org<mailto:googletalk%3Aconf
%2B888@conference.freeswitch.org>
pstn:213-799-1400



_______________________________________________
FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
http://www.freeswitch.org

[brian at freeswitch.org]

Are you using SIPP?

/b

On Sep 17, 2009, at 8:33 AM, email lists wrote:

[email.list.subscriber ...]

I'm running on a (2) Dual Core, 16G RAM machine. Tried 5 calls per second with 3 minute duration -- noticed same issues.

I throttled down to 5 calls per second, with a 30 second duration and it seems quite a bit more stable now, though this doesn’t meet our requirements.

Looking at moving Freeswitch to a Quad-core 2.8ghz server now, and will re-test.

Vladimir


From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of Anthony Minessale
Sent: Thursday, September 17, 2009 10:44 AM
To: freeswitch-users@lists.freeswitch.org
Subject: Re: [Freeswitch-users] 480 Temporarily Unavailable/503 Max Sessions (was 502 Bad Gateway: Destination out of order error)


You should get a more powerful machine if you intend to sustain upwards of 3600 calls at 20cps

We recommend a 64 bit multi-core machine running 64bit Centos5.3


On Thu, Sep 17, 2009 at 9:31 AM, email lists <email.list.subscriber@gmail.com (email.list.subscriber@gmail.com)> wrote:
Yes.

-----Original Message-----
From: freeswitch-users-bounces@lists.freeswitch.org (freeswitch-users-bounces@lists.freeswitch.org)

[mailto:freeswitch-users-bounces@lists.freeswitch.org (freeswitch-users-bounces@lists.freeswitch.org)] On Behalf Of
Brian West
Sent: Thursday, September 17, 2009 10:07 AM
To: freeswitch-users@lists.freeswitch.org (freeswitch-users@lists.freeswitch.org)

Subject: Re: [Freeswitch-users] 480 Temporarily Unavailable/503 Max
Sessions (was 502 Bad Gateway: Destination out of order error)

Are you using SIPP?

/b

On Sep 17, 2009, at 8:33 AM, email lists wrote:

[email.list.subscriber ...]

Solaris OS is at 64 bit. Freeswitch was compiled as 32 bit however.
Our sysadmin will attempt to compile it at 64 bit.

In the meantime, I have moved Freeswitch over to the new server and am in the process of testing.

Vladimir

From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of Anthony Minessale
Sent: Thursday, September 17, 2009 2:58 PM
To: freeswitch-users@lists.freeswitch.org
Subject: Re: [Freeswitch-users] 480 Temporarily Unavailable/503 Max Sessions (was 502 Bad Gateway: Destination out of order error)


You never answered the question if you are using the 32 bit version of the OS
If you are, make sure you do not, this has a huge impact on your performance.


On Thu, Sep 17, 2009 at 12:48 PM, email lists <email.list.subscriber@gmail.com (email.list.subscriber@gmail.com)> wrote:
I'm running on a (2) Dual Core, 16G RAM machine. Tried 5 calls per second with 3 minute duration -- noticed same issues.

I throttled down to 5 calls per second, with a 30 second duration and it seems quite a bit more stable now, though this doesn’t meet our requirements.

Looking at moving Freeswitch to a Quad-core 2.8ghz server now, and will re-test.

Vladimir


From: freeswitch-users-bounces@lists.freeswitch.org (freeswitch-users-bounces@lists.freeswitch.org) [mailto:freeswitch-users-bounces@lists.freeswitch.org (freeswitch-users-bounces@lists.freeswitch.org)] On Behalf Of Anthony Minessale
Sent: Thursday, September 17, 2009 10:44 AM

To: freeswitch-users@lists.freeswitch.org (freeswitch-users@lists.freeswitch.org)
Subject: Re: [Freeswitch-users] 480 Temporarily Unavailable/503 Max Sessions (was 502 Bad Gateway: Destination out of order error)




You should get a more powerful machine if you intend to sustain upwards of 3600 calls at 20cps

We recommend a 64 bit multi-core machine running 64bit Centos5.3
On Thu, Sep 17, 2009 at 9:31 AM, email lists <email.list.subscriber@gmail.com (email.list.subscriber@gmail.com)> wrote:
Yes.

-----Original Message-----
From: freeswitch-users-bounces@lists.freeswitch.org (freeswitch-users-bounces@lists.freeswitch.org)

[mailto:freeswitch-users-bounces@lists.freeswitch.org (freeswitch-users-bounces@lists.freeswitch.org)] On Behalf Of
Brian West
Sent: Thursday, September 17, 2009 10:07 AM
To: freeswitch-users@lists.freeswitch.org (freeswitch-users@lists.freeswitch.org)

Subject: Re: [Freeswitch-users] 480 Temporarily Unavailable/503 Max
Sessions (was 502 Bad Gateway: Destination out of order error)

Are you using SIPP?

/b

On Sep 17, 2009, at 8:33 AM, email lists wrote: