diff options
Diffstat (limited to '_build/static/archives/extend/2012-December/000024.html')
| -rw-r--r-- | _build/static/archives/extend/2012-December/000024.html | 131 |
1 files changed, 131 insertions, 0 deletions
diff --git a/_build/static/archives/extend/2012-December/000024.html b/_build/static/archives/extend/2012-December/000024.html new file mode 100644 index 00000000..f55a4f92 --- /dev/null +++ b/_build/static/archives/extend/2012-December/000024.html @@ -0,0 +1,131 @@ +<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> +<HTML> + <HEAD> + <TITLE> [99s-extend] Cowboy HTTPS connection memory usage + </TITLE> + <LINK REL="Index" HREF="index.html" > + <LINK REL="made" HREF="mailto:extend%40lists.ninenines.eu?Subject=Re%3A%20%5B99s-extend%5D%20Cowboy%20HTTPS%20connection%20memory%20usage&In-Reply-To=%3CCAJ0zLRM4mBK0Du8W0Dg84D6vOqpMTOOOqbJD5L0ZO9cyxR%3DrZg%40mail.gmail.com%3E"> + <META NAME="robots" CONTENT="index,nofollow"> + <style type="text/css"> + pre { + white-space: pre-wrap; /* css-2.1, curent FF, Opera, Safari */ + } + </style> + <META http-equiv="Content-Type" content="text/html; charset=us-ascii"> + <LINK REL="Previous" HREF="000023.html"> + <LINK REL="Next" HREF="000025.html"> + </HEAD> + <BODY BGCOLOR="#ffffff"> + <H1>[99s-extend] Cowboy HTTPS connection memory usage</H1> + <B>rambocoder</B> + <A HREF="mailto:extend%40lists.ninenines.eu?Subject=Re%3A%20%5B99s-extend%5D%20Cowboy%20HTTPS%20connection%20memory%20usage&In-Reply-To=%3CCAJ0zLRM4mBK0Du8W0Dg84D6vOqpMTOOOqbJD5L0ZO9cyxR%3DrZg%40mail.gmail.com%3E" + TITLE="[99s-extend] Cowboy HTTPS connection memory usage">erlang at rambocoder.com + </A><BR> + <I>Fri Dec 21 17:49:37 CET 2012</I> + <P><UL> + <LI>Previous message: <A HREF="000023.html">[99s-extend] Cowboy HTTPS connection memory usage +</A></li> + <LI>Next message: <A HREF="000025.html">[99s-extend] Cowboy HTTPS connection memory usage +</A></li> + <LI> <B>Messages sorted by:</B> + <a href="date.html#24">[ date ]</a> + <a href="thread.html#24">[ thread ]</a> + <a href="subject.html#24">[ subject ]</a> + <a href="author.html#24">[ author ]</a> + </LI> + </UL> + <HR> +<!--beginarticle--> +<PRE>In my preliminary testing, I used Jmeter this morning since it's an +easy GUI load testing app and this is what I am seeing: + +With R15B03-01 [smp:4:4] [async-threads:4] [hipe] [kernel-poll:true], when +I establish 1K concurrent connections via HTTPS, each connection takes up +about 68K of memory. + +Unfortunately, after about 1050-1200 connections, on my test server the +Erlang scheduler jumps to 100% CPU utilization on all 4 schedulers, while +up to that point the scheduler's load was oscillating up and down. Using +the Observer, there is only 1 ssl_connection_sup in the ssl application, +having to deal with 1000+ gen_fsm workers, so that might be the bottleneck. +Since the ulimit on my server is 50000 I don't think I am hitting any type +of file handler's limit. + +Loïc and the group, am I missing some setting that is causing the scheduler +to go to 100% CPU and the run que in observer to be 99? + +Sincerely, + +rambocoder + + +On Fri, Dec 21, 2012 at 6:45 AM, Loïc Hoguin <<A HREF="https://lists.ninenines.eu/listinfo/extend">essen at ninenines.eu</A>> wrote: + +><i> On 12/21/2012 04:34 AM, rambocoder wrote: +</I>><i> +</I>>><i> Does anybody know either from benchmarks or real world data what is the +</I>>><i> average memory footprint of each concurrent HTTPS connection to cowboy? +</I>>><i> +</I>><i> +</I>><i> I don't have anything, sorry. I'm guessing it consumes a lot more than TCP +</I>><i> though. +</I>><i> +</I>><i> +</I>><i> SSL app in Erlang reuses SSL session-ids so I am not sure if the Apache +</I>>><i> Bench I test with reuses the session id or it does not. +</I>>><i> +</I>><i> +</I>><i> I wouldn't know, but I wouldn't trust Apache Bench doing the right thing. +</I>><i> Any other benchmark tool usually works better in my experience. +</I>><i> +</I>><i> +</I>><i> BTW, what makes an erlang api "documented" vs "undocumented". For +</I>>><i> example ssl:session_info/1 function here ( +</I>>><i> <A HREF="https://github.com/erlang/otp/**blob/maint/lib/ssl/src/ssl.**erl#L411<https://github.com/erlang/otp/blob/maint/lib/ssl/src/ssl.erl#L411">https://github.com/erlang/otp/**blob/maint/lib/ssl/src/ssl.**erl#L411<https://github.com/erlang/otp/blob/maint/lib/ssl/src/ssl.erl#L411</A>>) has +</I>>><i> a spec and a short doc, but session_info is not described +</I>>><i> <A HREF="http://www.erlang.org/doc/man/**ssl.html<http://www.erlang.org/doc/man/ssl.html">http://www.erlang.org/doc/man/**ssl.html<http://www.erlang.org/doc/man/ssl.html</A>>.ssl:session_info/1 is a useful +</I>>><i> function to be able to track if the load generator is reusing the SSL +</I>>><i> session_id or it is generating new one, because that would make all the +</I>>><i> difference during measurement due to Erlang caching SSL sessions by +</I>>><i> default. +</I>>><i> +</I>><i> +</I>><i> The documentation is separate (they're not using edoc). It's perhaps not +</I>><i> deemed useful enough for documenting it. I wouldn't worry about using it +</I>><i> for measurements though. +</I>><i> +</I>><i> Try asking Ingela on the ML about it, perhaps they just forgot to document +</I>><i> it. +</I>><i> +</I>><i> -- +</I>><i> Loďc Hoguin +</I>><i> Erlang Cowboy +</I>><i> Nine Nines +</I>><i> <A HREF="http://ninenines.eu">http://ninenines.eu</A> +</I>><i> +</I>><i> +</I>-------------- next part -------------- +An HTML attachment was scrubbed... +URL: <<A HREF="http://lists.ninenines.eu/archives/extend/attachments/20121221/8bfb2f11/attachment.html">http://lists.ninenines.eu/archives/extend/attachments/20121221/8bfb2f11/attachment.html</A>> +</PRE> + +<!--endarticle--> + <HR> + <P><UL> + <!--threads--> + <LI>Previous message: <A HREF="000023.html">[99s-extend] Cowboy HTTPS connection memory usage +</A></li> + <LI>Next message: <A HREF="000025.html">[99s-extend] Cowboy HTTPS connection memory usage +</A></li> + <LI> <B>Messages sorted by:</B> + <a href="date.html#24">[ date ]</a> + <a href="thread.html#24">[ thread ]</a> + <a href="subject.html#24">[ subject ]</a> + <a href="author.html#24">[ author ]</a> + </LI> + </UL> + +<hr> +<a href="https://lists.ninenines.eu/listinfo/extend">More information about the Extend +mailing list</a><br> +</body></html> |