Re: [mosquitto-dev] Commercial Support for Mosquitto Broker

[Manuel Domínguez Dorado <manolodd@xxxxxxxxx>]

Hi Karl,

this is the thread. After this email, I continued some days (3-4) tunning several the Linux kernel parameters, the JVM (I used java for my clients), the number of clients distributed in several virtual machines, and reducing the nnumber of bits of my certificate for TLS. After that, I achieved about 200K connections. But they continuously disconnected because of timeouts (only 1 core to take care of 200K connections are not enough).

The result is the same; I did not be able to run more than this number of connections that, moreover, were not stable. As far as I started sending traffic everything failed. And I was looking for a million connection. So, definitelly, I abandoned mosquitto to test other options.

But my previous mail was an answer to the question of "1024 limit of Mosquitto" and, definitely, ~200K connections are greater than 1K connections.

There were lots of thigs I had to touch day by day until my best result (the one of ~200K connections) but the most important one were the sysctl configuration in Linux. I could find this file if you need it. But again, I do not think that it is possible to achieve a set of hundreds of thousands of stable connections while Mosquitto is single-threaded. It was frustrating at that moment.

Best regards.

2016-06-28 12:37 GMT+02:00 Karl Palsson <karlp@xxxxxxxxxxxx>:

Resending

Karl Palsson <karlp@xxxxxxxxxxxx> wrote:
>
> Manuel Domínguez Dorado  <manolodd@xxxxxxxxx> wrote:
> > Hi Karl... We already had this conversación in this mailing
> > list about a year ago (look for it in the list archive), jeje.
> > I published everything I did, although It was not an empirical
> > experimental. Basically: a combination of linux kernel tunning
> > and a bit of hardware. I stopped after discovering that
> > mosquitto is single-threaded and it does not take advantage of
> > múltiple processors.
>
>
> Well, the last I saw from you was:
>
> https://dev.eclipse.org/mhonarc/lists/mosquitto-dev/msg00470.html
> and
> https://dev.eclipse.org/mhonarc/lists/mosquitto-dev/msg00544.html
>
> You only got to 52k connections, and if I understood, it
> crashed when you started having traffic. Are there more threads
> that I'm not finding? Could you share the thread where you got
> "hundreds of thousands" of clients?
>
> Cheers,
> Karl P
>
>
> >
> > 2016-06-27 15:29 GMT+02:00 Karl Palsson <karlp@xxxxxxxxxxxx>:
> >
> > >
> > > Manuel Domínguez Dorado  <manolodd@xxxxxxxxx> wrote:
> > > > Some months ago I was testing and achieved hundreds of
> > > > thousands clients... for sure more than 1024.
> > >
> > > Care to elaborate? Claims like this have been made here and there
> > > for years, but I've never seen anywhere near that number. What
> > > host machine specs wwere you using? What was the keepalive time
> > > on those clients? What was the average messages/sec/client
> > > figures? What sort of mix of subscriber only, publisher only
> > > clients did you have?
> > >
> > > Sincerely,
> > > Karl Palsson
> > >
> > >
> > > > El 27/6/2016
> > > > 14:51, "John Harrison" <john@xxxxxxxxxxx> escribió:
> > > >
> > > >
> > > > On Wed, Jun 22, 2016 at 5:23 AM, Jinto Simon
> > > > <jinto.simon@xxxxxxxxx> wrote:
> > > >
> > > > > we know that mosquito broker can have maximum 1024 clients
> > > > >
> > > >
> > > > I never saw a followup on this. It seems to contradict much of
> > > > the documentation I have read. What is this based on?

> > > >
> > > >
> > > >
> > > > _______________________________________________
> > > > mosquitto-dev mailing list
> > > > mosquitto-dev@xxxxxxxxxxx
> > > > To change your delivery options, retrieve your password, or
> > > > unsubscribe from this list, visit
> > > > https://dev.eclipse.org/mailman/listinfo/mosquitto-dev
> > > > _______________________________________________ mosquitto-dev
> > > > mailing list mosquitto-dev@xxxxxxxxxxx To change your delivery
> > > > options, retrieve your password, or unsubscribe from this list,
> > > > visit https://dev.eclipse.org/mailman/listinfo/mosquitto-dev
> >
> >
> >
> >
> > _______________________________________________
> > mosquitto-dev mailing list
> > mosquitto-dev@xxxxxxxxxxx
> > To change your delivery options, retrieve your password, or
> > unsubscribe from this list, visit
> > https://dev.eclipse.org/mailman/listinfo/mosquitto-dev

--

---
Manuel Domínguez Dorado
ingeniero ARROBA ManoloDominguez PUNTO com
http://www.ManoloDominguez.com