Re: [mosquitto-dev] Er, is there a version without memory leaks?

[Roger Light <roger@xxxxxxxxxx>]

Hi Andrew,

Thanks for addressing this in a considerate way. Assuming this is a
real problem, I'm very keen to sort it out. I use valgrind all the
time, the mosquitto tests can run under valgrind and
test.mosquitto.org is almost always running under one valgrind tool or
another these days.

When mosquitto exits I don't see any leaks in the valgrind "definitely
lost" sense, but that just means the memory is being freed at the end.
It could be, for example, that messages are being stored that are
never subsequently used by a client but aren't removed until the end.

Are you able to share any more details about your setup, such as the
config, the pattern of topics that is in use, what client settings you
are using - "clean session" being the important one, and whether
messages are retained? If there's anything you'd prefer to share
privately that is fine as well.

Regards,

Roger

On Wed, 22 May 2019 at 10:40, Andrew Hilborne <andrew@xxxxxxxxxxxx> wrote:
>
> Sorry to ask such a rude question.
>
> We have been running an old version (1.4.14) for some time on our IoT fleet. I don't know how busy some people's servers are, but I would think ours are 'medium busy': we ship around 800kB/1200 messages per minute. Some stats are at the end of this message.
>
> We have always suffered from an apparent memory leak. I.e. the heap keeps growing. This crashes our machines after several days. Here's what the heap looks like before that:
>
> $SYS/broker/heap/current 37769512
> $SYS/broker/heap/maximum 37782576
> $SYS/broker/heap/current 37772776
> $SYS/broker/heap/current 37776040
> $SYS/broker/heap/maximum 37783000
>
> .. and here's a v1.5.8 after ~ 15 hours. As you can see, it's growing too:
>
> $SYS/broker/heap/maximum 16341692
> $SYS/broker/heap/current 16340424
> $SYS/broker/heap/maximum 16344940
> $SYS/broker/heap/current 16343672
> $SYS/broker/heap/maximum 16348188
>
> Hence my question about memory leaks. If a later version has fixed these problems, please let me know. Else I can try valgrind and get back to the list.
>
> Many thanks!
>
> Andrew Hilborne
>
> --8<---------------8<---------------8<---------------8<------------
> Here are some more stats from v1.5.8:
>
> $SYS/broker/version mosquitto version 1.5.8
> $SYS/broker/uptime 66165 seconds
> $SYS/broker/clients/total 8
> $SYS/broker/clients/inactive 0
> $SYS/broker/clients/disconnected 0
> $SYS/broker/clients/active 8
> $SYS/broker/clients/connected 8
> $SYS/broker/clients/expired 0
> $SYS/broker/clients/maximum 9
> $SYS/broker/load/messages/received/1min 339.34
> $SYS/broker/load/messages/received/5min 339.86
> $SYS/broker/load/messages/received/15min 339.78
> $SYS/broker/load/messages/sent/1min 696.40
> $SYS/broker/load/messages/sent/5min 767.64
> $SYS/broker/load/messages/sent/15min 761.36
> $SYS/broker/load/publish/dropped/1min 0.00
> $SYS/broker/load/publish/dropped/5min 0.00
> $SYS/broker/load/publish/dropped/15min 0.00
> $SYS/broker/load/publish/received/1min 332.50
> $SYS/broker/load/publish/received/5min 332.28
> $SYS/broker/load/publish/received/15min 332.11
> $SYS/broker/load/publish/sent/1min 689.55
> $SYS/broker/load/publish/sent/5min 760.07
> $SYS/broker/load/publish/sent/15min 753.68
> $SYS/broker/load/bytes/received/1min 327277.76
> $SYS/broker/load/bytes/received/5min 323647.33
> $SYS/broker/load/bytes/received/15min 322932.85
> $SYS/broker/load/bytes/sent/1min 858260.42
> $SYS/broker/load/bytes/sent/5min 849654.01
> $SYS/broker/load/bytes/sent/15min 847230.58
> $SYS/broker/load/sockets/1min 0.06
> $SYS/broker/load/sockets/5min 0.27
> $SYS/broker/load/sockets/15min 0.39
> $SYS/broker/load/connections/1min 0.06
> $SYS/broker/load/connections/5min 0.27
> $SYS/broker/load/connections/15min 0.39
> $SYS/broker/messages/stored 52
> $SYS/broker/messages/received 374681
> $SYS/broker/messages/sent 768738
> $SYS/broker/store/messages/count 52
> $SYS/broker/store/messages/bytes 294
> $SYS/broker/subscriptions/count 62
> $SYS/broker/retained messages/count 52
> $SYS/broker/heap/current 17641032
> $SYS/broker/heap/maximum 17646888
> $SYS/broker/publish/messages/dropped 0
> $SYS/broker/publish/messages/received 365915
> $SYS/broker/publish/messages/sent 759973
> $SYS/broker/publish/bytes/received 341141939
> $SYS/broker/publish/bytes/sent 920239789
> $SYS/broker/bytes/received 355765521
> $SYS/broker/bytes/sent 933347599
> _______________________________________________
> mosquitto-dev mailing list
> mosquitto-dev@xxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> https://www.eclipse.org/mailman/listinfo/mosquitto-dev