[Herddb-dev] herddb-dev Digest, Vol 14, Issue 7

Amit Chavan achavan1 at gmail.com
Fri Aug 23 17:27:16 CEST 2019


Great news Ale. I will look at integrating the benchmark. I need to catch
up to speed with the collections framework Enrico added.

On Fri, Aug 23, 2019 at 2:58 AM <herddb-dev-request at lists.herddb.org> wrote:

> Send herddb-dev mailing list submissions to
>         herddb-dev at lists.herddb.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         http://lists.herddb.org/mailman/listinfo/herddb-dev
> or, via email, send a message with subject or body 'help' to
>         herddb-dev-request at lists.herddb.org
>
> You can reach the person managing the list at
>         herddb-dev-owner at lists.herddb.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of herddb-dev digest..."
>
>
> Today's Topics:
>
>    1. HerdDB collections in production (Alessandro Luccaroni - Diennea)
>    2. Re: HerdDB collections in production (Enrico Olivelli)
>    3. R:  HerdDB collections in production
>       (Alessandro Luccaroni - Diennea)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Thu, 22 Aug 2019 15:46:38 +0000
> From: Alessandro Luccaroni - Diennea
>         <alessandro.luccaroni at diennea.com>
> To: Herddb developers <herddb-dev at lists.herddb.org>
> Subject: [Herddb-dev] HerdDB collections in production
> Message-ID: <dc1d86ab556d4778a4b2b3bf32819659 at diennea.com>
> Content-Type: text/plain; charset="us-ascii"
>
> Hi list,
> I'm happy to say that, since the last update of Herd (v0.11.9), we are
> using HerdDB collections in production system and we are very pleased with
> the performance and the memory usage of Herd.
>
> We first tried to switch with herd v0.11.0 but we encountered some
> problems on services with lots of data being continuisly load and unloaded
> (mainly related to filesystem usage)...you can see an history of the fixes
> needed in the release histo fo the v0.11 branch, thanks Enrico and Diego!
>
> I don't have hard numbers on hand (I need to switch back to MapDB and
> perform some comparisons, I will update you tomorrow on that), but the
> performance are at least in line (I think they are better) with the added
> benefit of the controlled memory usage and a BIG reduction in storage IOPS
> (Herd data storage versus the memory mapped files of MapDB).
>
> PS: @Amit I've found this benchmark used in past by MapDB (
> https://github.com/jankotek/mapdb-benchmarks), maybe it would be good to
> integrate some bench regarding Collections before starting advertise this
> feature of herd
>
> Alessandro Luccaroni
> Platform Manager @ Diennea - MagNews
> Tel.: (+39) 0546 066100 Int. 924 - Mob.: (+39) 393 7273519
> Viale G.Marconi 30/14 - 48018 Faenza (RA) - Italy
>
>
> ________________________________
>
> CONFIDENTIALITY & PRIVACY NOTICE
> This e-mail (including any attachments) is strictly confidential and may
> also contain privileged information. If you are not the intended recipient
> you are not authorised to read, print, save, process or disclose this
> message. If you have received this message by mistake, please inform the
> sender immediately and destroy this e-mail, its attachments and any copies.
> Any use, distribution, reproduction or disclosure by any person other than
> the intended recipient is strictly prohibited and the person responsible
> may incur in penalties.
> The use of this e-mail is only for professional purposes; there is no
> guarantee that the correspondence towards this e-mail will be read only by
> the recipient, because, under certain circumstances, there may be a need to
> access this email by third subjects belonging to the Company.
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.herddb.org/pipermail/herddb-dev/attachments/20190822/953888f7/attachment-0001.html
> >
>
> ------------------------------
>
> Message: 2
> Date: Thu, 22 Aug 2019 18:38:49 +0200
> From: Enrico Olivelli <eolivelli at gmail.com>
> To: Herddb developers <herddb-dev at lists.herddb.org>
> Subject: Re: [Herddb-dev] HerdDB collections in production
> Message-ID:
>         <
> CACcefgdrWML5jn0TBa0Wwb_s4MCKWYva_CFVRvVebR1krkzsxQ at mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Il gio 22 ago 2019, 17:47 Alessandro Luccaroni - Diennea <
> alessandro.luccaroni at diennea.com> ha scritto:
>
> > Hi list,
> >
> > I?m happy to say that, since the last update of Herd (v0.11.9), we are
> > using HerdDB collections in production system and we are very pleased
> with
> > the performance and the memory usage of Herd.
> >
>
>
> Great news!
>
> Kudos
>
>
>
> >
> > We first tried to switch with herd v0.11.0 but we encountered some
> > problems on services with lots of data being continuisly load and
> unloaded
> > (mainly related to filesystem usage)?you can see an history of the fixes
> > needed in the release histo fo the v0.11 branch, thanks Enrico and Diego!
> >
> >
> > I don?t have hard numbers on hand (I need to switch back to MapDB and
> > perform some comparisons, I will update you tomorrow on that), but the
> > performance are at least in line (I think they are better) with the added
> > benefit of the controlled memory usage and a BIG reduction in storage
> IOPS
> > (Herd data storage versus the memory mapped files of MapDB).
> >
> >
> >
> > PS: @Amit I?ve found this benchmark used in past by MapDB (
> > https://github.com/jankotek/mapdb-benchmarks), maybe it would be good to
> > integrate some bench regarding Collections before starting advertise this
> > feature of herd
> >
> Sure
> We can wait for 0.12.0 release
>
>
> Enrico
>
>
> >
> > *Alessandro Luccaroni*
> > Platform Manager @ Diennea - MagNews
> > Tel.: (+39) 0546 066100 Int. 924 - Mob.: (+39) 393 7273519
> > Viale G.Marconi 30/14 - 48018 Faenza (RA) - Italy
> >
> >
> >
> > ------------------------------
> >
> > CONFIDENTIALITY & PRIVACY NOTICE
> > This e-mail (including any attachments) is strictly confidential and may
> > also contain privileged information. If you are not the intended
> recipient
> > you are not authorised to read, print, save, process or disclose this
> > message. If you have received this message by mistake, please inform the
> > sender immediately and destroy this e-mail, its attachments and any
> copies.
> > Any use, distribution, reproduction or disclosure by any person other
> than
> > the intended recipient is strictly prohibited and the person responsible
> > may incur in penalties.
> > The use of this e-mail is only for professional purposes; there is no
> > guarantee that the correspondence towards this e-mail will be read only
> by
> > the recipient, because, under certain circumstances, there may be a need
> to
> > access this email by third subjects belonging to the Company.
> > _______________________________________________
> > herddb-dev mailing list
> > herddb-dev at lists.herddb.org
> > http://lists.herddb.org/mailman/listinfo/herddb-dev
> >
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.herddb.org/pipermail/herddb-dev/attachments/20190822/038a4022/attachment-0001.html
> >
>
> ------------------------------
>
> Message: 3
> Date: Fri, 23 Aug 2019 09:36:44 +0000
> From: Alessandro Luccaroni - Diennea
>         <alessandro.luccaroni at diennea.com>
> To: Herddb developers <herddb-dev at lists.herddb.org>
> Subject: [Herddb-dev] R:  HerdDB collections in production
> Message-ID: <a3ea1bbbd91246a18b7de95c48545101 at diennea.com>
> Content-Type: text/plain; charset="utf-8"
>
> Some update on the numbers: I?ve run the same activity in production on
> MapDB v3.0.7 (with memory mapped files) and HerdDB v0.11.9 and we have a
> ~13x speedup (6200 sec vs 450 sec)
>
> All this with slightly lower CPU usage, same memory footprint (with the
> advantage that all the memory is inside the JVM heap, so we don?t see OOM
> error from the OS anymore) and a bit more GC load (this is expected since
> we don?t use direct memory anymore).
>
> Ale
>
> Da: herddb-dev-bounces at lists.herddb.org <
> herddb-dev-bounces at lists.herddb.org> Per conto di Enrico Olivelli
> Inviato: gioved? 22 agosto 2019 18:39
> A: Herddb developers <herddb-dev at lists.herddb.org>
> Oggetto: Re: [Herddb-dev] HerdDB collections in production
>
>
> We first tried to switch with herd v0.11.0 but we encountered some
> problems on services with lots of data being continuisly load and unloaded
> (mainly related to filesystem usage)?you can see an history of the fixes
> needed in the release histo fo the v0.11 branch, thanks Enrico and Diego!
>
> I don?t have hard numbers on hand (I need to switch back to MapDB and
> perform some comparisons, I will update you tomorrow on that), but the
> performance are at least in line (I think they are better) with the added
> benefit of the controlled memory usage and a BIG reduction in storage IOPS
> (Herd data storage versus the memory mapped files of MapDB).
> PS: @Amit I?ve found this benchmark used in past by MapDB (
> https://github.com/jankotek/mapdb-benchmarks), maybe it would be good to
> integrate some bench regarding Collections before starting advertise this
> feature of herd
> Sure
> We can wait for 0.12.0 release
>
>
> Enrico
>
> ________________________________
>
> CONFIDENTIALITY & PRIVACY NOTICE
> This e-mail (including any attachments) is strictly confidential and may
> also contain privileged information. If you are not the intended recipient
> you are not authorised to read, print, save, process or disclose this
> message. If you have received this message by mistake, please inform the
> sender immediately and destroy this e-mail, its attachments and any copies.
> Any use, distribution, reproduction or disclosure by any person other than
> the intended recipient is strictly prohibited and the person responsible
> may incur in penalties.
> The use of this e-mail is only for professional purposes; there is no
> guarantee that the correspondence towards this e-mail will be read only by
> the recipient, because, under certain circumstances, there may be a need to
> access this email by third subjects belonging to the Company.
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.herddb.org/pipermail/herddb-dev/attachments/20190823/c087ab4d/attachment.html
> >
>
> ------------------------------
>
> _______________________________________________
> herddb-dev mailing list
> herddb-dev at lists.herddb.org
> http://lists.herddb.org/mailman/listinfo/herddb-dev
>
>
> End of herddb-dev Digest, Vol 14, Issue 7
> *****************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.herddb.org/pipermail/herddb-dev/attachments/20190823/fe65f0e8/attachment.html>


More information about the herddb-dev mailing list