Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [epp-dev] Adding a error log collector to Mars milestone builds?

The first thing that comes to mind is network traffic.
Working with it for two days, it produced ~300 HTTP Post requests with several kilobytes of data each. If we assume that there will be a couple of hundred developers using that feature in the first milestone builds to report errors, this may sum up to:

200 developers x 150 requests / day = 30.000 requests per day.
30.000 requests per day x 10KB data = "" traffic.

Having said this, since many errors look quite similar, the error log reporter can be optimized to send only „new" stacktraces in the future and thus reduce the network traffic.


Second thing that comes to mind is disk space.
For the time being, a few GB of disk space should suffice.



At the moment the data is sent to recommenders.eclipse.org, a virtual machine Denis provisioned some time ago. It’s not a very powerful vm but from hardware perspective I’d say, I’m good to go for the first milestones.

But I wonder whether making the error logs accessible as they are today is okay for EMO. See [1] for a collection of stacktraces I sent in the past 2 days. AFAICT, there is at least two log statements in JDT that log the source code of a whole file in the case of an error. Other statements contain names of files and ids (which cannot be filtered easily).


Marcel



Am 12.08.2014 um 13:52 schrieb Mike Milinkovich <mike.milinkovich@xxxxxxxxxxx>:


Marcel, 

Can you please describe the server side requirements for this? E.g what will the EMO need to support for its operations?

Mike Milinkovich
mike.milinkovich@xxxxxxxxxxx
+1.613.220.3223 (mobile)
  Original Message  
From: Marcel Bruch
Sent: Monday, August 11, 2014 4:47 PM
To: mike.milinkovich@xxxxxxxxxxx; Eclipse Packaging Project
Cc: Gunnar Wagenknecht
Subject: Re: [epp-dev] Adding a error log collector to Mars milestone builds?

Let’s move that code in the timeframe of M2-M4 and go with the current setup for M1 and M2 to get some user feedback first.

Mike,
I silently assume that this kind of usage data collector has (or gets) approval of EMO. Is this correct - or is there something else I would have to do?

Thx,
Marcel




Am 11.08.2014 um 20:39 schrieb Mike Milinkovich <mike.milinkovich@xxxxxxxxxxx>:

On 11/08/2014 1:57 PM, Gunnar Wagenknecht wrote:
Oh we have projects with even less code.;) IMO, you should get started now but consider moving it into a separate project. The MPC is also just a few classes but a separate project. Otherwise, you won’t be able to release independently from Recommenders.

To me, this feels like it should be a separate project under EPP, just like MPC.

--
Mike Milinkovich
mike.milinkovich@xxxxxxxxxxx
+1.613.220.3223 (mobile)
_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev




Back to the top