Credit raise

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4274
Credit: 245303577
RAC: 11913
Topic 193234

We're still working on getting a grip to the large runtime variation that came up with splitting up the sky in S5R3 (it was averaged out in the "all-sky" search in S5R2).

However we found that on average we were still awarding too little credit compared to other projects recently, so we decided to raise the credit by 7%.

Note that due to server-assigned credit this will only affect newly generated workunits, so it will take some time to propagate through to your statistics.

BM

BM

Brian Silvers
Brian Silvers
Joined: 26 Aug 05
Posts: 772
Credit: 282700
RAC: 0

Credit raise

Quote:

We're still working on getting a grip to the large runtime variation that came up with splitting up the sky in S5R3 (it was averaged out in the "all-sky" search in S5R2).

However we found that on average we were still awarding too little credit compared to other projects recently, so we decided to raise the credit by 7%.

Note that due to server-assigned credit this will only affect newly generated workunits, so it will take some time to propagate through to your statistics.

BM

Thanks for the update...

Alinator
Alinator
Joined: 8 May 05
Posts: 927
Credit: 9352143
RAC: 0

RE: We're still working on

Quote:

We're still working on getting a grip to the large runtime variation that came up with splitting up the sky in S5R3 (it was averaged out in the "all-sky" search in S5R2).

BM

Yep, I don't run monster caches (0.5 days currently), so I have seen the boost already.

Few more of questions regarding S5R3;

1.) Have you worked up a TauWU pdf for it like you did for S5R2?

2.) Was anything done to address the problem of sending longer running results to hosts which are reporting with their CPCS that they can't make the deadline even if run solo on EAH flat out?

3.) Do the longer running results still have a three week deadline rather than two? Along this line are you still considering variable deadlines?

Alinator

Conan
Conan
Joined: 19 Jun 05
Posts: 172
Credit: 7195848
RAC: 2337

RE: We're still working on

Quote:

We're still working on getting a grip to the large runtime variation that came up with splitting up the sky in S5R3 (it was averaged out in the "all-sky" search in S5R2).

However we found that on average we were still awarding too little credit compared to other projects recently, so we decided to raise the credit by 7%.

Note that due to server-assigned credit this will only affect newly generated workunits, so it will take some time to propagate through to your statistics.

BM

That's great, thanks for that, much appreciated.

I have just downloaded Beta 4.12 on all my Linux computers to see if there is a difference over 4.09 and 4.02.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4274
Credit: 245303577
RAC: 11913

RE: RE: We're still

Message 74058 in response to message 74056

Quote:
Quote:

We're still working on getting a grip to the large runtime variation that came up with splitting up the sky in S5R3 (it was averaged out in the "all-sky" search in S5R2).

BM

Yep, I don't run monster caches (0.5 days currently), so I have seen the boost already.

Few more of questions regarding S5R3;

1.) Have you worked up a TauWU pdf for it like you did for S5R2?

2.) Was anything done to address the problem of sending longer running results to hosts which are reporting with their CPCS that they can't make the deadline even if run solo on EAH flat out?

3.) Do the longer running results still have a three week deadline rather than two? Along this line are you still considering variable deadlines?

Alinator


We are still not capable of even correctly anticipating this variation.

Personally I would rather be in favor of flattening the variation by measurements in the App than to react to the variation with deadlines and credits, but I still don't know whether this would be possible.

At a meeting that covers next week all relevant people (including the authors of the code in question) will be at one table, I hope things get sorted out then.

BM

BM

rbpeake
rbpeake
Joined: 18 Jan 05
Posts: 266
Credit: 983256130
RAC: 583199

RE: Personally I would

Message 74059 in response to message 74058

Quote:
Personally I would rather be in favor of flattening the variation by measurements in the App than to react to the variation with deadlines and credits, but I still don't know whether this would be possible.
BM


I personally don't have a problem with the deadlines and the credits as they currently are, but I am very aware that is but one opinion and that there are a lot of other opinions as well. Flattening the variation in the application is an elegant solution if that works, but if not, then I am happy to stay with the situation as it is now! fwiw.... ;)

And thanks for your efforts overall!

Alinator
Alinator
Joined: 8 May 05
Posts: 927
Credit: 9352143
RAC: 0

RE: RE: Yep, I don't run

Message 74060 in response to message 74058

Quote:
Quote:

Yep, I don't run monster caches (0.5 days currently), so I have seen the boost already.

Few more of questions regarding S5R3;

1.) Have you worked up a TauWU pdf for it like you did for S5R2?

2.) Was anything done to address the problem of sending longer running results to hosts which are reporting with their CPCS that they can't make the deadline even if run solo on EAH flat out?

3.) Do the longer running results still have a three week deadline rather than two? Along this line are you still considering variable deadlines?

Alinator


We are still not capable of even correctly anticipating this variation.

Personally I would rather be in favor of flattening the variation by measurements in the App than to react to the variation with deadlines and credits, but I still don't know whether this would be possible.

At a meeting that covers next week all relevant people (including the authors of the code in question) will be at one table, I hope things get sorted out then.

BM

Agreed, getting the credit rate and the deadlines right is no trivial task, especially when some of the fundamentals have changed. ;-)

I also agree that getting better feedback from the hosts would ideal to assist with making the determination. That would most likely make things somewhat easier as you make refinments to the analysis in the future without having to worry about the impact on scoring as much.

The one observation I have regarding deadlines you might want to bring to the table though is when considering how long to make them a lot of folks don't particularly like projects where the 'tightness factor' is too high. On S4 and S5R1, EAH played relatively nice with other projects even on slow hosts. With S5R2 and up, the longer runtimes made it so for slow hosts and even faster hosts running multiple projects they would get driven into EDF to complete the EAH task on time, and as a side effect drove the host off a 'lockstep' resource share in the short term for all projects as BOINC worked off the LTD which had built up for the preempted tasks on other projects.

I know that's a 'dumb' way to look at the problem, but that's my take on how a lot of people look at it based on posts here and in other projects' NC fora.

I guess one could say this could be filed under, "Just when you think you have all the answers, they change all the questions!". :-)

Alinator

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4274
Credit: 245303577
RAC: 11913

RE: I also agree that

Message 74061 in response to message 74060

Quote:
I also agree that getting better feedback from the hosts would ideal to assist with making the determination. That would most likely make things somewhat easier as you make refinments to the analysis in the future without having to worry about the impact on scoring as much.


We need some more information, but I doubt that it can be provided by participants. It would probably need some additional code in the Apps to write out some traces, and something on the server side to follow them. Anyway, this is something we are still working on, and we hope to make some progress next week.

BM

BM

Alinator
Alinator
Joined: 8 May 05
Posts: 927
Credit: 9352143
RAC: 0

RE: RE: I also agree that

Message 74062 in response to message 74061

Quote:
Quote:
I also agree that getting better feedback from the hosts would ideal to assist with making the determination. That would most likely make things somewhat easier as you make refinments to the analysis in the future without having to worry about the impact on scoring as much.

We need some more information, but I doubt that it can be provided by participants. It would probably need some additional code in the Apps to write out some traces, and something on the server side to follow them. Anyway, this is something we are still working on, and we hope to make some progress next week.

BM

Oh yes, it would have to be instrumentation built into the app. Hosts don't lie, but participants might. ;-)

In any event, no matter what the outcome it sounds like it's going to be a pretty heavy duty meeting (bring lots of coffee). :-)

Alinator

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2142
Credit: 2776084660
RAC: 806493

RE: RE: I also agree that

Message 74063 in response to message 74061

Quote:
Quote:
I also agree that getting better feedback from the hosts would ideal to assist with making the determination. That would most likely make things somewhat easier as you make refinments to the analysis in the future without having to worry about the impact on scoring as much.

We need some more information, but I doubt that it can be provided by participants. It would probably need some additional code in the Apps to write out some traces, and something on the server side to follow them. Anyway, this is something we are still working on, and we hope to make some progress next week.

BM


Bernd,

You posted while I was preparing the next episode for publication! I've uploaded another graph here: I think it shows the structure of the time variations even more clearly.

This sequence is looking as if I might be able to follow it all the way down to result 0: at 8 WUs/day, I should finish it sometime next Wednesday. I'll post the full graph then, but if it would help I'm happy to post another intermediate snapshot in time for the start of your meeting, if you tell us when you plan to start.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4274
Credit: 245303577
RAC: 11913

RE: Oh yes, it would have

Message 74064 in response to message 74062

Quote:
Oh yes, it would have to be instrumentation built into the app. Hosts don't lie, but participants might. ;-)


No, it's not about lying. It's about getting the relation right between certain properties of the workunit and dynamically calculated parameters in the App that affect the runtime. At the very moment, neither of these is visible to the participants, and even to us only when running under a debugger (or with an amount of debug output that would fill up your harddisk). We see the sinewave over all workunits of a given frequency band, but it's still hard to predict the phase, which would be important for a specific WU.

BM

BM

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.