I´m running out of work! Why ???

astro-marwil
astro-marwil
Joined: 28 May 05
Posts: 520
Credit: 435873400
RAC: 902128
Topic 220279

Hallo and happy Christmas world wide!!!

I´m running out of work and don´t know why I get no new tasks ? No parameters changed at my site and servers are running.

 

Kind regards an happy crunching

Martin

Stef
Stef
Joined: 8 Mar 05
Posts: 206
Credit: 110568193
RAC: 0

What's in the event log?

What's in the event log?

astro-marwil
astro-marwil
Joined: 28 May 05
Posts: 520
Credit: 435873400
RAC: 902128

"What's in the event

"What's in the event log?"

It´s repeating in about 30min intervall:

25.12.2019 11:24:27 | Einstein@Home | Sending scheduler request: To fetch work.
25.12.2019 11:24:27 | Einstein@Home | Requesting new tasks for CPU
25.12.2019 11:24:29 | Einstein@Home | Scheduler request completed: got 0 new tasks
25.12.2019 11:24:29 | Einstein@Home | No work sent

The last task I got:

23.12.2019 11:48:00 | Einstein@Home | Started download of l1_0278.50_O2C02Cl1In0.hFlW
23.12.2019 11:48:01 | Einstein@Home | Finished download of l1_0278.50_O2C02Cl1In0.hFlW

That was it since then.

Upload is working well.

Reloading my preferences etc. didn´t help either.

After restarting the PC, I got this contradictorxy response:

25.12.2019 14:16:04 |  | Checking presence of 307 project files
25.12.2019 14:16:10 | Einstein@Home | Sending scheduler request: To fetch work.
25.12.2019 14:16:10 | Einstein@Home | Requesting new tasks for CPU
25.12.2019 14:16:12 | Einstein@Home | Scheduler request completed: got 0 new tasks
25.12.2019 14:16:12 | Einstein@Home | No work sent

First, there is no one of these 307 project files listet in BOINC Manager.

Seconde, If he knows about these 307 project task allready available on my PC, why is he asking for new one? ok, these 307 project tasks ssem to be consistent with the space use on my PC, wich is about 5 times bigger than usually.

There seems to be an inconsistancy between the server and my PC.

I´ll see what happend in 13 Min, when the task has finished and no more task are in the scedule, whether it will load one of the 307 project files on my PC but not listed in the sceduler.

Ok, no new task started after ending sucessfully the tasks.

As I´m crunching two task at a time, my last task will end in about 6.5h. Then I´ll reset the project. Let´s see, what happens.

After rereading my local adjustments, I got 2 new tasks. that´s too little, as I like to have a spare work for  2 days.

All that seems to me somewhat irrationally. As I did this before without any changes, except I press now the store-buttom.

But later on I didn´t get any further work. Also repairing BOINC-Manager didn´t gave any advantage. 

At now I don´t have any new idea to cure this. It will stop crunching soon!

 

Kind regards an happy crunching

Martin

Richie
Richie
Joined: 7 Mar 14
Posts: 656
Credit: 1702989778
RAC: 0

As far as I've understood,

As far as I've understood, 307 "project files" doesn't mean tasks. It means all the other files that are needed for the project to run at your computer. When you start Boinc it always scans and finds quite an amount of "project files", even if there's no tasks anywhere.

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5851
Credit: 110676114916
RAC: 33519779

astro-marwil wrote:It´s

astro-marwil wrote:

It´s repeating in about 30min intervall:

....
25.12.2019 11:24:29 | Einstein@Home | No work sent

I had a look at the scheduler logs for the most recent contact (at the time of starting this reply) and I saw a horrifying mess :-).  To me, it looks like the scheduler is having great difficulty in handling the ever increasing number of runs, sub-runs, sub-sub-runs, extensions to runs, switch-backs to earlier runs, etc, etc.  It looks like it can't decide which large data files are available or not, have tasks or not, have been marked for deletion or not, etc.  There are lots and lots of [debug] lines scattered through the whole deal which seems to imply that the Devs are experimenting with the code and trying to sort out how and why the scheduler is making (or not as the case may be) decisions about the sending of work.

Maybe you are just a victim of a scheduler that can't work out what to send to you.  Maybe there is actually a shortage of new work (primary tasks).  The two extra tasks you mentioned receiving show up in your list of tasks with an _2 extension.  They are resends - not new primary tasks.  One of those shows as 'in progress' and the other shows as 'aborted'.  Did you actually abort it?  Perhaps it was aborted by the system somehow?  Perhaps one of the original tasks got returned late so that the resend was no longer needed?

If you continue to request work, by the luck of the draw you may get further resends as they become available.  You don't have to wait 30min to make a further request.  You can override that delay by clicking 'update'.  There are likely to be resends available if you keep trying.

The other action you could take would be to allow some gamma-ray pulsar tasks until whatever is ailing the supply of GW tasks gets fixed.

astro-marwil wrote:

The last task I got:

23.12.2019 11:48:00 | Einstein@Home | Started download of l1_0278.50_O2C02Cl1In0.hFlW
23.12.2019 11:48:01 | Einstein@Home | Finished download of l1_0278.50_O2C02Cl1In0.hFlW

This is NOT a task.  It is a single large data file (one of many) required for the processing of a task.  There is no such thing as a task file.  A task only exists as a group of parameters that are stored in your state file (client_state.xml).  Those parameters are received in the payload of a scheduler reply and are immediately inserted by the client into the state file and not as any separate task file.  When those parameters are 'used' to create various 'result' output files, they will be removed from the state file automatically on the successful transfer of the results back to the server.

astro-marwil wrote:

After restarting the PC, I got this contradictorxy response:

25.12.2019 14:16:04 |  | Checking presence of 307 project files

That is a normal response and in now way is it contradictory.  Project files are NOT tasks.  They are simply all the ancillary files deemed to be necessary for the project to run correctly.   They are things listed in the state file which is how the client knows exactly what you should have and what to complain about, or download afresh, if missing.  Many have no direct bearing on crunching - things like image files, slideshows, etc.  The important ones are things like large data files (you will likely have many of these if you have been crunching for a while), application files and various other bits and pieces - but NOT files representing tasks.  When you see that single line with no other complaints, you know that all is normal as far as the client end is concerned.  Since project files are not tasks, they will never be listed on the tasks tab of BOINC manager.

astro-marwil wrote:
There seems to be an inconsistancy between the server and my PC.

There is no inconsistency.  If there were, you would see specific messages about the problem.  What you are seeing is what seems to be a scheduler problem or perhaps a genuine lack of new work.  I don't know the true situation as I'm not running any GW CPU work.  Given the time of year, there may be a delay in providing new work if such a shortage does exist.  Your best bet (until things change) is to try more aggressively for resends or (a lot easier) allow some gamma-ray pulsar tasks until the shortage is fixed.

Cheers,
Gary.

Richie
Richie
Joined: 7 Mar 14
Posts: 656
Credit: 1702989778
RAC: 0

My linux host used to run 1

My linux host used to run 1 GW GPU task + 3 GW CPU tasks. I see it's not receiving CPU tasks now. Last CPU task has been reported 24 Dec 2019 7:33:08 UTC and there hasn't been new tasks after that. GPU is still receiving work. Maybe there is wider lack of GW CPU tasks. Contact log of that host:

https://einsteinathome.org/host/12462839/log

astro-marwil
astro-marwil
Joined: 28 May 05
Posts: 520
Credit: 435873400
RAC: 902128

Hallo! Today 8:34 CET I got

Hallo!

Today 8:34 CET I got a batch of 7 tasks and the first 2 are working well, so long.

So, as Gary wrote, it´s not on my side, but something at the servers. I hope, they can cure this in the next days.

 

Many thanks for your help and correcting my view on the things in some way.

Kind regards and happy crunching

Martin

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5851
Credit: 110676114916
RAC: 33519779

astro-marwil wrote:... I got

astro-marwil wrote:
... I got a batch of 7 tasks ...

Yes you did!   And guess what!  They are all resends :-).

Primary tasks always have an extension of _0 or _1.  If either (or both) primary tasks in a quorum fail, the replacement tasks (sent to different hosts) will have an extension of _2 or above, as necessary, until eventually two tasks manage to be successfully returned and validated.

All your current tasks are of the _2 variety so you are picking up some other host's failures.  As I suggested, there should be further resends available if you keep asking for more work.  At least that part seems to be working OK.

Cheers,
Gary.

San-Fernando-Valley
San-Fernando-Valley
Joined: 16 Mar 16
Posts: 273
Credit: 7480208261
RAC: 13860206

Just to inform: I received

Just to inform:

I received the last WU GW 2.07 _0 or _1 on 23. Dec. at aprrox. hour 19 UTC.

Since then, dead silence.

Stef
Stef
Joined: 8 Mar 05
Posts: 206
Credit: 110568193
RAC: 0

I get only few GPU tasks. The

I get only few GW GPU tasks. The number of tasks "ready to send" is increasing since a few hours.

iD6QqB6.png

DanNeely
DanNeely
Joined: 4 Sep 05
Posts: 1364
Credit: 3562358667
RAC: 18

AFAIK O2MDF is the GPU app. 

AFAIK O2MDF is the GPU app.  O2MD1 is the CPU one - it only has a handful of tasks to send.  I have all the GW apps selected in preferences except the GPU one, and in the last 5 days it appears only one of my 3 desktops has received any GW-CPU tasks.  

I run deep local work caches so even my fastest pair of boxes still have a decent amount of work left; but will run dry sometime next week if no one comes in who can address whatever the problem is.

 

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.