Anonymous platform -- app_info.xml -- developer help needed

petri33
petri33
Joined: 3 Nov 14
Posts: 12
Credit: 3892550
RAC: 0
Topic 197791

Hi,

i managed to compile the BRP4G and BRP5 cuda application (same app) on my linux with cuda 6.0.

1) Now I need help setting up a working app_info.xml.

I'd like to run CPU APPS:
- einstein_S5R6_1.01_graphics_i686-pc-linux-gnu
- hsgamma_FGRP4_1.04_x86_64-pc-linux-gnu__FGRP4-SSE2
- einstein_S5R6_1.01_graphics_i686-pc-linux-gnu
and MY GPU APP
- einsteinbinary_x86_64-pc-linux-gnu-cuda
.

2) I also need help about what to do with db.dev and dbhs.dev files? rename?

3) Should I put the NVIDIA v6.0 cudart and cufft files to einstein project directory too? Is it ok if they are in LIBPATH/PATH?

4) Before I try anything with production database I'd like to test my compilation against the standard app to validate results. How to do that off-line (not beta)? Is there a scrip for developers/optimizers?

--
petri33

Holmis
Joined: 4 Jan 05
Posts: 1118
Credit: 1055935564
RAC: 0

Anonymous platform -- app_info.xml -- developer help needed

Starting with a disclaimer: I'm not associate with the project and I'm not a developer/coder etc. but I might be able to help in some way.

Starting with your first question about app_info.xml.
There is currently only one CPU search running on Einstein and it's called "Gamma-ray pulsar search #4" or FGRP4 for short. The "einstein_S5R6_1.01_graphics..." files you mention are the screen saver apps associated with the now ended Gravity wave search and thus not needed at the moment. (Although they might get reused soon when the new gravity wave search gets under way, who knows!?)

If you have some knowledge about how to write an app_info.xml file you might be able to put something together by studying the client_state.xml file looking at , and tags for tasks assigned to the official app. I don't have enough knowledge and experience to help you with that though, sorry.

Number 2: Haven't got a clue.

Number 3: I'd take the safe alternative and put the files in the einstein project folder and reference them in the app_info.xml.

Number 4: As long as you're the only one running the new app there should be minimal risk of bad data being inserted in the science database as any error in your own app should not match the official app and thus not validate. But to play it safe choose a task assigned to you and the official app and extract the relevant data from the client_state.xml, the tag has the used and also reference all the needed data files, copy the data files to a separate folder along with the app and support files (cudart etc.) then run the app in standalone mode making sure to pass the command line to the app.

I've done something similar when the Intel GPU app was developed and this thread over at the old and now obsolete Albert@home message board might be useful: https://albert.phys.uwm.edu/forum_thread.php?id=8954 especially Message 112610 from Bikeman.
Don't use the files linked in that post to conduct your test but use them to get a grip on how things work with these apps.

Think I'll stop mumbling now and let someone with more knowledge take it from here. Hopefully something of the above was helpful =)

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4273
Credit: 245292696
RAC: 11824

My suggestion would be to

My suggestion would be to peek into client_state.xml for the BRP4G/BRP5 CUDA32 App (version) and use the app info there as a template.

All files listed for that app, or better, the respective CUDA 6 counterparts, are needed (with possible exception of the graphics_app if you don't want to see graphics) and should be placed in the project directory. db.dev and dbhs.dev should get unique names to not be confused / overwritten by the CUDA 32 files, but should be copied (tag ) into the slots directory with the original names (db.dev etc.). I would do the same with cudart and cufft (i.e. put these in the project directory and let the client copy these with the correct names). Depending on the client version it might work to set LD_LIBRARY_PATH to the directory where these files are in the environment of the client (which should then be inherited by the app), but I wouldn't bet that the app (or actually the loader) finds and picks the intended versions.

hth,
BM

Addendum: here's our app info for the BRP5 CUDA 32 app version:

    einsteinbinary_BRP5
    139
    7.2.2
    
       einsteinbinary_BRP5_1.39_x86_64-pc-linux-gnu__BRP5-cuda32-nv270
       
    
    
       libcudart64_32_16.so
       libcudart.so.3
    
    
    
       libcufft64_32_16.so
       libcufft.so.3
    
    
    
       EULA.txt
       EULA.txt
    
    
       einsteinbinary_BRP5_1.39_x86_64-pc-linux-gnu__BRP5-cuda32-nv270-db.dev
       db.dev
    
    
    
       einsteinbinary_BRP5_1.39_x86_64-pc-linux-gnu__BRP5-cuda32-nv270-dbhs.dev
       dbhs.dev
    
    

The ""s for your cudart and cufft will probably be different, depending on the CUDA version and your build. Just use the names the libs have now.

Addendum 2: On E@H every task is ran twice by different participants an then compared. There is no chance you will get the same result as another participants computer with a broken app.

BM

petri33
petri33
Joined: 3 Nov 14
Posts: 12
Credit: 3892550
RAC: 0

Thank you both, I think

Thank you both,

I think this will be an interesting journey to the einstein universe.

Now going to sleep. If I can.
--
petri33

BackGroundMAN
BackGroundMAN
Joined: 25 Feb 05
Posts: 58
Credit: 246736656
RAC: 0

Hi, I have some dev boards

Hi,

I have some dev boards with ARM processors (Cortex-A9) running Debian/Ubuntu and I want to run some tests with the EaH client. I manage to compile the client for these platforms but the boinc returns:

Einstein@Home | platform 'arm-unknown-linux-gnueabi' not found.

Is there a way to run and validate eah wu in these platforms with eah clients which are compiled by me ?

Thank you,

BackGroundMAN
BackGroundMAN
Joined: 25 Feb 05
Posts: 58
Credit: 246736656
RAC: 0

I manage to create an

I manage to create an app_info.xml file and validate same wus with a freescale i.MX6q (Cortex-A9) SoC board (here).

Claggy
Claggy
Joined: 29 Dec 06
Posts: 560
Credit: 2694028
RAC: 0

RE: I manage to create an

Quote:

I manage to create an app_info.xml file and validate same wus with a freescale i.MX6q (Cortex-A9) SoC board (here).


Does the Stock app for Arm work on that host?

If your Boinc client is running a different platform, you could try adding an arm-unknown-linux-gnueabihf option to your cc_config.xml to see if it'll run:

Client_configuration

Quote:
platform_name
Specify an alternate platform name, to be included in scheduler requests. New in 5.10.26

Claggy

petri33
petri33
Joined: 3 Nov 14
Posts: 12
Credit: 3892550
RAC: 0

I'm trying to tweak some code

I'm trying to tweak some code using anonymous platform.

Are these results different? (7:th meaningful digit or so differs by one)
Different summing order....

Got 8 minutes off from 100 minutes (8%) on the first try.

Will my results be deemed "not validated" ?

linux1 14 # diff ../../projects/einstein.phys.uwm.edu/PB0060_00291_212_1_0 ../projects/einstein.phys.uwm.edu/PB0060_00291_212_1_0|more
3,6c3,6
 % Date: 2014-11-24T19:42:00+00:00
> % Exec: einsteinbinary_x86_64-pc-linux-gnu-cuda5
> % ERP git id: unknown (git repository not found!)
> % BOINC rev.: f714fda0402b38d8846b7bb1b615970a1bad494d
9c9
 0.130017598470 22772.919921875000 2.921371459961 4.361827373505 18.5609 16.204 16
12c12
 41.113058725993 9225.538085937500 1.721350789070 4.800235271454 16.2148 11.92 8
15c15
 9.417851765951 6612.013183593750 1.349414944649 0.258994013071 15.0765 11.4804 16
20c20
 4.921754201253 7556.593261718750 1.431376457214 2.651865959167 15.5461 11.2235 8
23c23
 29.461701711019 5460.417968750000 1.074946641922 6.075776576996 14.8079 11.1284 16
27c27
 40.039698282878 6134.647949218750 1.195177793503 6.165960788727 15.3575 11.0279 8
29c29
 5.997021993001 5455.762207031250 1.057447433472 1.808187484741 15.3443 11.0142 8
32,33c32,33
 24.964650472005 5776.341308593750 1.276517748833 0.489908427000 14.704 10.9928 16
> 4.921118418376 7247.552734375000 1.213155508041 2.652237653732 15.3194 10.9885 8
37,38c37,38
 8.282661437988 8025.598632812500 1.525870800018 5.887578010559 14.6843 10.9671 16
> 19.803047180176 5748.158691406250 1.128414988518 3.379667758942 14.6821 10.9643 16
42c42
 71.728070576986 5718.965820312500 1.112200617790 0.088742986321 16.9045 10.8351 4
47c47
 71.657021840413 5369.669921875000 1.007469415665 4.963474273682 16.8001 10.7522 4
50c50
 22.550582885742 5524.666015625000 1.060509681702 4.087478637695 14.5043 10.7332 16
52c52
 30.340671539307 6826.371093750000 1.262879848480 3.355675935745 15.0688 10.7295 8
58c58
 49.808979034424 5747.409667968750 1.095149397850 2.545570135117 16.694 10.6681 4
60c60
 5.997816721598 5709.854492187500 1.224209547043 1.866249561310 15.0044 10.663 8
66c66
 44.178803761800 5210.474121093750 1.142139673233 5.791926860809 14.9705 10.6281 8
70c70
 105.208237965902 5507.743164062500 1.017637848854 0.968195319176 19.5842 10.5705 2
73c73
 29.650211334229 5204.834960937500 1.159862041473 6.054465293884 16.5585 10.5606 4
85,86c85,86
 18.836339314779 6333.511230468750 1.240311622620 0.232823133469 14.8245 10.4777 8
> 55.474758148193 5176.270019531250 1.130741715431 2.638604402542 14.8241 10.4773 8
88c88
 8.283297220866 7657.554199218750 1.362362504005 5.859113216400 14.2996 10.468 16
90c90
 11.240641276042 5404.484863281250 1.165789484978 5.468097686768 14.2908 10.4566 16
95c95
 8.282979329427 7777.509765625000 1.426747918129 5.865532875061 14.2555 10.4112 16
99c99
 50.613880157471 6842.541503906250 1.426664233208 3.690454006195 16.3508 10.3961 4
107c107
 134.789307912191 6707.034667968750 1.297950983047 1.142655968666 19.1974 10.3413 2
linux1 14 # diff ../../projects/einstein.phys.uwm.edu/PB0060_00291_212_1_1 ../projects/einstein.phys.uwm.edu/PB0060_00291_212_1_1|more
3,6c3,6
 % Date: 2014-11-24T20:18:00+00:00
> % Exec: einsteinbinary_x86_64-pc-linux-gnu-cuda5
> % ERP git id: unknown (git repository not found!)
> % BOINC rev.: f714fda0402b38d8846b7bb1b615970a1bad494d
8c8
 0.130176544189 10728.642578125000 1.648967623711 2.764057159424 18.6191 16.2851 16
26c26
 152.727127075195 5483.956054687500 1.162362813950 6.156308650970 20.6648 11.2117 2
28c28
 8.966445922852 6537.105957031250 1.228410720825 0.224903315306 14.8098 11.1309 16
34,36c34,36
 17.506122589111 6456.918457031250 1.308231949806 4.724027156830 14.6724 10.9517 16
> 17.704010009766 6219.750976562500 1.114473223686 0.703471839428 15.2783 10.9459 8
> 7.958412170410 7125.513671875000 1.376557946205 5.897690296173 15.2306 10.8966 8
39c39
 7.959206899007 6760.195312500000 1.192072153091 5.878903865814 15.2087 10.8739 8
52c52
 51.545302073161 5476.476562500000 1.025219321251 2.780078887939 24.743 10.7457 1
58c58
 50.853888193766 6008.622558593750 1.090330719948 0.947296798229 16.7518 10.7139 4
65c65
 48.769315083822 5275.507812500000 1.035870194435 2.576314687729 14.9967 10.6551 8
69c69
 113.838354746501 5748.409179687500 1.098730325699 1.823363780975 16.637 10.6228 4
71,72c71,72
 37.307421366374 7209.440429687500 1.428654074669 3.690719842911 14.928 10.5843 8
> 59.696992238363 8216.451171875000 1.600526094437 3.418078422546 14.9251 10.5813 8
74c74
 119.600931803385 6857.722656250000 1.337882399559 5.663602828979 19.5939 10.5762 2
79c79
 15.716870625814 5357.792480468750 1.223591685295 1.599350214005 14.879 10.5338 8
82c82
 43.764591217041 7443.059082031250 1.298973679543 1.032522201538 14.8707 10.5253 8
87,88c87,88
 56.743780771891 11015.071289062500 1.829629063606 5.844688415527 14.8484 10.5023 8
> 28.896013895671 5919.811035156250 1.196011185646 5.613035678864 14.8483 10.5022 8
105c105
 87.057908376058 5404.948730468750 1.146015644073 0.449358463287 19.355 10.4347 2
linux1 14 # 
BackGroundMAN
BackGroundMAN
Joined: 25 Feb 05
Posts: 58
Credit: 246736656
RAC: 0

I have the same problems

I have the same problems (diffs) with the Cortex-A9 client but the results are validated by the project.

petri33
petri33
Joined: 3 Nov 14
Posts: 12
Credit: 3892550
RAC: 0

Thank You. I'll give a try

Thank You. I'll give a try for my version.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.