2009/12/30

for Hpp220 Emu
ID     STATUS             E_HOST                               EXE_EXIT_CODE JOB_EXIT_STATUS 
--------------------------------------------------------------------------------------------
1      Retrieved          polgrid1.in2p3.fr                    9             9                
2      Retrieved          gate.grid.kiae.ru                    0             60307            
3      Retrieved          ce.cyf-kr.edu.pl                     8009          8009             
4      Retrieved          lcgce01.jinr.ru                      0             60307            
5      Retrieved          gridce2.pi.infn.it                   0             60307            
6      Retrieved          gridce2.pi.infn.it                   8001          8001             
7      Retrieved          t2-ce-01.lnl.infn.it                 0             60307            
8      Retrieved          sbgce1.in2p3.fr                      0             60307            
9      Retrieved          t2-ce-01.lnl.infn.it                 0             60307            
10     Retrieved          cmsrm-ce01.roma1.infn.it             0             60307   

Only 1 file was published among 10 files done

replace PoolSource.fileNames = {
        '/store/user/hkseo/Hpp400_EMu_10TeV_GEN_HLT/Hpp400_EMu_10TeV_GEN_HLT/56b0a150d8308d807c50872c1182ffb6/GEN_HLT_IDEAL_V12_1.root'
}
}


ID     STATUS             E_HOST                               EXE_EXIT_CODE JOB_EXIT_STATUS 
--------------------------------------------------------------------------------------------
1      Retrieved          t2-ce-01.lnl.infn.it                     0             0                
2      Retrieved          t2-ce-03.lnl.infn.it                     0             60307            
3      Retrieved          grid-ce-01.ba.infn.it                  0             60307            
4      Retrieved          ce02.marie.hellasgrid.gr                           10034            
5      Retrieved          lcgce21.jinr.ru                          0             60307            
6      Retrieved          grid-ce.physik.rwth-aachen.de   0             60307            
7      Retrieved          polgrid1.in2p3.fr                       9             9                
8      Retrieved          hephygr.oeaw.ac.at                  0             60307            
9      Retrieved          node07.datagrid.cea.fr              9             9                
10     Retrieved          dgc-grid-40.brunel.ac.uk          0             60307         

crab:  ExitCodes Summary
>>>>>>>>> 2 Jobs with Wrapper Exit Code : 9 
         List of jobs: 7,9 
        See https://twiki.cern.ch/twiki/bin/view/CMS/JobExitCodes for Exit Code meaning
 
crab:  ExitCodes Summary
>>>>>>>>> 1 Jobs with Wrapper Exit Code : 0 
         List of jobs: 1 
        See https://twiki.cern.ch/twiki/bin/view/CMS/JobExitCodes for Exit Code meaning
 
crab:  ExitCodes Summary
>>>>>>>>> 1 Jobs with Wrapper Exit Code : 10034 
         List of jobs: 4 
        See https://twiki.cern.ch/twiki/bin/view/CMS/JobExitCodes for Exit Code meaning
 
crab:  ExitCodes Summary
>>>>>>>>> 6 Jobs with Wrapper Exit Code : 60307 
         List of jobs: 2-3,5-6,8,10 
        See https://twiki.cern.ch/twiki/bin/view/CMS/JobExitCodes for Exit Code meaning
    
  • meaning of Exit Code
    • 60307 - Failed to copy an output file to the SE (sometimes caused by timeout issue).
    • 10034 - Required application version is not found at the site
    • 9 - killed, unblockable (POSIX) kill -9

error during crab -publish

  • successful when testing with small number of events
  • however, yield the following error message during crab -publish when I submitted 10 jobs with 1000 events, respectively
[lxplus243] ~/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/Hpp220_Emu > crab -publish
crab:  Version 2.6.6 running on Wed Dec 30 16:09:26 2009 CET (15:09:26 UTC)
 
crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /afs/cern.ch/user/h/hkseo/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/Hpp220_Emu/crab_0_091226_165956/
 
crab:  <dbs_url_for_publication> = https://cmsdbsprod.cern.ch:8443/cms_dbs_ph_analysis_02_writer/servlet/DBSServlet
crab:  --->>> No valid files to publish on DBS. Your jobs do not report exit codes = 0
Log file is /afs/cern.ch/user/h/hkseo/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/Hpp220_Emu/crab_0_091226_165956/log/crab.log

2009/12/18

successful crab setting for publishing
storage_element = T2_KR_KNU
dbs_url_for_publication = https://cmsdbsprod.cern.ch:8443/cms_dbs_ph_analysis_02_writer/servlet/DBSServlet

2009/12/15

publication test with the following setting in crab.cfg
  • dbs_url_for_publication = "http://cmssrv17.fnal.gov:8989/DBS108LOC1/servlet/DBSServlet"
  • storage_element = cluster142.knu.ac.kr
  • storage_path = /srm/managerv1?SFN=/pnfs/knu.ac.kr/data/cms/store/user/(my account name)

  • error during 'crab -create'
[lxplus215] ~/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/test_4 > crab -create
crab:  Version 2.6.5 running on Tue Dec 15 16:47:11 2009 CET (15:47:11 UTC)
 
crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /afs/cern.ch/user/h/hkseo/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/test_4/crab_0_091215_164711/
 
crab:  Required 10 events per job 
crab:  Required 100 events in total 
crab:  10 jobs can be created, each for 10 for a total of 100 events
crab:  Warning : 'Error checking []' 
 
crab: Problems trying remote dir check... 
        Please check stage out configuration parameters.
 
 
Log file is /afs/cern.ch/user/h/hkseo/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/test_4/crab_0_091215_164711/log/crab.log

publication test with T2_FR_GRIF_LLR

  • setting in crab.cfg
### OUTPUT files INTO A SE
copy_data = 1

### if you want to copy data in a "official CMS site"
### you have to specify the name as written in 
storage_element = T2_FR_GRIF_LLR
#storage_element = T2_KR_KNU
### the user_remote_dir will be created under the SE mountpoint
### in the case of publication this directory is not considered
user_remote_dir = 115.0

### To publish produced output in a local istance of DBS set publish_data = 1
publish_data=1
### Specify the dataset name. The full path will be <primarydataset>/<publish_data_name>/USER
publish_data_name = HppEMu_130GeV_10TeV_GEN_HLT
### Specify the URL of DBS istance where CRAB has to publish the output files
dbs_url_for_publication= https://vocms31.cern.ch:8443/cms_dbs_ph_analysis_01_writer/servlet/DBSServlet

  • error during publication
[lxplus215] ~/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/test_4 > crab -publish
crab:  Version 2.6.5 running on Tue Dec 15 13:23:46 2009 CET (12:23:46 UTC)
 
crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /afs/cern.ch/user/h/hkseo/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/test_4/crab_0_091214_150653/
 
crab:  <dbs_url_for_publication> = https://vocms31.cern.ch:8443/cms_dbs_ph_analysis_01_writer/servlet/DBSServlet
crab:  --->>> Start dataset publication
I will retry in 2 seconds
I will retry in 30 seconds
Traceback (most recent call last):
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/python/crab.py", line 878, in ?
    crab.run()
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/python/crab.py", line 816, in run
    if act in self.actions.keys(): self.actions[act].run()
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/python/Publisher.py", line 298, in run
    self.exit_status=self.publishDataset(file_list[0])
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/python/Publisher.py", line 157, in publishDataset
    dbswriter = DBSWriter(self.DBSURL)
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/external/ProdCommon/DataMgmt/DBS/DBSWriter.py", line 215, in __init__
    self.reader = DBSReader(**args)
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/external/ProdCommon/DataMgmt/DBS/DBSReader.py", line 38, in __init__
    if url.count('cmsdbsprod.cern.ch/cms_dbs_prod_global') or \
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/external/DBSAPI/DBSAPI/dbsApi.py", line 196, in getServerInfo
    raise ex
DBSAPI.dbsApiException.DbsConnectionError: Failed to connect in 03 Attempts
 
Call to DBS Server (https://vocms31.cern.ch:8443/cms_dbs_ph_analysis_01_writer/servlet/DBSServlet) failed
HTTP ERROR Status '400', 
Status detail: '('Bad Request', 'Bad request syntax or unsupported method')'

2009/12/14

publication test
  • setting in crab.cfg
### OUTPUT files INTO A SE
copy_data = 1

### if you want to copy data in a "official CMS site"
### you have to specify the name as written in 
storage_element = T2_KR_KNU
### the user_remote_dir will be created under the SE mountpoint
### in the case of publication this directory is not considered
user_remote_dir = 115.0

### To publish produced output in a local istance of DBS set publish_data = 1
publish_data=1
### Specify the dataset name. The full path will be <primarydataset>/<publish_data_name>/USER
publish_data_name = HppEMu_130GeV_7TeV_GEN_HLT
### Specify the URL of DBS istance where CRAB has to publish the output files
dbs_url_for_publication= http://cmssrv17.fnal.gov:8989/DBS108LOC1/servlet/DBSServlet

  • error during publication
[lxplus251] ~/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/test_3 > crab -publish
crab:  Version 2.6.5 running on Mon Dec 14 14:14:27 2009 CET (13:14:27 UTC)
 
crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /afs/cern.ch/user/h/hkseo/H++/CMSSW_2_2_13/src/HiggsAnalysis/DoublyChargedHiggs/test_3/crab_0_091211_153153/
 
crab:  <dbs_url_for_publication> = http://cmssrv17.fnal.gov:8989/DBS108LOC1/servlet/DBSServlet
crab:  --->>> Start dataset publication
Traceback (most recent call last):
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/python/crab.py", line 878, in ?
    crab.run()
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/python/crab.py", line 816, in run
    if act in self.actions.keys(): self.actions[act].run()
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/python/Publisher.py", line 298, in run
    self.exit_status=self.publishDataset(file_list[0])
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/python/Publisher.py", line 157, in publishDataset
    dbswriter = DBSWriter(self.DBSURL)
  File "/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/external/ProdCommon/DataMgmt/DBS/DBSWriter.py", line 214, in __init__
    raise DBSWriterError(msg)
ProdCommon.DataMgmt.DBS.DBSErrors.DBSWriterError: DBSWriterError
Message: Error in DBSWriterError with DbsApi
DbsConnectionError:Could not locate the host cmssrv17.fnal.gov 400
 
        ModuleName : ProdCommon.DataMgmt.DataMgmtError
        MethodName : __init__
        ClassInstance : None
        FileName : /afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_6_5/external/ProdCommon/DataMgmt/DataMgmtError.py
        ClassName : None
        LineNumber : 22
        ErrorNr : 1001

2009/12/11

setting in crab.cfg for publication at KNU
  • refer to https://twiki.cern.ch/twiki/bin/viewauth/CMS/CrabNewHowTo
  • dbs_url_for_publication = "http://cmssrv17.fnal.gov:8989/DBS108LOC1/servlet/DBSServlet"
  • storage_element = cluster142.knu.ac.kr
  • storage_path = /srm/managerv1?SFN=/pnfs/knu.ac.kr/data/cms/store/user/(my account name)

-- HyunkwanSeo - 14 Dec 2009

Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r4 - 2009-12-30 - HyunkwanSeo
 
KOREA-CMS
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding KoreaCmsWiki? Send feedback