CRAB for CMS-HI Dilepton group

Prerequisites

  • DongHo summarize the prerequisites, please visit here.

Preparation

Real CRAB

  • Step 1 : Store data at castor (not publishing on DBS)
(Notice : If you access the data in castor by crab, please read this.)

  • Step 2 : Store data at MIT and publish on DBS

Tips for effective work

  • If you want to store data at castor, before submit CRAB you should do following first. (ex: stored directory : /castor/cern.ch/user/h/hckim/JulyExercise10/JulyExercise10_HardEnriched_Dilepton_skim0)
    • rfrm -r /castor/cern.ch/user/h/hckim/JulyExercise10/JulyExercise10_HardEnriched_Dilepton_skim0
    • rfmkdir /castor/cern.ch/user/h/hckim/JulyExercise10/JulyExercise10_HardEnriched_Dilepton_skim0
    • rfchmod 775 /castor/cern.ch/user/h/hckim/JulyExercise10/JulyExercise10_HardEnriched_Dilepton_skim0
(If the directory doesn't have the right to write by group, you will face to exit code 60307.)

  • At MIT, maximum capacity to process job is about 2000, so it will be good to reduce the number of job per task. In my experience, less than 200 is OK.

  • Because of unknown reason, sometimes crab submit can be failed with exit code 60307. That means the folder to store data doesn't have permit to write by group. At that time, please remove that folder, kill that job and create and submit new job. (Thay may depend on which machine do a job..I guess.)
  • If you face to exit code 8018, do following list. (ex : trouble job : 13, 119)
    • crab -get(or -getoutput) 13, 119
    • crab -resubmit 13, 119

  • When dataset which you accessed with CRAB is extended(that is, addes more event to same dataset), you need to do like following. * crab -extend : That created extended CRAB job added to already created jobs * crab -submit #extended job number : From this step, same as usual jobs

Check whether all the data is stored and published successfully

  • Check the storage at castor
  • Check the storage at MIT
    • store at /net/pstore01/d00/scratch/hckim/PrimaryDataset/User_Dataset_Name/PsetHash/
      • ex. /pnfs/cmsaf.mit.edu/t2bat/cms/store/user/hckim/MinimumBiasHI/JulyExercise10_MinimumBiasHI_dilepton_skim0/bde1f0b06d4fc6b6d44b106f0c9b396a
  • Check the publishment on DBS

Useful link

-- HyunChulKim - 07 Jul 2010

Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r4 - 2010-07-30 - HyunChulKim
 
KOREA-CMS
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding KoreaCmsWiki? Send feedback