2008/06/26

updated getDQMSummary.py script in DQM/Integration/bin
  • again do a cvs co of all the DQM/integration/bin interface and src
  • compiled (scramv1 b)
  • Usage:
    • copy getDQMSummary.py to current directory
    • GetAndWriteDQMSummaryIntoOMDS  [filename] [logfile]

2008/06/16

Implemented identifying incomplete file in filesave_online.py
### check if file is corrupted
        f = TFile(fname)
        if (f.IsZombie()):
                print "File corrupted"
                continue
        else:
                hist = f.FindObjectAny("reportSummaryMap")
                if (hist == None):
                        print "File is incomplete"
                        continue
                else:
                        print "File is OK"
        f.Close()

How to identify incomplete file

  • use the fact that there is no "histogram file directory" in the incomplet file
  • Alternatvely try to look for the object "reportSummary". If this is absent, we can safely assume that the file is bad.

2008/06/13

  • During cruzet2 datataking, some of root files were incomplete so it caused merge script stop.
  • skipped merging run46879, 46890 by hand
  • modified merge script to skip incomplet files and put logfile.

2008/06/03

arrangement of machine for file merge, register and extraction
worker node      
19 Gui <-> /home/dqm/dqm.db   production
18 testing <-> /home/dqm/dqm.db   test
17 /home/dqmprolocal/output/ cronjob production
16 /home/dqmprolocal/output/ cronjob
15 /home/dqmprolocal/output/ cronjob
11 /home/dqmprolocal/output/ cronjob test
10 /home/dqmprolocal/output/ cronjob

  • run filesave_online.py on srv-c2d05-1[5-7]
  • run filesave_online.py on srv-c2d05-1[0-1] for test and development
  • 15,16,17 : copy DQM files to real dropbox, results, dqm.db->19
  • 10,11 : copy DQM files to dropbox_test, results_test, dqm.db->18

new scheme for file merge, register and extraction

Hi,
just to summarize what was discussed separately with you about the
scripts in online DQM for the file merging, archival, registration and 
extraction of info for OMDS and DBS.
The names are tentative. I am happy if you use other names, as long as 
they are coherent and descriptive.

1) script containing the trigger for new files and the loop over the scripts 2-5.
     dqmPostProcessing_online.py   (sleep 2 minutes)   watched by watchdog
     Hyunkwan Seo

2) script  for file merging, archival and registration to the DQM GUI.
     fileMergeAndRegister_online.py
     This script has the filename and returns it.
     Hyunkwan Seo

3) getDQMSummary.py receives filename as argument
     Yuri Gotra

4) writeDQMSummarytoOMDS.py
     this is a wrapper for the code that writes report summary to DBS.
     Michele de Gruttola

5) writeDQMSummarytoDBS.py
     Anzar, Oliver


These scripts should all be versioned in DQM/Integration/scripts


Andreas B. Meyer
-------------------------------------------------------
CERN: 40-3-A24  +412276-71584 (o)   +4176487-2302 (m)
DESY: 1b/267    +4940899893136 (o)  +491778193304 (m)

-- HyunkwanSeo - 05 Jun 2008

Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r6 - 2008-07-07 - HyunkwanSeo
 
KOREA-CMS
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding KoreaCmsWiki? Send feedback