usage of archive.py from Sho

The new version is up in cvs; DQM/Integration/scripts/archive.py.
At top, global variables are defined. You  need change paths to your
testing area. You'll see switches to en/disable functionalities. Those
switches are all off as default(only zipping functionality is on).
There are functions like filreg & fileunreg, but you don't need them
since those are already in your script. At end, you'll find a main
program, where various sub-routines are called. Each sub-routine is
defined and grouped into a similar category somewhere in middle. As
long as only zipping part is concerned, it's done in three steps.
First, get a list of files for zipping from db. Second, make a zip
file and check if it's readable. Third, register a zip file to db. If
you have any trouble with my script, please feel free to contact me
instead of spending too much time to understand what' wrong etc. To
get Tier0 Transfer System work, you need cp
/nfshome0/smaruyam/CMSSW_2_0_10/src/test/myconfig.txt <your test
area>. Without this configuration file, no file can be copied to
Castor. This file shouldn't be uploaded to cvs.



Things to integrate in dqmPostProcessing_online.py
  • merge and register (done & being used)
  • archive.py: make zip files and copy to castor (currently to testbackup disk for test)
  • garbage collection: if the disk is 80% full, unregister old files from dqm.db and remove the old files
  • GetAndWriteDQMSummaryIntoOMDS : plan to write more information. OMDS is read by WBM Customized sfides(?) or RR(run registery)
    • reportSummary, FED Entries, FED Fatal, FED NouFatal, reportSummaryContents

General comments

  • use playback file for test: tag_runend_xxx will be available
  • use playback server (srv-c2d05-18)
  • Next meeting : Wed morning (10:00 am ??)

-- HyunkwanSeo - 14 Nov 2008

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2008-11-17 - HyunkwanSeo
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding KoreaCmsWiki? Send feedback