Difference: HyunKwanFileRegInstall (1 vs. 8)

Revision 82008-10-07 - HyunkwanSeo

 
META TOPICPARENT name="HyunkwansLog"
Changed:
<
<

File transfer

>
>

How to install DQM file archival scripts

 
Added:
>
>

File transfer script

 
sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}

mkdir YourDirectory
cd YourDirectory
mkdir log
source ~cmssw2/cmsset_default.sh     # Get CMS commands like 'scramv1'
CMSSW_V=CMSSW_2_1_9
scramv1 p CMSSW $CMSSW_V
cd $CMSSW_V/src
cvs -Q co DQM/Integration/scripts
cd -
cp $CMSSW_V/src/DQM/Integration/scripts/filesave_online.py .
cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_filesave.sh .
cp $CMSSW_V/src/DQM/Integration/scripts/sistrip_reduce_file.C .
cp $CMSSW_V/src/DQM/Integration/scripts/convert.sh .
cp $CMSSW_V/src/DQM/Integration/scripts/filechk.C .
cp $CMSSW_V/src/DQM/Integration/scripts/filechk.sh .

modify the following entries in alivecheck_filesave.sh

WorkDir=YourDirectory
YourEmail=Hyunkwan.Seo@cern.ch

modify the following entries in filesave_online.py

#set environments
exedir = '/home/dqmprolocal/filecopy' # directory to execute the relevant scripts
DIR = '/home/dqmprolocal/output'  #directory to search new files
TMPDIR = '/data/dqm/.dropbox_tmp' # stealth area on cmsmon
FILEDIR = '/data/dqm/dropbox' # directory, to which files are stored
TimeTag = '/home/dqmprolocal/output/timetag' #file for time tag for searching new file
server = 'srv-c2d05-19' #machine to which files are transfered

make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory/alivecheck_filesave.sh >& /dev/null

then, file transfer will start automatically.

Changed:
<
<

File merge and register

>
>

File merge and register script

 
sudo -u dqm -H bash at srv-c2d05-19

mkdir YourDirectory
cd YourDirectory
mkdir log
source /home/dqm/rpms/cmsset_default.sh
CMSSW_V=CMSSW_2_1_9
scramv1 p CMSSW $CMSSW_V
cd $CMSSW_V/src
cvs -Q co DQM/Integration
cvs -Q co DQMServices VisMonitoring/DQMServer
cvs -Q up -r V03-03-06 DQMServices/Core
cvs -Q up -r V03-03-03 DQMServices/Components
cp DQM/Integration/bin/getDQMSummary.py YourDirectory/

replace getDQMSummary.py with YourDirectory/getDQMSummary.py in DQM/Integration/bin/GetAndWriteDQMSummaryIntoOMDS.cpp

scramv1 b -j 4
source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh
cmsenv
cd -
export TNS_ADMIN=/nfshome0/xiezhen/conddb

cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_dqmPostProcessing.sh .
cp $CMSSW_V/src/DQM/Integration/scripts/dqmPostProcessing_online.py .
cp $CMSSW_V/src/DQM/Integration/scripts/mergeAndRegister.py .

modify the following entries in alivecheck_dqmPostProcessing.sh

WorkDir=YourDirectory
CMSSW_V=CMSSW_2_1_6
YourEmail=Hyunkwan.Seo@cern.ch

modify the following entries in dqmPostProcessing_online.py

### set environments
DIR = '/data/dqm/dropbox'  # directory to search new files
DB = '/home/dqm/dqm.db' #master db
BAKDB = '/data/dqm/filereg/backups/dqm.db' #bakcup db (timestamp will be attatched)
TMPDB = '/data/dqm/dropbox/dqm-tmp.db' # temporal db
FILEDIR = '/data/dqm/results' # directory, to which merged file is stored
TMPDIR = '/data/dqm/.dropbox_tmp' # directory, in which merged file is created
TimeTag = '/data/dqm/dropbox/timetag' #file for time tag for searching new file
LOGDIR = '/data/dqm/filereg/log'
WAITTIME = 120 # waiting time for new files (sec)
MERGE_EXE = '/data/dqm/filereg/mergeAndRegister.py'

make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory/alivecheck_dqmPostProcessing.sh >& /dev/null

then, file merge and register will start automatically.

-- HyunkwanSeo - 24 Sep 2008

Revision 72008-10-06 - HyunkwanSeo

 
META TOPICPARENT name="HyunkwansLog"
Changed:
<
<
File copy program
>
>

File transfer

 
Changed:
<
<
>
>
 sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}

mkdir YourDirectory? cd YourDirectory? mkdir log source ~cmssw2/cmsset_default.sh # Get CMS commands like 'scramv1' CMSSW_V=CMSSW_2_1_9 scramv1 p CMSSW $CMSSW_V cd $CMSSW_V/src cvs -Q co DQM/Integration/scripts cd - cp $CMSSW_V/src/DQM/Integration/scripts/filesave_online.py . cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_filesave.sh . cp $CMSSW_V/src/DQM/Integration/scripts/sistrip_reduce_file.C . cp $CMSSW_V/src/DQM/Integration/scripts/convert.sh . cp $CMSSW_V/src/DQM/Integration/scripts/filechk.C . cp $CMSSW_V/src/DQM/Integration/scripts/filechk.sh .

Deleted:
<
<
 
Changed:
<
<
modify the following entries in alivecheck_filesave.sh
export WorkDir=YourDirectory
export YourEmail=Hyunkwan.Seo@cern.ch
>
>
modify the following entries in alivecheck_filesave.sh
WorkDir=YourDirectory
YourEmail=Hyunkwan.Seo@cern.ch
 
Deleted:
<
<
 
Changed:
<
<
modify the following entries in filesave_online.py
>
>
modify the following entries in filesave_online.py
Added:
>
>
 #set environments exedir = '/home/dqmprolocal/filecopy' # directory to execute the relevant scripts DIR = '/home/dqmprolocal/output' #directory to search new files TMPDIR = '/data/dqm/.dropbox_tmp' # stealth area on cmsmon FILEDIR = '/data/dqm/dropbox' # directory, to which files are stored TimeTag? = '/home/dqmprolocal/output/timetag' #file for time tag for searching new file server = 'srv-c2d05-19' #machine to which files are transfered
Deleted:
<
<
 
Added:
>
>
 make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory/alivecheck_filesave.sh >& /dev/null

Changed:
<
<
then, file copy will start automatically.
>
>
then, file transfer will start automatically.
 
Deleted:
<
<
File merge and register
 
Added:
>
>

File merge and register

 
sudo -u dqm -H bash at srv-c2d05-19

mkdir YourDirectory
cd YourDirectory
mkdir log
source /home/dqm/rpms/cmsset_default.sh
CMSSW_V=CMSSW_2_1_9
scramv1 p CMSSW $CMSSW_V
cd $CMSSW_V/src
cvs -Q co DQM/Integration
cvs -Q co DQMServices VisMonitoring/DQMServer
cvs -Q up -r V03-03-06 DQMServices/Core
cvs -Q up -r V03-03-03 DQMServices/Components
cp DQM/Integration/bin/getDQMSummary.py YourDirectory/
Changed:
<
<
##### replace getDQMSummary.py with YourDirectory?/getDQMSummary.py ##### in DQM/Integration/bin/GetAndWriteDQMSummaryIntoOMDS.cpp
>
>
Added:
>
>
replace getDQMSummary.py with YourDirectory/getDQMSummary.py in DQM/Integration/bin/GetAndWriteDQMSummaryIntoOMDS.cpp
 scramv1 b -j 4 source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh cmsenv cd - export TNS_ADMIN=/nfshome0/xiezhen/conddb

cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_dqmPostProcessing.sh . cp $CMSSW_V/src/DQM/Integration/scripts/dqmPostProcessing_online.py . cp $CMSSW_V/src/DQM/Integration/scripts/mergeAndRegister.py .

modify the following entries in alivecheck_dqmPostProcessing.sh

Changed:
<
<
>
>
 WorkDir?=YourDirectory CMSSW_V=CMSSW_2_1_6 YourEmail?=Hyunkwan.Seo@cern.ch

modify the following entries in dqmPostProcessing_online.py

Changed:
<
<
>
>
 ### set environments DIR = '/data/dqm/dropbox' # directory to search new files DB = '/home/dqm/dqm.db' #master db BAKDB = '/data/dqm/filereg/backups/dqm.db' #bakcup db (timestamp will be attatched) TMPDB = '/data/dqm/dropbox/dqm-tmp.db' # temporal db FILEDIR = '/data/dqm/results' # directory, to which merged file is stored TMPDIR = '/data/dqm/.dropbox_tmp' # directory, in which merged file is created TimeTag? = '/data/dqm/dropbox/timetag' #file for time tag for searching new file LOGDIR = '/data/dqm/filereg/log' WAITTIME = 120 # waiting time for new files (sec) MERGE_EXE = '/data/dqm/filereg/mergeAndRegister.py'

make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory/alivecheck_dqmPostProcessing.sh >& /dev/null

then, file merge and register will start automatically.

Added:
>
>
 

-- HyunkwanSeo - 24 Sep 2008

Revision 62008-10-06 - HyunkwanSeo

 
META TOPICPARENT name="HyunkwansLog"
File copy program
Changed:
<
<
>
>
 sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}

mkdir YourDirectory? cd YourDirectory? mkdir log source ~cmssw2/cmsset_default.sh # Get CMS commands like 'scramv1' CMSSW_V=CMSSW_2_1_9 scramv1 p CMSSW $CMSSW_V cd $CMSSW_V/src cvs -Q co DQM/Integration/scripts cd - cp $CMSSW_V/src/DQM/Integration/scripts/filesave_online.py . cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_filesave.sh . cp $CMSSW_V/src/DQM/Integration/scripts/sistrip_reduce_file.C . cp $CMSSW_V/src/DQM/Integration/scripts/convert.sh . cp $CMSSW_V/src/DQM/Integration/scripts/filechk.C . cp $CMSSW_V/src/DQM/Integration/scripts/filechk.sh .

Added:
>
>
 
Changed:
<
<
modify the following entries in alivecheck_filesave.sh
>
>
modify the following entries in alivecheck_filesave.sh
 export WorkDir?=YourDirectory export YourEmail?=Hyunkwan.Seo@cern.ch
Added:
>
>
 
Changed:
<
<
modify the following entries in filesave_online.py
>
>
modify the following entries in filesave_online.py
 
#set environments
exedir = '/home/dqmprolocal/filecopy' # directory to execute the relevant scripts
DIR = '/home/dqmprolocal/output'  #directory to search new files
TMPDIR = '/data/dqm/.dropbox_tmp' # stealth area on cmsmon
FILEDIR = '/data/dqm/dropbox' # directory, to which files are stored
TimeTag = '/home/dqmprolocal/output/timetag' #file for time tag for searching new file
server = 'srv-c2d05-19' #machine to which files are transfered
Changed:
<
<
>
>
  make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory/alivecheck_filesave.sh >& /dev/null

then, file copy will start automatically.

File merge and register

sudo -u dqm -H bash at srv-c2d05-19

mkdir YourDirectory
cd YourDirectory
mkdir log
source /home/dqm/rpms/cmsset_default.sh
CMSSW_V=CMSSW_2_1_9
scramv1 p CMSSW $CMSSW_V
cd $CMSSW_V/src
cvs -Q co DQM/Integration
cvs -Q co DQMServices VisMonitoring/DQMServer
cvs -Q up -r V03-03-06 DQMServices/Core
cvs -Q up -r V03-03-03 DQMServices/Components
cp DQM/Integration/bin/getDQMSummary.py YourDirectory/
##### replace getDQMSummary.py with YourDirectory/getDQMSummary.py
##### in  DQM/Integration/bin/GetAndWriteDQMSummaryIntoOMDS.cpp
scramv1 b -j 4
source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh
cmsenv
cd -
export TNS_ADMIN=/nfshome0/xiezhen/conddb

cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_dqmPostProcessing.sh .
cp $CMSSW_V/src/DQM/Integration/scripts/dqmPostProcessing_online.py .
cp $CMSSW_V/src/DQM/Integration/scripts/mergeAndRegister.py .

modify the following entries in alivecheck_dqmPostProcessing.sh

WorkDir=YourDirectory
CMSSW_V=CMSSW_2_1_6
YourEmail=Hyunkwan.Seo@cern.ch

modify the following entries in dqmPostProcessing_online.py

### set environments
DIR = '/data/dqm/dropbox'  # directory to search new files
DB = '/home/dqm/dqm.db' #master db
BAKDB = '/data/dqm/filereg/backups/dqm.db' #bakcup db (timestamp will be attatched)
TMPDB = '/data/dqm/dropbox/dqm-tmp.db' # temporal db
FILEDIR = '/data/dqm/results' # directory, to which merged file is stored
TMPDIR = '/data/dqm/.dropbox_tmp' # directory, in which merged file is created
TimeTag = '/data/dqm/dropbox/timetag' #file for time tag for searching new file
LOGDIR = '/data/dqm/filereg/log'
WAITTIME = 120 # waiting time for new files (sec)
MERGE_EXE = '/data/dqm/filereg/mergeAndRegister.py'

make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory/alivecheck_dqmPostProcessing.sh >& /dev/null

then, file merge and register will start automatically.

-- HyunkwanSeo - 24 Sep 2008

Revision 52008-10-01 - HyunkwanSeo

 
META TOPICPARENT name="HyunkwansLog"
File copy program

sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}

mkdir YourDirectory
cd YourDirectory
mkdir log
source ~cmssw2/cmsset_default.sh     # Get CMS commands like 'scramv1'
CMSSW_V=CMSSW_2_1_9
scramv1 p CMSSW $CMSSW_V
cd $CMSSW_V/src
cvs -Q co DQM/Integration/scripts
cd -
cp $CMSSW_V/src/DQM/Integration/scripts/filesave_online.py .
cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_filesave.sh .
cp $CMSSW_V/src/DQM/Integration/scripts/sistrip_reduce_file.C .
cp $CMSSW_V/src/DQM/Integration/scripts/convert.sh .
cp $CMSSW_V/src/DQM/Integration/scripts/filechk.C .
cp $CMSSW_V/src/DQM/Integration/scripts/filechk.sh .

modify the following entries in alivecheck_filesave.sh

export WorkDir=YourDirectory
export YourEmail=Hyunkwan.Seo@cern.ch

modify the following entries in filesave_online.py

#set environments
exedir = '/home/dqmprolocal/filecopy' # directory to execute the relevant scripts
DIR = '/home/dqmprolocal/output'  #directory to search new files
TMPDIR = '/data/dqm/.dropbox_tmp' # stealth area on cmsmon
FILEDIR = '/data/dqm/dropbox' # directory, to which files are stored
TimeTag = '/home/dqmprolocal/output/timetag' #file for time tag for searching new file
server = 'srv-c2d05-19' #machine to which files are transfered

make cronjob like following by crontab -e

Changed:
<
<
0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory?/alivecheck_filesave.sh >& /dev/null
>
>
0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory/alivecheck_filesave.sh >& /dev/null
  then, file copy will start automatically.

File merge and register

sudo -u dqm -H bash at srv-c2d05-19

mkdir YourDirectory
cd YourDirectory
Added:
>
>
mkdir log
 source /home/dqm/rpms/cmsset_default.sh
Changed:
<
<
scramv1 p CMSSW CMSSW_2_1_6 cd CMSSW_2_1_6/src
>
>
CMSSW_V=CMSSW_2_1_9 scramv1 p CMSSW $CMSSW_V
Added:
>
>
cd $CMSSW_V/src
 cvs -Q co DQM/Integration cvs -Q co DQMServices VisMonitoring?/DQMServer cvs -Q up -r V03-03-06 DQMServices/Core cvs -Q up -r V03-03-03 DQMServices/Components
Changed:
<
<
perl -p -i -e 's|";$|.,:%[]>";| if /s_safe =/' DQMServices/Core/src/DQMStore.cc cp DQM/Integration/bin/getDQMSummary.py .
>
>
cp DQM/Integration/bin/getDQMSummary.py YourDirectory?/ ##### replace getDQMSummary.py with YourDirectory?/getDQMSummary.py
Deleted:
<
<
##### replace getDQMSummary.py with /data/dqm/filereg/getDQMSummary.py
 ##### in DQM/Integration/bin/GetAndWriteDQMSummaryIntoOMDS.cpp scramv1 b -j 4 source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh cmsenv cd - export TNS_ADMIN=/nfshome0/xiezhen/conddb
Changed:
<
<
cp DQM/Integration/scripts/alivecheck_dqmPostProcessing.sh . cp DQM/Integration/scripts/dqmPostProcessing_online.py . cp DQM/Integration/scripts/mergeAndRegister.py .
>
>
cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_dqmPostProcessing.sh . cp $CMSSW_V/src/DQM/Integration/scripts/dqmPostProcessing_online.py . cp $CMSSW_V/src/DQM/Integration/scripts/mergeAndRegister.py .
Deleted:
<
<
cp DQM/Integration/scripts/setupForFileReg.sh .
 
Changed:
<
<
make setupForFileReg.sh containing the following commands
>
>
modify the following entries in alivecheck_dqmPostProcessing.sh
Deleted:
<
<
 
Changed:
<
<
#! /bin/bash
>
>
WorkDir?=YourDirectory
Added:
>
>
CMSSW_V=CMSSW_2_1_6 YourEmail?=Hyunkwan.Seo@cern.ch
 
Changed:
<
<
source /home/dqm/rpms/cmsset_default.sh cd YourDirectory?/CMSSW_2_1_6/src source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh cmsenv cd -
>
>
modify the following entries in dqmPostProcessing_online.py
### set environments
DIR = '/data/dqm/dropbox'  # directory to search new files
Added:
>
>
DB = '/home/dqm/dqm.db' #master db BAKDB = '/data/dqm/filereg/backups/dqm.db' #bakcup db (timestamp will be attatched) TMPDB = '/data/dqm/dropbox/dqm-tmp.db' # temporal db FILEDIR = '/data/dqm/results' # directory, to which merged file is stored TMPDIR = '/data/dqm/.dropbox_tmp' # directory, in which merged file is created TimeTag? = '/data/dqm/dropbox/timetag' #file for time tag for searching new file LOGDIR = '/data/dqm/filereg/log' WAITTIME = 120 # waiting time for new files (sec) MERGE_EXE = '/data/dqm/filereg/mergeAndRegister.py'
 

make cronjob like following by crontab -e

Changed:
<
<
0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory?/alivecheck_dqmPostProcessing.sh >& /dev/null
>
>
0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory/alivecheck_dqmPostProcessing.sh >& /dev/null
  then, file merge and register will start automatically.

-- HyunkwanSeo - 24 Sep 2008

Revision 42008-10-01 - HyunkwanSeo

 
META TOPICPARENT name="HyunkwansLog"
File copy program

sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}

mkdir YourDirectory
cd YourDirectory
Added:
>
>
mkdir log
 source ~cmssw2/cmsset_default.sh # Get CMS commands like 'scramv1'
Changed:
<
<
scramv1 p CMSSW CMSSW_2_1_4 cd CMSSW_2_1_4/src
>
>
CMSSW_V=CMSSW_2_1_9 scramv1 p CMSSW $CMSSW_V
Added:
>
>
cd $CMSSW_V/src
 cvs -Q co DQM/Integration/scripts
Deleted:
<
<
scramv1 b -j 4 eval `scramv1 runtime -sh`
 cd -
Changed:
<
<
cp DQM/Integration/scripts/filesave_online.py . cp DQM/Integration/scripts/alivecheck_filesave.sh . cp DQM/Integration/scripts/env.sh . cp DQM/Integration/scripts/sistrip_reduce_file.C . cp DQM/Integration/scripts/convert.sh . cp DQM/Integration/scripts/filechk.C .
>
>
cp $CMSSW_V/src/DQM/Integration/scripts/filesave_online.py . cp $CMSSW_V/src/DQM/Integration/scripts/alivecheck_filesave.sh . cp $CMSSW_V/src/DQM/Integration/scripts/sistrip_reduce_file.C . cp $CMSSW_V/src/DQM/Integration/scripts/convert.sh . cp $CMSSW_V/src/DQM/Integration/scripts/filechk.C . cp $CMSSW_V/src/DQM/Integration/scripts/filechk.sh .
Deleted:
<
<
cp DQM/Integration/scripts/filechk.sh .
 
Changed:
<
<
>
>
modify the following entries in alivecheck_filesave.sh
Deleted:
<
<
make env.sh containing the following commands
 
Changed:
<
<
#! /bin/bash
>
>
export WorkDir?=YourDirectory
Added:
>
>
export YourEmail?=Hyunkwan.Seo@cern.ch
 
Changed:
<
<
source ~cmssw2/cmsset_default.sh # Get CMS commands like 'scramv1' cd YourDirectory?/CMSSW_2_1_4/src eval `scramv1 runtime -sh` cd -
>
>
modify the following entries in filesave_online.py
#set environments
exedir = '/home/dqmprolocal/filecopy' # directory to execute the relevant scripts
Added:
>
>
DIR = '/home/dqmprolocal/output' #directory to search new files TMPDIR = '/data/dqm/.dropbox_tmp' # stealth area on cmsmon FILEDIR = '/data/dqm/dropbox' # directory, to which files are stored TimeTag? = '/home/dqmprolocal/output/timetag' #file for time tag for searching new file server = 'srv-c2d05-19' #machine to which files are transfered
 

make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory?/alivecheck_filesave.sh >& /dev/null

then, file copy will start automatically.

File merge and register

sudo -u dqm -H bash at srv-c2d05-19

mkdir YourDirectory
cd YourDirectory
source /home/dqm/rpms/cmsset_default.sh
scramv1 p CMSSW CMSSW_2_1_6
cd CMSSW_2_1_6/src
cvs -Q co DQM/Integration
cvs -Q co DQMServices VisMonitoring/DQMServer
cvs -Q up -r V03-03-06 DQMServices/Core
cvs -Q up -r V03-03-03 DQMServices/Components
perl -p -i -e 's|";$|.,:%[]>";| if /s_safe =/' DQMServices/Core/src/DQMStore.cc
cp DQM/Integration/bin/getDQMSummary.py .
##### replace getDQMSummary.py with /data/dqm/filereg/getDQMSummary.py
##### in  DQM/Integration/bin/GetAndWriteDQMSummaryIntoOMDS.cpp
scramv1 b -j 4
source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh
cmsenv
cd -
export TNS_ADMIN=/nfshome0/xiezhen/conddb

cp DQM/Integration/scripts/alivecheck_dqmPostProcessing.sh .
cp DQM/Integration/scripts/dqmPostProcessing_online.py .
cp DQM/Integration/scripts/mergeAndRegister.py .
cp DQM/Integration/scripts/setupForFileReg.sh .

make setupForFileReg.sh containing the following commands

#! /bin/bash

source /home/dqm/rpms/cmsset_default.sh
cd YourDirectory/CMSSW_2_1_6/src
source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh
cmsenv
cd -

make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory?/alivecheck_dqmPostProcessing.sh >& /dev/null

then, file merge and register will start automatically.

-- HyunkwanSeo - 24 Sep 2008

Revision 32008-09-24 - HyunkwanSeo

 
META TOPICPARENT name="HyunkwansLog"
File copy program
Deleted:
<
<
sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}

  • At the first login
 
Added:
>
>
sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}

mkdir YourDirectory? cd YourDirectory?

 source ~cmssw2/cmsset_default.sh # Get CMS commands like 'scramv1' scramv1 p CMSSW CMSSW_2_1_4 cd CMSSW_2_1_4/src cvs -Q co DQM/Integration/scripts scramv1 b -j 4 eval `scramv1 runtime -sh` cd - cp DQM/Integration/scripts/filesave_online.py . cp DQM/Integration/scripts/alivecheck_filesave.sh . cp DQM/Integration/scripts/env.sh . cp DQM/Integration/scripts/sistrip_reduce_file.C . cp DQM/Integration/scripts/convert.sh . cp DQM/Integration/scripts/filechk.C . cp DQM/Integration/scripts/filechk.sh .
Changed:
<
<
  • At every login
>
>
Added:
>
>
make env.sh containing the following commands
 
Added:
>
>
#! /bin/bash
 source ~cmssw2/cmsset_default.sh # Get CMS commands like 'scramv1'
Changed:
<
<
cd CMSSW_2_1_4/src
>
>
cd YourDirectory?/CMSSW_2_1_4/src
 eval `scramv1 runtime -sh` cd -
Deleted:
<
<
But the above procedure is written in env.sh.
 
Added:
>
>
 make cronjob like following by crontab -e
Changed:
<
<
0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/dqmprolocal/filecopy/alivecheck_filesave.sh >& /dev/null
>
>
0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory?/alivecheck_filesave.sh >& /dev/null
  then, file copy will start automatically.

File merge and register

Deleted:
<
<
sudo -u dqm -H bash at srv-c2d05-19

  • At the first login
 
Added:
>
>
sudo -u dqm -H bash at srv-c2d05-19

mkdir YourDirectory? cd YourDirectory?

 source /home/dqm/rpms/cmsset_default.sh scramv1 p CMSSW CMSSW_2_1_6 cd CMSSW_2_1_6/src cvs -Q co DQM/Integration cvs -Q co DQMServices VisMonitoring?/DQMServer cvs -Q up -r V03-03-06 DQMServices/Core cvs -Q up -r V03-03-03 DQMServices/Components perl -p -i -e 's|";$|.,:%[]>";| if /s_safe =/' DQMServices/Core/src/DQMStore.cc cp DQM/Integration/bin/getDQMSummary.py . ##### replace getDQMSummary.py with /data/dqm/filereg/getDQMSummary.py ##### in DQM/Integration/bin/GetAndWriteDQMSummaryIntoOMDS.cpp scramv1 b -j 4 source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh cmsenv cd - export TNS_ADMIN=/nfshome0/xiezhen/conddb

cp DQM/Integration/scripts/alivecheck_dqmPostProcessing.sh . cp DQM/Integration/scripts/dqmPostProcessing_online.py . cp DQM/Integration/scripts/mergeAndRegister.py . cp DQM/Integration/scripts/setupForFileReg.sh .

Changed:
<
<
  • At every login
>
>
Added:
>
>
make setupForFileReg.sh containing the following commands
 
Added:
>
>
#! /bin/bash
 source /home/dqm/rpms/cmsset_default.sh
Changed:
<
<
cd /data/dqm/filereg/CMSSW_2_1_6/src
>
>
cd YourDirectory?/CMSSW_2_1_6/src
 source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh cmsenv cd -
Deleted:
<
<
 
Deleted:
<
<
But the above procedure is written in setupForFileReg.sh.
  make cronjob like following by crontab -e
Changed:
<
<
0,5,10,15,20,25,30,35,40,45,50,55 * * * * /data/dqm/filereg/alivecheck_dqmPostProcessing.sh >& /dev/null
>
>
0,5,10,15,20,25,30,35,40,45,50,55 * * * * YourDirectory?/alivecheck_dqmPostProcessing.sh >& /dev/null
  then, file merge and register will start automatically.
Added:
>
>
 

-- HyunkwanSeo - 24 Sep 2008

Revision 22008-09-24 - HyunkwanSeo

 
META TOPICPARENT name="HyunkwansLog"
File copy program
Added:
>
>
 sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}
Changed:
<
<
At the first login
>
>
  • At the first login
 
source ~cmssw2/cmsset_default.sh     # Get CMS commands like 'scramv1'
scramv1 p CMSSW CMSSW_2_1_4
cd CMSSW_2_1_4/src
Added:
>
>
cvs -Q co DQM/Integration/scripts
 scramv1 b -j 4 eval `scramv1 runtime -sh` cd -
Added:
>
>
cp DQM/Integration/scripts/filesave_online.py . cp DQM/Integration/scripts/alivecheck_filesave.sh . cp DQM/Integration/scripts/env.sh . cp DQM/Integration/scripts/sistrip_reduce_file.C . cp DQM/Integration/scripts/convert.sh . cp DQM/Integration/scripts/filechk.C . cp DQM/Integration/scripts/filechk.sh .
 
Changed:
<
<
At every login
>
>
  • At every login
 
source ~cmssw2/cmsset_default.sh     # Get CMS commands like 'scramv1'
cd CMSSW_2_1_4/src
eval `scramv1 runtime -sh`
cd -
Added:
>
>
But the above procedure is written in env.sh.
 
Added:
>
>
make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/dqmprolocal/filecopy/alivecheck_filesave.sh >& /dev/null

then, file copy will start automatically.

File merge and register

sudo -u dqm -H bash at srv-c2d05-19

  • At the first login
source /home/dqm/rpms/cmsset_default.sh
scramv1 p CMSSW CMSSW_2_1_6
cd CMSSW_2_1_6/src
cvs -Q co DQM/Integration
cvs -Q co DQMServices VisMonitoring/DQMServer
cvs -Q up -r V03-03-06 DQMServices/Core
cvs -Q up -r V03-03-03 DQMServices/Components
perl -p -i -e 's|";$|.,:%[]>";| if /s_safe =/' DQMServices/Core/src/DQMStore.cc
cp DQM/Integration/bin/getDQMSummary.py .
##### replace getDQMSummary.py with /data/dqm/filereg/getDQMSummary.py
##### in  DQM/Integration/bin/GetAndWriteDQMSummaryIntoOMDS.cpp
scramv1 b -j 4
source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh
cmsenv
cd -
export TNS_ADMIN=/nfshome0/xiezhen/conddb

cp DQM/Integration/scripts/alivecheck_dqmPostProcessing.sh .
cp DQM/Integration/scripts/dqmPostProcessing_online.py .
cp DQM/Integration/scripts/mergeAndRegister.py .
cp DQM/Integration/scripts/setupForFileReg.sh .

  • At every login
source /home/dqm/rpms/cmsset_default.sh
cd /data/dqm/filereg/CMSSW_2_1_6/src
source /home/dqm/rpms/slc4_ia32_gcc345/cms/dqmgui/4.2.3/etc/profile.d/env.sh
cmsenv
cd -

But the above procedure is written in setupForFileReg.sh.

make cronjob like following by crontab -e

0,5,10,15,20,25,30,35,40,45,50,55 * * * * /data/dqm/filereg/alivecheck_dqmPostProcessing.sh >& /dev/null

then, file merge and register will start automatically.

 

-- HyunkwanSeo - 24 Sep 2008

Revision 12008-09-24 - HyunkwanSeo

 
META TOPICPARENT name="HyunkwansLog"
File copy program sudo -u dqm -H bash at srv-c2d05-{15,16,17,18}

At the first login

source ~cmssw2/cmsset_default.sh     # Get CMS commands like 'scramv1'
scramv1 p CMSSW CMSSW_2_1_4
cd CMSSW_2_1_4/src
scramv1 b -j 4
eval `scramv1 runtime -sh`
cd -

At every login

source ~cmssw2/cmsset_default.sh     # Get CMS commands like 'scramv1'
cd CMSSW_2_1_4/src
eval `scramv1 runtime -sh`
cd -

-- HyunkwanSeo - 24 Sep 2008

 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding KoreaCmsWiki? Send feedback