Difference: SiPixelQuality (19 vs. 20)

Revision 202016-08-26 - TamasVami

Line: 1 to 1
 
META TOPICPARENT name="CmsSusy"
Line: 61 to 61
 
Changed:
<
<		scram b -j
>
>		scram b -j 10
 

New Quality payload generation

Line: 177 to 177
 
wget https://raw.githubusercontent.com/tvami/SiPixelQualtiyValidation/master/TimingStudy_MCValidation_cfg.py
# edit it
Added:
>
>		# make sure this is True: process.siPixelDigis.UseQualityInfo = cms.bool(True)
 
Line: 195 to 196
 
Now lets wait until CRAB finishes the job. In the meantime one can start the data validation
Added:
>
>
crab status -d SiPixelQuality_MCValidation_v$xy+1$
crab getoutput -d SiPixelQuality_MCValidation_v$xy+1$
mv SiPixelQuality_MCValidation_v$xy+1$/results/*.root .
 

Data Validation
Line: 207 to 215
  
# other crab python for data reco
Changed:
<
<		# don't forget to modify $xy+1$, $dataset$, $run$, $user$ variables
>
>		# don't forget to modify $xy+1$, $dataset$, $run$, $user$, $GT$ variables, $GT$ can be learn the following way 

# go to

https://cmsweb.cern.ch/das/ 

#enter the dataset name like


config dataset=$dataset$

# click to the "cmsRun" thing
# look for  "global_tag":
  

import os
import glob
Deleted:
<
<		GT='auto:run2_data'
 from WMCore.Configuration import Configuration config = Configuration()
Line: 224 to 248
 config.section_('General') config.General.transferOutputs = True config.General.transferLogs = True
Changed:
<
<		config.General.requestName = 'SiPixelQuality_MCValidation_v$xy+1$' #can be anything
>
>		config.General.requestName = 'SiPixelQuality_DataValidation_v$xy+1$' #can be anything
  config.section_('JobType') config.JobType.allowUndistributedCMSSW = True config.JobType.pluginName = 'Analysis' config.JobType.psetName = PTSdir+'test/TimingStudy_RunIIData_80X_cfg.py'
Changed:
<
<		config.JobType.pyCfgParams = ['globalTag='+GT]
>
>		config.JobType.pyCfgParams = ['globalTag='$GT$]
 config.JobType.inputFiles = [ PTSdir+'portcardmap.dat', PTSdir+'run_ls_instlumi_pileup_2015.txt' ] config.JobType.outputFiles = ['Ntuple.root'] config.JobType.disableAutomaticOutputCollection = True
Line: 238 to 262
 config.section_('Data') config.Data.inputDataset = '$dataset$ ' config.Data.outLFNDirBase = '/store/user/$user$/QualityValidation'
Changed:
<
<		config.Data.outputDatasetTag = = config.General.requestName
>
>		config.Data.outputDatasetTag = config.General.requestName
 config.Data.splitting = 'LumiBased' config.Data.unitsPerJob = 2 config.Data.runRange = '$run$'
Line: 252 to 276
 crab submit -c crab_config.py
Changed:
<
<		#Now lets wait until CRAB finishes the job.
>
>		#Now lets wait until CRAB finishes the same amount of job as the MC (ie dont have to wait for until the whole dataset is digested). 
crab status -d SiPixelQuality_DataValidation_v$xy+1$
crab getoutput -d SiPixelQuality_DataValidation_v$xy+1$
mv SiPixelQuality_DataValidation_v$xy+1$/results/*.root .
 
Added:
>
>

Plotting the results 

cd $release$/src/MC/
cmsenv
wget http://www.grid.kfki.hu/twiki/pub/CMS/SiPixelQuality/ROC_Occupancy.C
root ROC_Occupancy.C
>> .q
root output.root
>> TBrowser f
# save as a png with the name of v$xy"_occupancyMap.png
 
Changed:
<
<

>
>
cd $release$/src/Data/
wget http://www.grid.kfki.hu/twiki/pub/CMS/SiPixelQuality/ROC_Occupancy.C
root ROC_Occupancy.C
root output.root
>> TBrowser f
# save as a png with the name of v$xy"_occupancyMap_data.png
 

Tracking effect

TimingStudy

Line: 321 to 364
  Studying the valid/traj_missing/traj_inactive modules in three scenarios
Changed:
<
<

Scenario 1)

We have a new bad component but it is not included in the DB yet

>
>

Scenario 1) We have a new bad component but it is not included in the DB yet

 --> in SiPixelQuality_v34_data we had a new bad half module (BmO _Sec8_Lyr1_Ldr9F_Mod4 (TBM-B) -- 302059012)
  • Run range 275891 (the moduel is bad from this run) - 275914 (hlt tag was accepted and uploaded, in the meantime there was a half module that was bad but the DB did not contain it)
Line: 336 to 378
 
Changed:
<
<

Scenario 2)

We have a bad component and it is included in the DB already

>
>

Scenario 2) We have a bad component and it is included in the DB already

 --> in SiPixelQuality_v34_data an old half module (BPix_BmO_SEC7_LYR2_LDR13F_MOD3 (ROC0-7) -- 302126344 [this was added in v33])
  • Run range 275891-275914 (same range is OK)
Line: 352 to 393
 
Changed:
<
<

Scenario 3)

A module is marked bad although it is working

>
>

Scenario 3) A module is marked bad although it is working

 --> v35_data (302123800)
  • Run range 276460-276870 (after this the mistake was corrected)
Line: 366 to 406
 
Deleted:
<
<
<--

 Dateset boarders 



























 Dataset name 
 From #Run 
 Until #Run 
 Comment 




 Run2016B -v2 
 273150 
 275376 
 /ZeroBias/Run2016B-v2/RAW 




 Run2016B -v2 
 273511 
 274100 
 /ZeroBias1/Run2016B-v2/RAW 




 Run2016B -v2 
 273511 
 274100 
 /ZeroBias2/Run2016B-v2/RAW 




 Run2016B -v2 
 273511 
 274100 
 /ZeroBias3/Run2016B-v2/RAW 




 Run2016B -v2 
 273511 
 274100 
 /ZeroBias4/Run2016B-v2/RAW 




 Run2016B -v2 
 273511 
 274100 
 /ZeroBias5/Run2016B-v2/RAW 




 Run2016B -v2 
 273511 
 274100 
 /ZeroBias6/Run2016B-v2/RAW 




 Run2016B -v2 
 273511 
 274100 
 /ZeroBias7/Run2016B-v2/RAW 




 Run2016B -v2 
 273511 
 274100 
 /ZeroBias8/Run2016B-v2/RAW 




 Run2016B -v1 
 272023 
 273146 
 /ZeroBias/Run2016B-v1/RAW 




 Run2016B -v1 
 271884 
 273138 
 /ZeroBias1/Run2016B-v1/RAW 




 Run2016B -v1 
 271884 
 273138 
 /ZeroBias2/Run2016B-v1/RAW 




 Run2016B -v1 
 271884 
 273138 
 /ZeroBias3/Run2016B-v1/RAW 




 Run2016B -v1 
 271884 
 273138 
 /ZeroBias4/Run2016B-v1/RAW 




 Run2016B -v1 
 271884 
 273138 
 /ZeroBias5/Run2016B-v1/RAW 




 Run2016B -v1 
 271884 
 273138 
 /ZeroBias6/Run2016B-v1/RAW 




 Run2016B -v1 
 271884 
 273138 
 /ZeroBias7/Run2016B-v1/RAW 




 Run2016B -v1 
 272007 
 273138 
 /ZeroBias8/Run2016B-v1/RAW 




 Run2016B -v1 
 271884 
 273138 
 /ZeroBias9/Run2016B-v1/RAW 




-->

Recipe

CMSSW 80X

Enviroment 

cmsrel CMSSW_8_0_2
cd CMSSW_8_0_2/src
cmsenv

git cms-addpkg CondTools/SiPixel
git clone https://github.com/jkarancs/PixelTimingStudy DPGAnalysis/PixelTimingStudy
vim DPGAnalysis/PixelTimingStudy/plugins/TimingStudy.cc 
#define COMPLETE 0
#define SPLIT 2
scram b -j

Validation using MC 

cd DPGAnalysis/PixelTimingStudy/test/
wget http://www.grid.kfki.hu/twiki/pub/CMS/SiPixelQuality/2TimingStudy_RawData_CMSSW802_cfg.py.txt 2TimingStudy_RawData_CMSSW802_cfg.py
cmsrun 2TimingStudy_RawData_CMSSW802_cfg.py
# make sure this is True: process.siPixelDigis.UseQualityInfo = cms.bool(True)
# creates Ntuple_IOV30_5k.root

cp Ntuple_IOV30_5k.root  ../../3Ploting@/MCPlot/.
cd  ../../3Ploting@/MCPlot/
# edit ROC_Occupancy.C accordingly
root -l 
.L ROC_Occupancy.C+g
.X ROC_Occupancy.C

Occupancy map from Data 

cd DPGAnalysis/PixelTimingStudy/test/
wget http://www.grid.kfki.hu/twiki/pub/CMS/SiPixelQuality/3TimingStudy_RawData_CMSSW802_cfg.py.txt 3TimingStudy_RawData_CMSSW802_cfg.py
cmsrun 3TimingStudy_RawData_CMSSW802_cfg.py
#creates Ntuple_IOV30_5k.root

cp Ntuple_IOV30_5k.root  ../../3Ploting@/DataPlot/.
cd  ../../3Ploting@/DataPlot/
# edit ROC_Occupancy.C accordingly
root -l 
.L ROC_Occupancy.C+g
.X ROC_Occupancy.C
 
META FILEATTACHMENT attachment="0SiPixelBadModuleByHandBuilder_cfg_v29.py.txt" attr="" comment="SiPixelQuality_byHand_cfg_v29" date="1458642504" name="0SiPixelBadModuleByHandBuilder_cfg_v29.py.txt" path="0SiPixelBadModuleByHandBuilder_cfg_v29.py" size="5294" stream="0SiPixelBadModuleByHandBuilder_cfg_v29.py" tmpFilename="/usr/tmp/CGItemp13490" user="TamasVami" version="1"
META FILEATTACHMENT attachment="2TimingStudy_RawData_CMSSW802_cfg.py.txt" attr="" comment="2TimingStudy_RawData_CMSSW802_cfg" date="1462800793" name="2TimingStudy_RawData_CMSSW802_cfg.py.txt" path="2TimingStudy_RawData_CMSSW802_cfg.py" size="9700" stream="2TimingStudy_RawData_CMSSW802_cfg.py" tmpFilename="/usr/tmp/CGItemp20495" user="TamasVami" version="1"
META FILEATTACHMENT attachment="0SiPixelBadModuleByHandBuilder_cfg_v33.py.txt" attr="" comment="0SiPixelBadModuleByHandBuilder_cfg_v33" date="1463590425" name="0SiPixelBadModuleByHandBuilder_cfg_v33.py.txt" path="0SiPixelBadModuleByHandBuilder_cfg_v33.py" size="3669" stream="0SiPixelBadModuleByHandBuilder_cfg_v33.py" tmpFilename="/usr/tmp/CGItemp10573" user="TamasVami" version="1"
Line: 450 to 414
 
META FILEATTACHMENT attachment="OneCoolingLoop_Layer3.png" attr="" comment="OneCoolingLoop_Layer3" date="1468379859" name="OneCoolingLoop_Layer3.png" path="OneCoolingLoop_Layer3.png" size="47742" stream="OneCoolingLoop_Layer3.png" tmpFilename="/usr/tmp/CGItemp18787" user="TamasVami" version="1"
META FILEATTACHMENT attachment="OneCoolingLoop_Layer4.png" attr="" comment="OneCoolingLoop_Layer4" date="1468379869" name="OneCoolingLoop_Layer4.png" path="OneCoolingLoop_Layer4.png" size="27635" stream="OneCoolingLoop_Layer4.png" tmpFilename="/usr/tmp/CGItemp18769" user="TamasVami" version="1"
META FILEATTACHMENT attachment="0SiPixelBadModuleByHandBuilder_cfg_v36.py.txt" attr="" comment="0SiPixelBadModuleByHandBuilder_cfg_v36" date="1468382856" name="0SiPixelBadModuleByHandBuilder_cfg_v36.py.txt" path="0SiPixelBadModuleByHandBuilder_cfg_v36.py" size="3998" stream="0SiPixelBadModuleByHandBuilder_cfg_v36.py" tmpFilename="/usr/tmp/CGItemp18650" user="TamasVami" version="1"
Changed:
<
<
META FILEATTACHMENT attachment="ROC_Occupancy.C" attr="" comment="ROC_Occupancy -- 2016-07-22" date="1469215443" name="ROC_Occupancy.C" path="ROC_Occupancy.C" size="17395" stream="ROC_Occupancy.C" tmpFilename="/usr/tmp/CGItemp18631" user="TamasVami" version="1"
>
>
META FILEATTACHMENT attachment="ROC_Occupancy.C" attr="" comment="ROC_Occupancy" date="1472228229" name="ROC_Occupancy.C" path="ROC_Occupancy.C" size="17436" stream="ROC_Occupancy.C" tmpFilename="/usr/tmp/CGItemp18846" user="TamasVami" version="3"
View topic | History: r33 < r32 < r31 < r30 | More topic actions...
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright &© by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback