chrispap95 / SVJProduction

Private production of semi-visible jet samples

SVJProduction

Setup

All of the necessary setup (including checkout of this repo, dependencies, and CMSSW compilation) is performed by setup.sh.

For Run 2 ultra-legacy MC production (2016APV, 2016, 2017, 2018), CMSSW_10_6_29_patch1 is used.

wget https://raw.githubusercontent.com/cms-svj/SVJProduction/master/setup.sh
chmod +x setup.sh
./setup.sh
cd CMSSW_10_6_29_patch1/src
cmsenv
cd SVJ/Production

The setup script has several options:

• -c [release]: CMSSW release to install (default = CMSSW_10_6_29_patch1)
• -f [fork]: clone from specified fork (default = cms-svj)
• -b [branch]: clone specified branch (default = Run2_UL)
• -s [protocol]: use protocol to clone (default = https, alternative = ssh)
• -j [cores]: # cores for CMSSW compilation (default = 8)
• -t: install HLT releases
• -h: print help message and exit

For more details about the -t option, see HLT in UL below.

Steps

There are several available steps that may be chained together in multiple combinations. The number in the list below indicates where the step appears in the chain. In some combinations, some numbers may be skipped.

0. Gridpack
1. GEN, LHE-GEN, GEN-SIM, LHE-GEN-SIM
2. SIM
3. DIGI, DIGI-HLT
4. HLT
5. RECO
6. MINIAOD
7. NANOAOD

HLT in UL

The HLT configuration is only valid in the actual CMSSW release cycle that was used online for a specific data-taking period. Therefore, a true simulation of the HLT requires using an older CMSSW release: CMSSW_8_0_33_UL for 2016, CMSSW_9_4_14_UL_patch1 for 2017, CMSSW_10_2_16_UL for 2018. The standalone HLT step can only be executed in the respective release for each year, which can be optionally installed along with the main UL 10_6_X release used for the other steps.

If the older releases are not installed, or the HLT simulation is not needed, the separate DIGI-HLT step can be used instead. This step uses a highly simplified HLT configuration designed for relvals. Therefore, the trigger-related contents from this step will not correspond to the data, but all the other contents (GEN, RECO, MINIAOD, etc.) will be the same.

runSVJ script

The runSVJ script is a wrapper that can customize and run any CMSSW config file. An alternative script runMG.py handles MadGraph gridpack generation. These scripts share the same options:

• maxEvents=[num]: number of events to process (default = -1)
• maxEventsIn=[num]: number of events from input file (if different from maxEvents) (default = -1)
• signal=[bool]: whether this is a signal sample (default = True)
• scan=[string]: name of scan fragment
• fragment=[string]: name of file w/ processParameters fragment
• madgraph=[bool]: generation with MadGraph (instead of default Pythia8)
• nogridpack=[bool]: disable gridpack mode and just generate events (only for runMG) (default = False)
• syst=[bool]: enable systematics for generation with MadGraph (default = False)
• suep=[bool]: run SUEP simulation (default = False)
• channel=[string]: process to generate (default = s, alternative = t)
• boost=[float]: applies a minimum cut of this value (default = 0.0)
• boostvar=[string]: applies the above minimum cut to this variable (default = "madpt", alternatives = "pt")
• mMediator=[val]: mediator mass value (default = 3000.0)
• mDark=[val]: dark hadron mass value (default = 20.0)
• rinv=[val]: invisible fraction value (default = 0.3)
• alpha=[val]: hidden sector force coupling value (default = peak)
• yukawa=[val]: Yukawa coupling for bifundamental mediator (t channel) (default = 1.0)
• nMediator=[val]: generate exclusive signal process based on number of on-shell mediators (default = -1 -> inclusive)
• sepproc=[bool]: use exclusive signal process at gridpack level rather than LHE level (default = True)
• temperature=[val]: temperature for SUEP model (default = 2.0)
• decay=[str]: decay mode for SUEP model (default = generic)
• filterHT=[val]: value of the gen-level HT cut on the SUEP analysis (default = -1.0, no cut)
• filterZ2=[bool]: only keep events with an even number of stable dark hadrons (default = True)
• scout=[bool]: keep scouting collections in miniAOD (default = False)
• part=[num]: part number when producing a sample in multiple jobs (default = 1)
• indir=[str]: directory for input file (local or logical)
• inpre=[str]: prefix for input file name
• outpre=[list]: list of prefixes for output file names (must be same length as list of output modules) (default = step_GEN)
• output=[list]: list of output module names (default = sorted(process.outputModules_()))
• year=[str]: which year to simulate (default = 0, for year-independent configs)
• config=[str]: config file to customize and run (default = step_GEN)
• printEvents=[num]: number of Pythia events to print (default = 1)
• threads=[num]: number of threads to run (default = 1)
• streams=[num]: number of streams to run (default = 0 -> streams = threads)
• redir=[dir]: xrootd redirector for input file
• tmi=[bool]: enable TimeMemoryInfo for simple profiling (default = False)
• dump=[bool]: equivalent to edmConfigDump, but accounts for all command-line settings; exits without running (default = False)
  • for runMG.py, this option keeps the gridpack directory
• dryrun=[bool]: for runMG.py, stop before actually running MadGraph

Basic usage

GEN-level analysis

To run generator-level sample production interactively with example parameters:

cd SVJ/Production/test
cmsRun runSVJ.py year=2016 config=step_GEN outpre=step_GEN mMediator=3000.0 mDark=20.0 rinv=0.3 alpha=0.1 part=1 maxEvents=10

To run a GEN-level analyzer:

cmsRun runSVJ.py config=genmassanalyzer_cfg output=TFileService outpre=genmassanalysis inpre=step_GEN mMediator=3000.0 mDark=20.0 rinv=0.3 alpha=0.1 part=1 maxEvents=10

To run the softdrop algorithm on GenJets/GenParticles from an existing sample, and analyze the result:

cmsRun runSVJ.py config=softDropGenJets outpre=softdropgen indir=/store/user/lpcsusyhad/SVJ2017/ProductionV4/GEN/ inpre=step_GEN redir=root://cmseos.fnal.gov/ mMediator=3000 mDark=20 rinv=0.3 alpha=0.2 maxEvents=500 part=1
cmsRun runSVJ.py config=softdropanalyzer_cfg outpre=softdropana output=TFileService inpre=softdropgen mMediator=3000 mDark=20 rinv=0.3 alpha=0.2 maxEvents=500 part=1

Gen-level for SUEP

To run the sample production interactively for SUEP with example parameters:

cd SVJ/Production/test
cmsRun runSVJ.py suep=1 year=2018 config=step_GEN outpre=step_GEN mMediator=125 mDark=2.0 temperature=2.0 decay=generic part=1 maxEvents=10

Condor submission

Condor submission is supported for the LPC batch system or for the global pool via CMS Connect. Job submission and management is based on the CondorProduction package. Refer to the package documentation for basic details.

The batch directory contains all of the relevant scripts. If you make a copy of this directory and run the submitJobs.py script, it will submit to Condor the specified number of jobs for the specified signal models. Example:

test/lnbatch.sh myProduction
cd myProduction
python submitJobs.py -p -o root://cmseos.fnal.gov//store/user/YOURUSERNAME/myProduction -d signals2 -E 500 -N 20 --outpre step_GEN-SIM --config SVJ.Production.2016.step_GEN-SIM -s

submitJobs.py can also:

• count the expected number of jobs to submit (for planning purposes),
• check for jobs which were completely removed from the queue and make a resubmission list,
• make an output file list for ntuple production.

The class jobSubmitterSVJ.py extends the class jobSubmitter from CondorProduction. It adds a few extra arguments:

Python:

• -y, --getpy: make python file list for ntuple production (new operation mode)
• -d, --dicts [file]: file with list of input dicts; each dict contains signal parameters (required)
• -o, --output [dir]: path to output directory in which root files will be stored (required)
• -E, --maxEvents [num]: number of events to process per job (default = 1)
• -I, --maxEventsIn [num]: number of events from input file (if different from -E) (default = 1)
• -F, --firstPart [num]: first part to process in case extending a sample (default = 1)
• -N, --nParts [num]: number of parts to process
• -K, --skipParts [n1,n2,... or auto]: comma-separated list of parts to skip (or auto, which checks existence of input files)
• --indir [dir]: input file directory (LFN)
• --redir [dir]: input file redirector (default = root://cmseos.fnal.gov/)
• --inpre [str]: input file prefix
• --outpre [str]: output file prefix (required)
• --config [str]: CMSSW config to run (required unless madgraph)
• --year [num]: which year to simulate
• --gridpack: gridpack production
• --madgraph: sample generated w/ madgraph (rather than pythia)
• --suep: run SUEP simulation
• --actualEvents: count actual number of events from each input file (for python file list, requires -K auto)
• -A, --args [list]: additional common args to use for all jobs (passed to runSVJ.py)
• -v, --verbose: enable verbose output (default = False)
• --chain-name [str]: value for job.chainName (default = )

Shell (in step2.sh):

• -o [dir]: output directory
• -j [jobname]: job name
• -p [part]: part number
• -x [redir]: xrootd redirector
• -m [mode]: running mode (madgraph or normal)

Example commands

These examples show how to submit batch jobs for a specific step, demonstrating several different methods for generating 50,000 events with selected signal models.

The basic CondorProduction setup has already been performed by the setup script.

Commands:

Gridpack:

python submitJobs.py -p -d signalsV3_1 -E 10000 -N 1 --outpre step_GRIDPACK --year 2016 --gridpack -o root://cmseos.fnal.gov//store/user/lpcsusyhad/SVJ2017/ProductionV4/2016/GRIDPACK/ -s

LHE-GEN-SIM:

python submitJobs.py -p -d signalsV3_1 -E 1000 -N 100 -I 10000 --indir /store/user/lpcsusyhad/SVJ2017/ProductionV4/2016/GRIDPACK/ --inpre step_GRIDPACK --outpre step_LHE-GEN-SIM --year 2016 --config step_LHE-GEN-SIM --madgraph -o root://cmseos.fnal.gov//store/user/lpcsusyhad/SVJ2017/ProductionV4/2016/GEN-SIM/ -s

GEN-SIM:

python submitJobs.py -p -d signalsV3_1 -E 1000 -N 100 --outpre step_GEN-SIM --year 2016 --config step_GEN-SIM -o root://cmseos.fnal.gov//store/user/lpcsusyhad/SVJ2017/ProductionV4/2016/GEN-SIM/ -s

Chain submission

The script runProd.py can create and submit a chain of jobs to run all* signal production steps. This script automates the creation of a job chain.

* Gridpack production should be run separately, since a single gridpack can be reused by multiple jobs.

Several predefined chains are provided:
P8: 0. GEN-SIM, 1. DIGI, 2. HLT, 3. RECO, 4. MINIAOD
P8-lite: 0. GEN-SIM, 1. DIGI-HLT, 2. RECO, 3. MINIAOD
MG: 0. LHE-GEN-SIM, 1. DIGI, 2. HLT, 3. RECO, 4. MINIAOD
MG-lite: 0. LHE-GEN-SIM, 1. DIGI-HLT, 2. RECO, 3. MINIAOD

These predefined chains can be modified with the script's command-line options, or (as an exclusive option) a custom chain of steps can be used.

The script has several options:

• -P, --predefined [chain]: choose predefined chain
• -C, --custom [steps]: specify steps for custom chain
• -M, --modify [op] [pos/name] [step]: modify predefined chain
  multiple ops can be given in one call, or option can be called multiple times
  ops will be applied in order provided
  • op = insert, remove, change
  • pos/name = position (number) or name of step in predefined chain
  • step = name of step to insert/substitute
• -S, --store [pos/name]: store output for intermediate step (position or name) (can be called multiple times) (-1 or all: store all steps' output)
• -G, --global [opts]: global arguments for submitJobs (use syntax: -G="...")
• -L, --local [pos/name] [opts]: local arguments for submitJobs for a specific step
• -n, --name [name]: base-level name for chain job
• -k, --keep: keep existing tarball(s) for job submission
• -s, --submit: submit chain jdl(s)
• -y, --year [year]: which year to simulate
• -o, --output [dir]: base-level output directory
• -t, --tardir [dir]: xrdcp address for CMSSW tarballs (default: None)
• -c, --checkpoint: enable checkpointing (if a job fails, save output files from previous job in chain)
• -v, --verbose: print verbose output (default: False)
• -h, --help: show this help message and exit

The options with lowercase short flags are related to options for submitJobs.py and createChain.py. Other submitJobs options that should usually be specified using -G include: mode, input dict(s), number of events per job, number of parts, resource requirements such as memory, any additional common arguments.

Example commands

Pythia-only generation:

python runProd.py -P P8 -G="-p -d signals_P8_ex -E 10 -N 1 --cpus 4 --memory 8000" -y 2016 -n chain2016_ -o root://cmseos.fnal.gov//store/user/lpcdarkqcd/SVJ2017/testUL/ -t root://cmseos.fnal.gov//store/user/lpcdarkqcd/SVJ2017/testUL/ -c -s

MadGraph+Pythia generation:

python submitJobs.py -p -d signals_MG_ex -E 10000 -N 1 --memory 4000 --outpre step_GRIDPACK --year 2016 --gridpack -o root://cmseos.fnal.gov//store/user/lpcdarkqcd/SVJ2017/testUL/GRIDPACK -s
[wait for jobs to finish]
python runProd.py -P MG -G="-p -d signals_MG_ex --madgraph -E 10 -N 1 --cpus 4 --memory 8000" -L 0 "-I 10000 --indir /store/user/lpcdarkqcd/SVJ2017/testUL/GRIDPACK --inpre step_GRIDPACK" -y 2016 -n chain2016_ -o root://cmseos.fnal.gov//store/user/lpcdarkqcd/SVJ2017/testUL/ -t root://cmseos.fnal.gov//store/user/lpcdarkqcd/SVJ2017/testUL/ -c -s

Ntuple production

To prepare the file lists (and associated metadata):

python submitJobs.py -y --actualEvents -K auto -d signalsV3_1 -E 1000 -N 100 --indir /store/user/lpcsusyhad/SVJ2017/ProductionV4/2016/MINIAOD --inpre step_MINIAOD --outpre SVJ_2016

Ntuple production uses the TreeMaker repository, which has its own Condor submission instructions. To submit the ntuple jobs:

python submitJobs.py -p -d svj -N 200 --cpus 4 -o root://cmseos.fnal.gov//store/user/lpcsusyhad/SVJ2017/ProductionV4/Ntuples/ --args "redir=root://cmseos.fnal.gov/" -s

N.B. this command uses submitJobs.py from TreeMaker, not from this repository.

cmsDriver commands

These commands are based on the PdmVMcCampaigns twiki, specifically the pages for the RunIISummer20 campaigns. The steps are: LHE-GEN, LHE-GEN-SIM, GEN, GEN-SIM, SIM, DIGI, DIGI-HLT, HLT, RECO, MINIAOD, NANOAOD.

Commands (2016APV):

cmsDriver.py SVJ/Production/python/HadronizerFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_mcRun2_asymptotic_preVFP_v8 --beamspot Realistic25ns13TeV2016Collision --step LHE,GEN --geometry DB:Extended --era Run2_2016_HIPM  --fileout file:step0.root --python_filename python/2016APV/step_LHE-GEN.py --no_exec
cmsDriver.py SVJ/Production/python/HadronizerFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN-SIM --conditions 106X_mcRun2_asymptotic_preVFP_v8 --beamspot Realistic25ns13TeV2016Collision --step LHE,GEN,SIM --geometry DB:Extended --era Run2_2016_HIPM  --fileout file:step0.root --python_filename python/2016APV/step_LHE-GEN-SIM.py --no_exec
cmsDriver.py SVJ/Production/python/EmptyFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_mcRun2_asymptotic_preVFP_v8 --beamspot Realistic25ns13TeV2016Collision --step GEN --geometry DB:Extended --era Run2_2016_HIPM  --fileout file:step0.root --python_filename python/2016APV/step_GEN.py --no_exec
cmsDriver.py SVJ/Production/python/EmptyFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN-SIM --conditions 106X_mcRun2_asymptotic_preVFP_v8 --beamspot Realistic25ns13TeV2016Collision --step GEN,SIM --geometry DB:Extended --era Run2_2016_HIPM  --fileout file:step0.root --python_filename python/2016APV/step_GEN-SIM.py --no_exec
cmsDriver.py step1 --mc --eventcontent RAWSIM --runUnscheduled --datatier GEN-SIM --conditions 106X_mcRun2_asymptotic_preVFP_v8 --beamspot Realistic25ns13TeV2016Collision --step SIM --nThreads 8 --geometry DB:Extended --era Run2_2016_HIPM  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016APV/step_SIM.py --no_exec
cmsDriver.py step1 --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_mcRun2_asymptotic_preVFP_v8 --step DIGI,DATAMIX,L1,DIGI2RAW --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2016_HIPM  --filein file:step-1.root --fileout file:step0.root --pileup_input pileup.root --python_filename python/2016APV/step_DIGI.py --no_exec
cmsDriver.py step1 --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_mcRun2_asymptotic_preVFP_v8 --step DIGI,DATAMIX,L1,DIGI2RAW,HLT:@relval2016 --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2016_HIPM  --filein file:step-1.root --fileout file:step0.root --pileup_input pileup.root --python_filename python/2016APV/step_DIGI-HLT.py --no_exec
cmsDriver.py step1 --mc --eventcontent RAWSIM --outputCommand "keep *_mix_*_*,keep *_genPUProtons_*_*" --datatier GEN-SIM-RAW --inputCommands "keep *","drop *_*_BMTF_*","drop *PixelFEDChannel*_*_*_*" --conditions 80X_mcRun2_asymptotic_2016_TrancheIV_v6 --customise_commands 'process.source.bypassVersionCheck = cms.untracked.bool(True)' --step HLT:25ns15e33_v4 --nThreads 8 --geometry DB:Extended --era Run2_2016  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016APV/step_HLT.py --no_exec
cmsDriver.py step1 --mc --eventcontent AODSIM --runUnscheduled --datatier AODSIM --conditions 106X_mcRun2_asymptotic_preVFP_v8 --step RAW2DIGI,L1Reco,RECO,RECOSIM --nThreads 8 --geometry DB:Extended --era Run2_2016_HIPM  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016APV/step_RECO.py --no_exec
cmsDriver.py step1 --mc --eventcontent MINIAODSIM --runUnscheduled --datatier MINIAODSIM --conditions 106X_mcRun2_asymptotic_preVFP_v8 --step PAT --procModifiers run2_miniAOD_UL --nThreads 8 --geometry DB:Extended --era Run2_2016_HIPM  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016APV/step_MINIAOD.py --no_exec
cmsDriver.py step1 --mc --eventcontent NANOAODSIM --datatier NANOAODSIM --conditions 106X_mcRun2_asymptotic_preVFP_v9 --step NANO --nThreads 8 --era Run2_2016,run2_nanoAOD_106Xv1  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016APV/step_NANOAOD.py --no_exec

Commands (2016):

cmsDriver.py SVJ/Production/python/HadronizerFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_mcRun2_asymptotic_v13 --beamspot Realistic25ns13TeV2016Collision --step LHE,GEN --geometry DB:Extended --era Run2_2016  --fileout file:step0.root --python_filename python/2016/step_LHE-GEN.py --no_exec
cmsDriver.py SVJ/Production/python/HadronizerFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN-SIM --conditions 106X_mcRun2_asymptotic_v13 --beamspot Realistic25ns13TeV2016Collision --step LHE,GEN,SIM --geometry DB:Extended --era Run2_2016  --fileout file:step0.root --python_filename python/2016/step_LHE-GEN-SIM.py --no_exec
cmsDriver.py SVJ/Production/python/EmptyFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_mcRun2_asymptotic_v13 --beamspot Realistic25ns13TeV2016Collision --step GEN --geometry DB:Extended --era Run2_2016  --fileout file:step0.root --python_filename python/2016/step_GEN.py --no_exec
cmsDriver.py SVJ/Production/python/EmptyFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN-SIM --conditions 106X_mcRun2_asymptotic_v13 --beamspot Realistic25ns13TeV2016Collision --step GEN,SIM --geometry DB:Extended --era Run2_2016  --fileout file:step0.root --python_filename python/2016/step_GEN-SIM.py --no_exec
cmsDriver.py step1 --mc --eventcontent RAWSIM --runUnscheduled --datatier GEN-SIM --conditions 106X_mcRun2_asymptotic_v13 --beamspot Realistic25ns13TeV2016Collision --step SIM --nThreads 8 --geometry DB:Extended --era Run2_2016  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016/step_SIM.py --no_exec
cmsDriver.py step1 --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_mcRun2_asymptotic_v13 --step DIGI,DATAMIX,L1,DIGI2RAW --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2016  --filein file:step-1.root --fileout file:step0.root --pileup_input pileup.root --python_filename python/2016/step_DIGI.py --no_exec
cmsDriver.py step1 --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_mcRun2_asymptotic_v13 --step DIGI,DATAMIX,L1,DIGI2RAW,HLT:@relval2016 --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2016  --filein file:step-1.root --fileout file:step0.root --pileup_input pileup.root --python_filename python/2016/step_DIGI-HLT.py --no_exec
cmsDriver.py step1 --mc --eventcontent RAWSIM --outputCommand "keep *_mix_*_*,keep *_genPUProtons_*_*" --datatier GEN-SIM-RAW --inputCommands "keep *","drop *_*_BMTF_*","drop *PixelFEDChannel*_*_*_*" --conditions 80X_mcRun2_asymptotic_2016_TrancheIV_v6 --customise_commands 'process.source.bypassVersionCheck = cms.untracked.bool(True)' --step HLT:25ns15e33_v4 --nThreads 8 --geometry DB:Extended --era Run2_2016  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016/step_HLT.py --no_exec
cmsDriver.py step1 --mc --eventcontent AODSIM --runUnscheduled --datatier AODSIM --conditions 106X_mcRun2_asymptotic_v13 --step RAW2DIGI,L1Reco,RECO,RECOSIM --nThreads 8 --geometry DB:Extended --era Run2_2016  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016/step_RECO.py --no_exec
cmsDriver.py step1 --mc --eventcontent MINIAODSIM --runUnscheduled --datatier MINIAODSIM --conditions 106X_mcRun2_asymptotic_v13 --step PAT --procModifiers run2_miniAOD_UL --nThreads 8 --geometry DB:Extended --era Run2_2016  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016/step_MINIAOD.py --no_exec
cmsDriver.py step1 --mc --eventcontent NANOAODSIM --datatier NANOAODSIM --conditions 106X_mcRun2_asymptotic_v15 --step NANO --nThreads 8 --era Run2_2016,run2_nanoAOD_106Xv1  --filein file:step-1.root --fileout file:step0.root --python_filename python/2016/step_NANOAOD.py --no_exec

Commands (2017):

cmsDriver.py SVJ/Production/python/HadronizerFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step LHE,GEN --geometry DB:Extended --era Run2_2017  --fileout file:step0.root --python_filename python/2017/step_LHE-GEN.py --no_exec
cmsDriver.py SVJ/Production/python/HadronizerFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN-SIM --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step LHE,GEN,SIM --geometry DB:Extended --era Run2_2017  --fileout file:step0.root --python_filename python/2017/step_LHE-GEN-SIM.py --no_exec
cmsDriver.py SVJ/Production/python/EmptyFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step GEN --geometry DB:Extended --era Run2_2017  --fileout file:step0.root --python_filename python/2017/step_GEN.py --no_exec
cmsDriver.py SVJ/Production/python/EmptyFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN-SIM --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step GEN,SIM --geometry DB:Extended --era Run2_2017  --fileout file:step0.root --python_filename python/2017/step_GEN-SIM.py --no_exec
cmsDriver.py step1 --mc --eventcontent RAWSIM --runUnscheduled --datatier GEN-SIM --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step SIM --nThreads 8 --geometry DB:Extended --era Run2_2017  --filein file:step-1.root --fileout file:step0.root --python_filename python/2017/step_SIM.py --no_exec
cmsDriver.py step1 --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_mc2017_realistic_v6 --step DIGI,DATAMIX,L1,DIGI2RAW --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2017  --filein file:step-1.root --fileout file:step0.root --pileup_input pileup.root --python_filename python/2017/step_DIGI.py --no_exec
cmsDriver.py step1 --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_mc2017_realistic_v6 --step DIGI,DATAMIX,L1,DIGI2RAW,HLT:@relval2017 --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2017  --filein file:step-1.root --fileout file:step0.root --pileup_input pileup.root --python_filename python/2017/step_DIGI-HLT.py --no_exec
cmsDriver.py step1 --mc --eventcontent RAWSIM --datatier GEN-SIM-RAW --conditions 94X_mc2017_realistic_v15 --customise_commands 'process.source.bypassVersionCheck = cms.untracked.bool(True)' --step HLT:2e34v40 --nThreads 8 --geometry DB:Extended --era Run2_2017  --filein file:step-1.root --fileout file:step0.root --python_filename python/2017/step_HLT.py --no_exec
cmsDriver.py step1 --mc --eventcontent AODSIM --runUnscheduled --datatier AODSIM --conditions 106X_mc2017_realistic_v6 --step RAW2DIGI,L1Reco,RECO,RECOSIM --nThreads 8 --geometry DB:Extended --era Run2_2017  --filein file:step-1.root --fileout file:step0.root --python_filename python/2017/step_RECO.py --no_exec
cmsDriver.py step1 --mc --eventcontent MINIAODSIM --runUnscheduled --datatier MINIAODSIM --conditions 106X_mc2017_realistic_v9 --step PAT --procModifiers run2_miniAOD_UL --nThreads 8 --geometry DB:Extended --era Run2_2017  --filein file:step-1.root --fileout file:step0.root --python_filename python/2017/step_MINIAOD.py --no_exec
cmsDriver.py step1 --mc --eventcontent NANOAODSIM --datatier NANOAODSIM --conditions 106X_mc2017_realistic_v8 --step NANO --nThreads 8 --era Run2_2017,run2_nanoAOD_106Xv1  --filein file:step-1.root --fileout file:step0.root --python_filename python/2017/step_NANOAOD.py --no_exec

Commands (2018):

cmsDriver.py SVJ/Production/python/HadronizerFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_upgrade2018_realistic_v4 --beamspot Realistic25ns13TeVEarly2018Collision --step LHE,GEN --geometry DB:Extended --era Run2_2018  --fileout file:step0.root --python_filename python/2018/step_LHE-GEN.py --no_exec
cmsDriver.py SVJ/Production/python/HadronizerFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN-SIM --conditions 106X_upgrade2018_realistic_v4 --beamspot Realistic25ns13TeVEarly2018Collision --step LHE,GEN,SIM --geometry DB:Extended --era Run2_2018  --fileout file:step0.root --python_filename python/2018/step_LHE-GEN-SIM.py --no_exec
cmsDriver.py SVJ/Production/python/EmptyFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_upgrade2018_realistic_v4 --beamspot Realistic25ns13TeVEarly2018Collision --step GEN --geometry DB:Extended --era Run2_2018  --fileout file:step0.root --python_filename python/2018/step_GEN.py --no_exec
cmsDriver.py SVJ/Production/python/EmptyFragment_cff.py --mc --eventcontent RAWSIM --datatier GEN-SIM --conditions 106X_upgrade2018_realistic_v4 --beamspot Realistic25ns13TeVEarly2018Collision --step GEN,SIM --geometry DB:Extended --era Run2_2018  --fileout file:step0.root --python_filename python/2018/step_GEN-SIM.py --no_exec
cmsDriver.py step1 --mc --eventcontent RAWSIM --runUnscheduled --datatier GEN-SIM --conditions 106X_upgrade2018_realistic_v11_L1v1 --beamspot Realistic25ns13TeVEarly2018Collision --step SIM --nThreads 8 --geometry DB:Extended --era Run2_2018  --filein file:step-1.root --fileout file:step0.root --python_filename python/2018/step_SIM.py --no_exec
cmsDriver.py step1 --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_upgrade2018_realistic_v11_L1v1 --step DIGI,DATAMIX,L1,DIGI2RAW --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2018  --filein file:step-1.root --fileout file:step0.root --pileup_input pileup.root --python_filename python/2018/step_DIGI.py --no_exec
cmsDriver.py step1 --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_upgrade2018_realistic_v11_L1v1 --step DIGI,DATAMIX,L1,DIGI2RAW,HLT:@relval2018 --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2018  --filein file:step-1.root --fileout file:step0.root --pileup_input pileup.root --python_filename python/2018/step_DIGI-HLT.py --no_exec
cmsDriver.py step1 --mc --eventcontent RAWSIM --datatier GEN-SIM-RAW --conditions 102X_upgrade2018_realistic_v15 --customise_commands 'process.source.bypassVersionCheck = cms.untracked.bool(True)' --step HLT:2018v32 --nThreads 8 --geometry DB:Extended --era Run2_2018  --filein file:step-1.root --fileout file:step0.root --python_filename python/2018/step_HLT.py --no_exec
cmsDriver.py step1 --mc --eventcontent AODSIM --runUnscheduled --datatier AODSIM --conditions 106X_upgrade2018_realistic_v11_L1v1 --step RAW2DIGI,L1Reco,RECO,RECOSIM,EI --nThreads 8 --geometry DB:Extended --era Run2_2018  --filein file:step-1.root --fileout file:step0.root --python_filename python/2018/step_RECO.py --no_exec
cmsDriver.py step1 --mc --eventcontent MINIAODSIM --runUnscheduled --datatier MINIAODSIM --conditions 106X_upgrade2018_realistic_v16_L1v1 --step PAT --procModifiers run2_miniAOD_UL --nThreads 8 --geometry DB:Extended --era Run2_2018  --filein file:step-1.root --fileout file:step0.root --python_filename python/2018/step_MINIAOD.py --no_exec
cmsDriver.py step1 --mc --eventcontent NANOAODSIM --datatier NANOAODSIM --conditions 106X_upgrade2018_realistic_v15_L1v1 --step NANO --nThreads 8 --era Run2_2018,run2_nanoAOD_106Xv1  --filein file:step-1.root --fileout file:step0.root --python_filename python/2018/step_NANOAOD.py --no_exec

Pileup input files

The script picklePileupInput.py can download the premixed pileup input file list, convert it to a Python list and pickle it, and upload it to EOS.

The premixed pileup input file lists in use are:

/Neutrino_E-10_gun/RunIISummer20ULPrePremix-UL16_106X_mcRun2_asymptotic_v13-v1/PREMIX
/Neutrino_E-10_gun/RunIISummer20ULPrePremix-UL17_106X_mc2017_realistic_v6-v3/PREMIX
/Neutrino_E-10_gun/RunIISummer20ULPrePremix-UL18_106X_upgrade2018_realistic_v11_L1v1-v2/PREMIX