taolicheng / ML4LHC

Tutorial for the basic workflow of practicing machine learning in the LHC physics

ML4LHC-Tutorial

Data Preparation

• MadGraph: event generation. A summer school reference slides: https://indico.ihep.ac.cn/event/7822/contribution/19/material/slides/0.pdf

• Pythia: parton shower -- numpythia: The interface between PYTHIA and NumPy

• Delphes: fast detector simulation

  • Run Delphes without Pythia : instructions here

• FastJet: jet clustering -- PyJet: The interface between FastJet and NumPy

• Instructions on generating events on a cluster with pbs scheduler: [Running MadGraph on the cluster]

Public Datasets

• CMS Open Data

Data Analysis

• Framework: ROOT

  • c++: with ExRootAnalysis https://cp3.irmp.ucl.ac.be/projects/ExRootAnalysis/wiki/UserManual
  • Python: PyROOT Tutorial. And here is an example for PyROOT

• HSF

  • Reweighting: https://hsf-training.github.io/analysis-essentials/advanced-python/7DemoReweighting.html

Data Fromatting and Transformation

• root2hdf5: convert root TTrees into HDF5 tables.
• uproot (https://indico.cern.ch/event/686641/contributions/2894906/attachments/1606247/2548596/pivarski-uproot.pdf) /root_numpy
• h5py to create hdf5 files more "machine learning-friendly" than .root file

Deep Learning

• Deep Learning Course repository of Gilles Louppe: https://github.com/glouppe/info8010-deep-learning
• Introduction and basic workflow of DL4HEP: https://github.com/stwunsch/iml_tensorflow_keras_workshop

---

Exercises

Dataset

[to be setup. candidate: zenodo]

Playground

• Basic data generation and analysis: [Exercise01]
• advanced: tt~ generation
• Jet clustering
• Produce standard h5 files

---

Cluster Tips

• Basic usage
• Easily use jupyter notebook on a cluster: https://josephpcohen.com/w/jupyter-notebook-and-hpc-systems/

---

References

• Scikit-HEP: a toolset of Python packages for particle physics.
• A high-bias, low-variance introduction to Machine Learning for physicists, https://arxiv.org/abs/1803.08823