Modern machine learning techniques, including deep learning, is rapidly being applied, adapted, and developed for high energy physics. The goal of this document is to provide a nearly comprehensive list of citations for those developing and applying these approaches to experimental, phenomenological, or theoretical analyses. As a living document, it will be updated as often as possible to incorporate the latest developments. A list of proper (unchanging) reviews can be found within. Papers are grouped into a small set of topics to be as useful as possible. Suggestions are most welcome.
The purpose of this note is to collect references for modern machine learning as applied to particle physics. A minimal number of categories is chosen in order to be as useful as possible. Note that papers may be referenced in more than one category. The fact that a paper is listed in this document does not endorse or validate its content - that is for the community (and for peer-review) to decide. Furthermore, the classification here is a best attempt and may have flaws - please let us know if (a) we have missed a paper you think should be included, (b) a paper has been misclassified, or (c) a citation for a paper is not correct or if the journal information is now available. In order to be as useful as possible, this document will continue to evolve so please check back before you write your next paper. If you find this review helpful, please consider citing it using \cite{hepmllivingreview} in HEPML.bib.
Reviews
Modern reviews
Specialized reviews
Classical papers
Datasets
Classification
Parameterized classifiers
Approximating Likelihood Ratios with Calibrated Discriminative Classifiers
E Pluribus Unum Ex Machina: Learning from Many Collider Events at Once
Jet images
Event images
Sequences
Trees
Graphs
Sets (point clouds)
Physics-inspired basis
$W/Z$ tagging
$H\rightarrow b\bar{b$}
quarks and gluons
top quark tagging
strange jets
$b$-tagging
Flavor physics
BSM particles and models
Particle identification
Neutrino Detectors
Direct Dark Matter Detectors
Cosmology, Astro Particle, and Cosmic Ray physics
Tracking
Heavy Ions / Nuclear Physics
Hyperparameters
Weak/Semi supervision
Unsupervised
Reinforcement Learning
Quantum Machine Learning
Feature ranking
Attention
Regularization
Software
Hardware/firmware
Deployment
Regression
Pileup
Calibration
Recasting
Matrix elements
Parameter estimation
Parton Distribution Functions (and related)
Lattice Gauge Theory
Function Approximation
Symbolic Regression
Decorrelation methods.
Generative models / density estimation
GANs:
Autoencoders
Normalizing flows
Physics-inspired
Mixture Models
Phase space generation
Gaussian processes
Anomaly detection.
Simulation-based (`likelihood-free') Inference
Parameter estimation
Unfolding
Domain adaptation
BSM
Uncertainty Quantification
Interpretability
Estimation
Mitigation
Uncertainty- and inference-aware learning
Experimental results. This section is incomplete as there are many results that directly and indirectly (e.g. via flavor tagging) use modern machine learning techniques. We will try to highlight experimental results that use deep learning in a critical way for the final analysis sensitivity.
Final analysis discriminate for searches
Measurements using deep learning directly (not through object reconstruction)