4th GraphNeT Workshop: Graph Neural Networks and Beyond

Europe/Berlin
TUM Institute for Advanced Study

TUM Institute for Advanced Study

Lichtenbergstraße 2 a 85748 Garching bei München Germany
Rasmus Ørsøe (TUM)
Description

What is it about?

This is the fourth workshop dedicated to GraphNeT – A deep learning library for neutrino telescopes. The goal is to bring together researchers working at the intersection of neutrino telescope experiments and machine learning to meet likeminded researchers, discuss the latest progress, and develop new solutions to physics challenges by applying deep learning where it matters, using GraphNeT.

This May, we're celebrating the launch of GraphNeT 2.0 which extends functionality beyond graph neural networks into other deep learning paradigms like normalizing flows, transformers, autoencoders and several of the winning solutions from the IceCube Kaggle Competition.

The workshop, and particularly the two half-day hackathons, are focussed on putting the GraphNeT framework into use for physics — in IceCube, P-ONE, KM3NeT and other experiments. In this way, we hope to foster collaboration on common tools in order to advance physics research faster than individual experiments can on their own.

During the workshop, participants will be presented an opportunity to get involved in a joint publication that aims to provide the first-ever apples-to-apples comparison of deep learning techniques from different neutrino telescopes on a series of open-source datasets specfically prepared for this workshop by the team behind open-source simulation tool Prometheus.

Who is it for?

The GraphNeT user community can be broken into two broad categories:

  • a) Users with a high level of deep learning expertise that translate new, novel techniques from deep learning research into solutions within the context of neutrino telescopes.
  • b) Neutrino physicists that are domain experts and require sharper methods to carry out their physics analyses.

Physics analyses often require expert knowledge in both of these categories, but very few people are experts in both. Therefore, a key goal of GraphNeT is to provide a common framework for both types of users and to foster partnerships across these two disciplines and across experiments. The end-goal is to open doors that are currently closed; to turn evidence into discoveries and help find evidence where there currently is none.

While the workshop's presentations can feature most work at the intersection of ML and neutrino telescopes, e.g. new technical developments or physics challenges, hackathon participants ought to have an interest in trying out the GraphNeT code — either because they’re open to using it as their main framework, or because they want to see how other people are working with deep learning.

Where is it held?

The workshop will be held in Munich, the capitol of the German state of Bavaria. Specifically, the workshop activities will take place at the TUM Campus in Garching, slightly north of Munich, at the TUM Institute for Advanced Study (IAS).

There may be some limitations to the workshop's capacity, in which case preference will be given to attendees who fit well in to either of the above categories of GraphNeT users.

 

Funding

The organisers would like to acknowledge the generous support for this workshop, provided by the Munich Data Science Institute (MDSI), SFB1258,  and the ORIGINS Cluster of Excellence.

            

    • 9:00 AM 10:00 AM
      Check-in & Coffee
    • 10:00 AM 12:00 PM
      Talks

      A series of presentations alternating between technical and physics topics.

      • 10:00 AM
        Welcome! 15m
        Speaker: Rasmus Ørsøe (TUM)
      • 10:15 AM
        Machine-Learning Opportunities for the Tau Air-Shower Mountain-Based Observatory 30m

        The detection of high-energy astrophysical neutrinos by IceCube has opened a new window on our Universe. While IceCube has measured the flux of these neutrinos at energies up to several PeV, much remains to be discovered regarding their origin and nature. Currently, measurements are limited by the small sample size of astrophysical neutrinos and by the difficulty of discriminating between electron and tau neutrinos. TAMBO is a next-generation neutrino observatory specifically designed to detect tau neutrinos in the 1-100 PeV energy range, enabling tests of neutrino physics at high energies and the characterization of astrophysical neutrino sources. The observatory will comprise an array of water Cherenkov and plastic scintillator detectors deployed on the face of the Colca Canyon in the Peruvian Andes. This unique geometry will facilitate a high-purity measurement of astrophysical tau neutrino properties. In this talk, I will present the current status of this detector and show potential avenues for machine learning in our simulation and reconstruction chains.

        Speaker: Jeffrey Lazar
      • 10:45 AM
        Coffee Break 15m
      • 11:00 AM
        Machine Learning Methods for the DSNB Search in JUNO 30m

        The diffuse supernova neutrino background (DSNB) describes the constant flux of neutrinos from past core-collapse supernovae over the visible universe.
        The upcoming Jiangmen Underground Neutrino Observatory (JUNO), a 20 kton liquid scintillator detector, plans to observe the DSNB through the inverse beta decay (IBD) detection channel.
        While other electron anti-neutrino sources will cause irreducible IBD background, non-IBD backgrounds such as neutron-induced events and NC interactions of atmospheric neutrinos can mimic the IBD event signature. We plan to reduce this background by machine-learning(ML)-based pulse-shape discrimination (PSD).
        In this talk, we will compare three available ML techniques, feed-forward neural networks, support vector machines, and boosted decision trees, regarding both their achievable performance as well as the information these models provide about their given input parameters.
        This work has been supported by the Clusters of Excellence PRISMA+ and ORIGINS as well as the DFG Collaborative Research Center "NDM" (SFB1258) and the DFG Research Units 2319 and 5519.

        Speaker: Matthias Mayer (TUM)
      • 11:30 AM
        GraphNeT 2.0 30m
        Speaker: Rasmus Ørsøe (TUM)
    • 12:00 PM 1:00 PM
      Lunch Break 1h
    • 1:00 PM 2:00 PM
      Hackathon: Session 1

      A session dedicated to getting hands-on experience in applying applying GraphNeT to current challenges, develop/integrate new techniques, take the first few steps in a joint project, etc.

    • 2:00 PM 2:30 PM
      Coffee Break 30m
    • 2:30 PM 5:00 PM
      Hackathon: Session 2

      A session dedicated to getting hands-on experience in applying applying GraphNeT to current challenges, develop/integrate new techniques, take the first few steps in a joint project, etc.

    • 9:00 AM 9:30 AM
      Coffee & Informal Discussion (Optional)

      Meet and discuss with other participants over a cup of coffee or tea before the program starts!

    • 9:30 AM 10:30 AM
      Talks

      A series of presentations alternating between technical and physics topics.

      • 10:00 AM
        IceCube Event Classification using Graph Neural Networks 30m
        Speaker: Philipp Soldin
    • 10:30 AM 10:45 AM
      Coffee Break 15m
    • 10:45 AM 12:00 PM
      Talks

      A series of presentations alternating between technical and physics topics.

      • 10:45 AM
        Kaggle solutions for direction reconstruction of cascades and tracks in IceCube 30m
        Speaker: Arturo Llorente
      • 11:15 AM
        Invited Talk: Graph Neural Networks in Collider Physics 45m

        Machine learning has revolutionized the analysis of large-scale data samples in high energy physics and greatly increased the discovery potential for new fundamental laws of nature. Specifically, graph neural networks (GNNs), thanks to their high flexibility and expressiveness, have demonstrated superior performance over classical deep learning approaches in tackling data analysis challenges in particle physics. In this talk, I will go through the fundamentals of GNNs, the design of physics-driven GNN architectures, and their applications in solving data analysis challenges in ongoing and planned collider experiments. Prospects and possible future directions will also be discussed.

    • 12:00 PM 1:00 PM
      Lunch Break 1h
    • 1:00 PM 2:30 PM
      Hackathon: Session 3

      A session dedicated to getting hands-on experience in applying applying GraphNeT to current challenges, develop/integrate new techniques, take the first few steps in a joint project, etc.

    • 2:30 PM 3:00 PM
      Coffee Break 30m
    • 3:00 PM 4:30 PM
      Hackathon: Session 4

      A session dedicated to getting hands-on experience in applying applying GraphNeT to current challenges, develop/integrate new techniques, take the first few steps in a joint project, etc.

    • 4:30 PM 6:00 PM
      Talks: Poster Session

      A series of presentations alternating between technical and physics topics.

    • 6:30 PM 8:30 PM
      Social: Workshop Dinner (self-paid) Garchinger Augustiner

      Garchinger Augustiner

      https://www.google.com/maps/place/Garchinger+Augustiner/@48.2497093,11.6541389,15z/data=!4m6!3m5!1s0x479e72fe8a22fbe1:0x43842f42783d5306!8m2!3d48.2502608!4d11.6534068!16s%2Fg%2F11c1vhzzsl?entry=ttu
    • 9:00 AM 9:30 AM
      Coffee & Informal Discussion (Optional)

      Meet and discuss with other participants over a cup of coffee or tea before the program starts!

    • 9:30 AM 10:30 AM
      Talks

      A series of presentations alternating between technical and physics topics.

    • 10:30 AM 10:45 AM
      Coffee Break 15m
    • 10:45 AM 12:00 PM
      Talks

      A series of presentations alternating between technical and physics topics.

      • 10:45 AM
        ORCA6 and ORCA115 event classification and reconstruction 30m

        KM3NeT/ARCA and KM3NeT/ORCA are the new generation of neutrino telescopes located
        in the depths of the Mediterranean Sea. Each comprises a grid of optical sensors that
        capture the Cherenkov light emitted by charged particles produced in neutrino interactions.
        KM3NeT/ARCA, sensitive to interactions with energies ranging from TeV to PeV, focuses on
        cosmic neutrinos, while KM3NeT/ORCA investigates atmospheric neutrino oscillations in the
        GeV energy range.
        Among various approaches, Graph Neural Networks (GNNs) stand out as a promising
        method to reconstruct different observables in neutrino interactions. GraphNeT, a software
        which uses several GNN-based models, have demonstrated competitive performance with
        respect to likelihood-based reconstruction algorithms in IceCube. This contribution will
        provide an overview of the latest developments within the GraphNet software. Introducing a
        new database developed for handling KM3NeT data, we will present preliminary results on
        direction, energy, and position reconstructions, along with topology classification for ORCA6
        and ORCA115.

        Speaker: Jorge González
      • 11:15 AM
        Invited Talk - OmniJet-α: The first cross-task foundation model for particle physics 45m

        Foundation models are multi-dataset and multi-task machine learning methods that
        once pre-trained can be fine-tuned for a large variety of downstream applications.
        We introduce OmniJet-α, a Transformer-based model designed for tokenized
        particle jets, showcasing notable advancements on two fronts.
        Firstly, our work shows extensive studies on the encoding (tokenization) quality of
        our tokenized particle jets.
        Secondly, we demonstrate the first successful transfer learning between
        unsupervised jet generation and supervised jet tagging, marking a
        significant advancement in building foundation models for particle physics.

        Speaker: Mr Joschka Birk (University of Hamburg)
    • 12:00 PM 1:00 PM
      Lunch Break 1h
    • 1:00 PM 2:30 PM
      Hackathon: Session 5

      A session dedicated to getting hands-on experience in applying applying GraphNeT to current challenges, develop/integrate new techniques, take the first few steps in a joint project, etc.

    • 2:30 PM 3:00 PM
      Coffee Break 30m
    • 3:00 PM 5:00 PM
      Hackathon: Session 6

      A session dedicated to getting hands-on experience in applying applying GraphNeT to current challenges, develop/integrate new techniques, take the first few steps in a joint project, etc.

    • 9:00 AM 9:30 AM
      Coffee & Informal Discussion (Optional)

      Meet and discuss with other participants over a cup of coffee or tea before the program starts!

    • 9:30 AM 10:30 AM
      Talks

      A series of presentations alternating between technical and physics topics.

      • 9:30 AM
        Reconstruction in MAGIC / CTA 30m
        Speaker: Jarred Green (MPP)
      • 10:00 AM
        End-to-End Optimized Summary Statistic in IceCube's Diffuse Analysis 30m

        The analysis of the diffuse neutrino flux with IceCube is usually done using forward-folding binned likelihood fits. The data is binned using energy and angular information. This binning scheme can be improved by employing a neural network optimized summary statistic. For each event, the network predicts a 1D summary statistic which is then binned for the likelihood fit. The network is optimized in such a way that the uncertainties of the fitted signal parameters are improved. In addition to the information utilized in the standard binning, more data can be incorporated as input to the neural network, potentially further enhancing the analysis.
        This talk will focus on the implementation of this method for a toy example and the current status of implementing it in the standard analysis framework for diffuse analysis in IceCube.

        Speaker: Oliver Janik
    • 10:30 AM 11:00 AM
      Coffee Break 30m
    • 11:00 AM 12:00 PM
      Talks

      A series of presentations alternating between technical and physics topics.

      • 11:00 AM
        Ideas for GraphNeT aided physics analyses 30m

        GraphNeT opens up for a host of physics analysis and calibration opportunities to be explored. This talk will try to give an overview of some of the ideas that have been discussed, attempted, and carried out, with a subsequent discussion of the gains, challenges, drawbacks, and results. Three of the main ideas are: Data-MC Calibration, improved Self-Veto, and a GraphNeT neutrino selection applied at Level2 on Data.

        Speaker: Troels Petersen
      • 11:30 AM
        Application of GraphNeT to Dark Matter Search in SNO+ 30m
        Speaker: Luo Meng
    • 12:00 PM 1:00 PM
      Lunch Break 1h
    • 1:00 PM 2:30 PM
      Hackathon

      A session dedicated to getting hands-on experience in applying applying GraphNeT to current challenges, develop/integrate new techniques, take the first few steps in a joint project, etc.

    • 2:30 PM 3:00 PM
      Workshop Summary & Goodbye!
    • 3:15 PM 5:15 PM
      Social: Optional Excursion - A visit to European Space Observatory Exhibition