Development of systematic uncertainty-aware neural network trainings for binned-likelihood analyses at the LHC

CMS Collaboration; Chekhovsky, V.; Hayrapetyan, A.; Makarenko, V.; Tumasyan, A.; Adam, W.; Andrejkovic, J. W.; Benato, L.; Bergauer, T.; Chatterjee, S.; Damanakis, K.; Dragicevic, M.; Hussain, P. S.; Jeitler, M.; Krammer, N.; Li, A.; Liko, D.; Mikulec, I.; Schieck, J.; Schöfbeck, R.; Schwarz, D.; Sonawane, M.; Waltenberger, W.; Wulz, C.-E.; Janssen, T.; Kwon, H.; Van Laer, T.; Van Mechelen, P.; Breugelmans, N.; D'Hondt, J.; Dansana, S.; De Moor, A.; Delcourt, M.; Heyen, F.; Hong, Y.; Lowette, S.; Makarenko, I.; Müller, D.; Tavernier, S.; Tytgat, M.; Van Onsem, G. P.; Van Putte, S.; Vannerom, D.; Bilin, B.; Clerbaux, B.; Das, A. K.; De Bruyn, I.; De Lentdecker, G.; Evard, H.; Favart, L.; Gianneios, P.; Khalilzadeh, A.; Khan, F. A.; Lee, K.; Malara, A.; Shahzad, M. A.; Thomas, L.; Vanden Bemden, M.; Vander Velde, C.; Vanlaer, P.; De Coen, M.; Dobur, D.; Gokbulut, G.; Knolle, J.; Lambrecht, L.; Marckx, D.; Skovpen, K.; Van Den Bossche, N.; van der Linden, J.; Vandenbroeck, J.; Wezenbeek, L.; Bein, S.; Benecke, A.; Bethani, A.; Bruno, G.; Caputo, C.; De Favereau De Jeneret, J.; Delaere, C.; Donertas, I. S.; Giammanco, A.; Guzel, A. O.; Jain, S a.; Lemaitre, V.; Lidrych, J.; Mastrapasqua, P.; Tran, T. T.; Turkcapar, S.; Alves, G. A.; Coelho, E.; Correia Silva, G.; Hensel, C.; Menezes De Oliveira, T.; Mora Herrera, C.; Rebello Teles, P.; Soeiro, M.; Tonelli Manganote, E. J.; Vilela Pereira, A.; Aldá Júnior, W. L.; Barroso Ferreira Filho, M.; Brandao Malbouisson, H.; Carvalho, W.; Chinellato, J.; Da Costa, E. M.; Da Silveira, G. G.; De Jesus Damiao, D.; Fonseca De Souza, S.; De Souza, R. Gomes; Laux Kuhn, T.; Macedo, M.; Martins, J.; Mota Amarilo, K.; Mundim, L.; Nogima, H.; Pinheiro, J. P.; Santoro, A.; Sznajder, A.; Thiel, M.; Bernardes, C. A.; Calligaris, L.; Fernandez Perez Tomei, T. R.; Gregores, E. M.; Maietto Silverio, I.; Mercadante, P. G.; Novaes, S. F.; Orzari, B.; Padula, Sandra S.; Scheurer, V.; Aleksandrov, A.; Antchev, G.; Hadjiiska, R.; Iaydjiev, P.; Misheva, M.; Shopova, M.; Sultanov, G.; Dimitrov, A.; Litov, L.; Pavlov, B.; Petkov, P.; Petrov, A.; Shumka, E.; Keshri, S.; Laroze, D.; Thakur, S.; Cheng, T.; Javaid, T.; Yuan, L.; Hu, Z.; Liang, Z.; Liu, J.; Chen, G. M.; Chen, H. S.; Chen, M.; Iemmi, F.; Jiang, C. H.; Kapoor, A.; Liao, H.; Liu, Z.-A.; Sharma, R.; Song, J. N.; Tao, J.; Wang, C.; Wang, J.; Wang, Z.; Zhang, H.; Zhao, J.; Agapitos, A.; Ban, Y.; Carvalho Antunes De Oliveira, A.; Deng, S.; Guo, B.; Jiang, C.; Levin, A.; Li, C.; Li, Q.; Mao, Y.; Qian, S.; Qian, S. J.; Qin, X.; Sun, X.; Wang, D.; Yang, H.; Zhao, Y.; Zhou, C.; Yang, S.; You, Z.; Jaffel, K.; Lu, N.; Bauer, G.; Li, B.; Wang, H.; Yi, K.; Zhang, J.; Li, Y.; Lin, Z.; Lu, C.; Xiao, M.; Avila, C.; Barbosa Trujillo, D. A.; Cabrera, A.; Florez, C.; Fraga, J.; Reyes Vega, J. A.; Jaramillo, J.; Rendón, C.; Rodriguez, M.; Ruales Barbosa, A. A.; Ruiz Alvarez, J. D.; Giljanovic, D.; Godinovic, N.; Lelas, D.; Sculac, A.; Kovac, M.; Petkovic, A.; Sculac, T.; Bargassa, P.; Brigljevic, V.; Chitroda, B. K.; Ferencek, D.; Jakovcic, K.; Starodumov, A.; Susa, T.; Attikis, A.; Christoforou, K.; Hadjiagapiou, A.; Leonidou, C.; Mousa, J.; Nicolaou, C.; Paizanos, L.; Ptochos, F.; Razis, P. A.; Rykaczewski, H.; Saka, H.; Stepennov, A.; Finger, M.; Finger, M.; Kveton, A.; Ayala, E.; Carrera Jarrin, E.; Abdalla, H.; Assran, Y.; El-mahdy, B.; Abdullah Al-Mashad, M.; Mahmoud, M. A.; Ehataht, K.; Kadastik, M.; Lange, T.; Nielsen, C.; Pata, J.; Raidal, M.; Tani, L.; Veelken, C.; Osterberg, K.; Voutilainen, M.; Bin Norjoharuddeen, N.; Brücken, E.; Garcia, F.; Inkaew, P.; Kallonen, K. T. S.; Lampén, T.; Lassila-Perini, K.; Lehti, S.; Lindén, T.; Myllymäki, M.; Rantanen, M. m.; Tuominiemi, J.; Kirschenmann, H.; Luukka, P.; Petrow, H.; Besancon, M.; Couderc, F.; Dejardin, M.; Denegri, D.; Faure, J. L.; Ferri, F.; Ganjour, S.; Gras, P.; Hamel de Monchenault, G.; Kumar, M.; Lohezic, V.; Malcles, J.; Orlandi, F.; Portales, L.; Rosowsky, A.; Sahin, M. Ö.; Savoy-Navarro, A.; Simkina, P.; Titov, M.; Tornago, M.; Beaudette, F.; Boldrini, G.; Busson, P.; Cappati, A.; Charlot, C.; Chiusi, M.; Cuisset, T. D.; Damas, F.; Davignon, O.; De Wit, A.; Ehle, I. T.; Fontana Santos Alves, B. A.; Ghosh, S.; Gilbert, A.; Granier de Cassagnac, R.; Hakimi, A.; Harikrishnan, B.; Kalipoliti, L.; Liu, G.; Nguyen, M.; Obraztsov, S.; Ochando, C.; Salerno, R.; Sauvan, J. B.; Sirois, Y.; Sokmen, G.; Urda Gómez, L.; Vernazza, E.; Zabi, A.; Zghiche, A.; Agram, J.-L.; Andrea, J.; Apparu, D.; Bloch, D.; Brom, J.-M.; Chabert, E. C.; Collard, C.; Falke, S.; Goerlach, U.; Haeberle, R.; Le Bihan, A.-C.; Meena, M.; Poncet, O.; Saha, G.; Sessini, M. A.; Van Hove, P.; Vaucelle, P.; Di Florio, A.; Amram, D.; Beauceron, S.; Blancon, B.; Boudoul, G.; Chanon, N.; Contardo, D.; Depasse, P.; Dozen, C.; El Mamouni, H.; Fay, J.; Gascon, S.; Gouzevitch, M.; Greenberg, C.; Grenier, G.; Ille, B.; Jourd'huy, E.; Laktineh, I. B.; Lethuillier, M.; Mirabito, L.; Perries, S.; Purohit, A.; Vander Donckt, M.; Verdier, P.; Xiao, J.; Adamov, G.; Lomidze, I.; Tsamalaidze, Z.; Botta, V.; Consuegra Rodríguez, S.; Feld, L.; Klein, K.; Lipinski, M.; Meuser, D.; Pauls, A.; Pérez Adán, D.; Röwert, N.; Teroerde, M.; Diekmann, S.; Dodonova, A.; Eich, N.; Eliseev, D.; Engelke, F.; Erdmann, J.; Erdmann, M.; Fischer, B.; Hebbeker, T.; Hoepfner, K.; Ivone, F.; Jung, A.; Lee, M. y.; Mausolf, F.; Merschmeyer, M.; Meyer, A.; Mukherjee, S.; Noll, D.; Nowotny, F.; Pozdnyakov, A.; Rath, Y.; Redjeb, W.; Rehm, F.; Reithler, H.; Sarkisovi, V.; Schmidt, A.; Seth, C.; Sharma, A.; Spah, J. L.; Torres Da Silva De Araujo, F.; Wiedenbeck, S.; Zaleski, S.; Dziwok, C.; Flügge, G.; Kress, T.; Nowack, A.; Pooth, O.; Stahl, A.; Ziemons, T.; Zotz, A.; Aarup Petersen, H.; Aldaya Martin, M.; Alimena, J.; Amoroso, S.; An, Y.; Bach, J.; Baxter, S.; Bayatmakou, M.; Becerril Gonzalez, H.; Behnke, O.; Belvedere, A.; Blekman, F.; Borras, K.; Campbell, A.; Cardini, A.; Colombina, F.; De Silva, M.; Eckerlin, G.; Eckstein, D.; Estevez Banos, L. I.; Gallo, E.; Geiser, A.; Guglielmi, V.; Guthoff, M.; Hinzmann, A.; Jeppe, L.; Kaech, B.; Kasemann, M.; Kleinwort, C.; Kogler, R.; Komm, M.; Krücker, D.; Lange, W.; Leyva Pernia, D.; Lipka, K.; Lohmann, W.; Lorkowski, F.; Mankel, R.; Melzer-Pellmann, I.-A.; Mendizabal Morentin, M.; Meyer, A. B.; Milella, G.; Moral Figueroa, K.; Mussgiller, A.; Nair, L. P.; Niedziela, J.; Nürnberg, A.; Park, J.; Ranken, E.; Raspereza, A.; Rastorguev, D.; Rübenach, J.; Rygaard, L.; Scham, M.; Schnake, S.; Schütze, P.; Schwanenberger, C.; Selivanova, D.; Sharko, K.; Shchedrolosiev, M.; Stafford, D.; Vazzoler, F.; Ventura Barroso, A.; Walsh, R.; Wang, D.; Wang, Q.; Wichmann, K.; Wiens, L.; Wissing, C.; Yang, Y.; Zakharov, S.; Zimermmane Castro Santos, A.; Albrecht, A.; Albrecht, S.; Antonello, M.; Bollweg, S.; Bonanomi, M.; Connor, P.; El Morabit, K.; Fischer, Y.; Garutti, E.; Grohsjean, A.; Haller, J.; Hundhausen, D.; Jabusch, H. R.; Kasieczka, G.; Keicher, P.; Klanner, R.; Korcari, W.; Kramer, T.; Kuo, C. c.; Kutzner, V.; Labe, F.; Lange, J.; Lobanov, A.; Matthies, C.; Moureaux, L.; Mrowietz, M.; Nigamova, A.; Nissan, Y.; Paasch, A.; Pena Rodriguez, K. J.; Quadfasel, T.; Raciti, B.; Rieger, M.; Savoiu, D.; Schindler, J.; Schleper, P.; Schröder, M.; Schwandt, J.; Sommerhalder, M.; Stadie, H.; Steinbrück, G.; Tews, A.; Wiederspan, B.; Wolf, M.; Brommer, S.; Butz, E.; Chwalek, T.; Dierlamm, A.; Dincer, G. G.; Elicabuk, U.; Faltermann, N.; Giffels, M.; Gottmann, A.; Hartmann, F.; Hofsaess, R.; Horzela, M.; Husemann, U.; Kieseler, J.; Klute, M.; Lavoryk, O.; Lawhorn, J. M.; Link, M.; Lintuluoto, A.; Maier, S.; Mitra, S.; Monsch, A. A.; Mormile, M.; Müller, T h.; Neukum, M.; Oh, M.; Pfeffer, E.; Presilla, M.; Quast, G.; Rabbertz, K.; Regnery, B.; Schmieder, R.; Shadskiy, N.; Shvetsov, I.; Simonis, H. J.; Sowa, L.; Stockmeier, L.; Tauqeer, K.; Toms, M.; Topko, B.; Trevisani, N.; Voigtländer, T.; Von Cube, R. F.; Von Den Driesch, J.; Wassmer, M.; Wieland, S.; Wittig, F.; Wolf, R.; Zuo, X.; Anagnostou, G.; Daskalakis, G.; Kyriakis, A.; Papadopoulos, A.; Stakia, A.; Melachroinos, G.; Painesis, Z.; Paraskevas, I.; Saoulidou, N.; Theofilatos, K.; Tziaferi, E.; Vellidis, K.; Zisopoulos, I.; Bakas, G.; Chatzistavrou, T.; Karapostoli, G.; Kousouris, K.; Papakrivopoulos, I.; Siamarkou, E.; Tsipolitis, G.; Zacharopoulou, A.; Bestintzanos, I.; Evangelou, I.; Foudas, C.; Kamtsikis, C.; Katsoulis, P.; Kokkas, P.; Kosmoglou Kioseoglou, P. G.; Manthos, N.; Papadopoulos, I.; Strologas, J.; Hajdu, C.; Horvath, D.; Márton, K.; Rádl, A. J.; Sikler, F.; Veszpremi, V.; Csanád, M.; Farkas, K.; Fehérkuti, A.; Gadallah, M. M. A.; Kadlecsik, Á.; Major, P.; Pásztor, G.; Veres, G. I.; Ujvari, B.; Zilizi, G.; Bencze, G.; Czellar, S.; Molnar, J.; Szillasi, Z.; Csorgo, T.; Nemes, F.; Novak, T.; Bansal, S.; Beri, S. B.; Bhatnagar, V.; Chaudhary, G.; Chauhan, S.; Dhingra, N.; Kaur, A.; Kaur, A.; Kaur, H.; Kaur, M.; Kumar, S.; Sheokand, T.; Singh, J. B.; Singla, A.; Bhardwaj, A.; Chhetri, A.; Choudhary, B. C.; Kumar, A.; Kumar, A.; Naimuddin, M.; Ranjan, K.; Saini, M. K.; Saumya, S.; Baradia, S.; Barman, S.; Bhattacharya, S.; Das Gupta, S.; Dutta, S.; Dutta, S.; Sarkar, S.; Ameen, M. M.; Behera, P. K.; Behera, S. C.; Chatterjee, S.; Dash, G.; Jana, P.; Kalbhor, P.; Kamble, S.; Komaragiri, J. R.; Kumar, D.; Mishra, T.; Parida, B.; Pujahari, P. R.; Saha, N. R.; Sharma, A.; Sikdar, A. K.; Singh, R. K.; Verma, P.; Verma, S.; Vijay, A.; Dugad, S.; Mohanty, G. B.; Shelake, M.; Suryadevara, P.; Bala, A.; Banerjee, S.; Bhowmik, S.; Chatterjee, R. M.; Guchait, M.; Jain, S h.; Jaiswal, A.; Joshi, B. M.; Kumar, S.; Majumder, G.; Mazumdar, K.; Parolia, S.; Thachayath, A.; Bahinipati, S.; Kar, C.; Maity, D.; Mal, P.; Naskar, K.; Nayak, A.; Nayak, S.; Pal, K.; Sadangi, P.; Swain, S. K.; Varghese, S.; Vats, D.; Acharya, S.; Alpana, A.; Dube, S.; Gomber, B.; Hazarika, P.; Kansal, B.; Laha, A.; Sahu, B.; Sharma, S.; Vaish, K. Y.; Bakhshiansohi, H.; Jafari, A.; Zeinali, M.; Bashiri, S.; Chenarani, S.; Etesami, S. M.; Hosseini, Y.; Khakzad, M.; Khazaie, E.; Mohammadi Najafabadi, M.; Tizchang, S.; Felcini, M.; Grunewald, M.; Abbrescia, M.; Colaleo, A.; Creanza, D.; D'Anzi, B.; De Filippis, N.; De Palma, M.; Elmetenawee, W.; Ferrara, N.; Fiore, L.; Iaselli, G.; Longo, L.; Louka, M.; Maggi, G.; Maggi, M.; Margjeka, I.; Mastrapasqua, V.; My, S.; Nuzzo, S.; Pellecchia, A.; Pompili, A.; Pugliese, G.; Radogna, R.; Ramos, D.; Ranieri, A.; Silvestris, L.; Simone, F. M.; Sözbilir, Ü.; Stamerra, A.; Troiano, D.; Venditti, R.; Verwilligen, P.; Zaza, A.; Abbiendi, G.; Battilana, C.; Bonacorsi, D.; Capiluppi, P.; Castro, A.; Cavallo, F. R.; Cuffiani, M.; Dallavalle, G. M.; Diotalevi, T.; Fabbri, F.; Fanfani, A.; Fasanella, D.; Giacomelli, P.; Giommi, L.; Grandi, C.; Guiducci, L.; Lo Meo, S.; Lorusso, M.; Lunerti, L.; Marcellini, S.; Masetti, G.; Navarria, F. L.; Paggi, G.; Perrotta, A.; Primavera, F.; Rossi, A. M.; Rossi Tisbeni, S.; Rovelli, T.; Siroli, G. P.; Costa, S.; Di Mattia, A.; Lapertosa, A.; Potenza, R.; Tricomi, A.; Assiouras, P.; Barbagli, G.; Bardelli, G.; Camaiani, B.; Cassese, A.; Ceccarelli, R.; Ciulli, V.; Civinini, C.; D'Alessandro, R.; Focardi, E.; Kello, T.; Latino, G.; Lenzi, P.; Lizzo, M.; Meschini, M.; Paoletti, S.; Papanastassiou, A.; Sguazzoni, G.; Viliani, L.; Benussi, L.; Bianco, S.; Meola, S.; Piccolo, D.; Alves Gallo Pereira, M.; Ferro, F.; Robutti, E.; Tosi, S.; Benaglia, A.; Brivio, F.; Cetorelli, F.; De Guio, F.; Dinardo, M. E.; Dini, P.; Gennai, S.; Gerosa, R.; Ghezzi, A.; Govoni, P.; Guzzi, L.; Lavizzari, G.; Lucchini, M. T.; Malberti, M.; Malvezzi, S.; Massironi, A.; Menasce, D.; Moroni, L.; Paganoni, M.; Palluotto, S.; Pedrini, D.; Perego, A.; Pinolini, B. S.; Pizzati, G.; Ragazzi, S.; Tabarelli de Fatis, T.; Buontempo, S.; Cagnotta, A.; Carnevali, F.; Cavallo, N.; Fabozzi, F.; Iorio, A. O. M.; Lista, L.; Paolucci, P.; Rossi, B.; Ardino, R.; Azzi, P.; Bacchetta, N.; Bisello, D.; Bortignon, P.; Bortolato, G.; Bulla, A. C. M.; Checchia, P.; Dorigo, T.; Gasparini, F.; Gasparini, U.; Giorgetti, S.; Gulmini, M.; Lusiani, E.; Margoni, M.; Meneguzzo, A. T.; Migliorini, M.; Pazzini, J.; Ronchese, P.; Rossin, R.; Simonetto, F.; Tosi, M.; Triossi, A.; Ventura, S.; Zanetti, M.; Zotto, P.; Zucchetta, A.; Zumerle, G.; Braghieri, A.; Calzaferri, S.; Fiorina, D.; Montagna, P.; Re, V.; Riccardi, C.; Salvini, P.; Vai, I.; Vitulo, P.; Ajmal, S.; Ascioti, M. E.; Bilei, G. M.; Carrivale, C.; Ciangottini, D.; Fanò, L.; Mariani, V.; Menichelli, M.; Moscatelli, F.; Rossi, A.; Santocchia, A.; Spiga, D.; Tedeschi, T.; Aimè, C.; Alexe, C. A.; Asenov, P.; Azzurri, P.; Bagliesi, G.; Bhattacharya, R.; Bianchini, L.; Boccali, T.; Bossini, E.; Bruschini, D.; Castaldi, R.; Ciocci, M. A.; Cipriani, M.; D'Amante, V.; Dell'Orso, R.; Donato, S.; Giassi, A.; Ligabue, F.; Marini, A. C.; Matos Figueiredo, D.; Messineo, A.; Mishra, S.; Muraleedharan Nair Bindhu, V. K.; Musich, M.; Nandan, S.; Palla, F.; Rizzi, A.; Rolandi, G.; Roy Chowdhury, S.; Sarkar, T.; Scribano, A.; Spagnolo, P.; Tenchini, R.; Tonelli, G.; Turini, N.; Vaselli, F.; Venturi, A.; Verdini, P. G.; Barria, P.; Basile, C.; Cavallari, F.; Cunqueiro Mendez, L.; Del Re, D.; Di Marco, E.; Diemoz, M.; Errico, F.; Gargiulo, R.; Longo, E.; Martikainen, L.; Mijuskovic, J.; Organtini, G.; Pandolfi, F.; Paramatti, R.; Quaranta, C.; Rahatlou, S.; Rovelli, C.; Santanastasio, F.; Soffi, L.; Vladimirov, V.; Amapane, N.; Arcidiacono, R.; Argiro, S.; Arneodo, M.; Bartosik, N.; Bellan, R.; Biino, C.; Borca, C.; Cartiglia, N.; Costa, M.; Covarelli, R.; Demaria, N.; Finco, L.; Grippo, M.; Kiani, B.; Legger, F.; Luongo, F.; Mariotti, C.; Markovic, L.; Maselli, S.; Mecca, A.; Menzio, L.; Meridiani, P.; Migliore, E.; Monteno, M.; Mulargia, R.; Obertino, M. M.; Ortona, G.; Pacher, L.; Pastrone, N.; Pelliccioni, M.; Ruspa, M.; Siviero, F.; Sola, V.; Solano, A.; Staiano, A.; Tarricone, C.; Trocino, D.; Umoret, G.; White, R.; Babbar, J.; Belforte, S.; Candelise, V.; Casarsa, M.; Cossutti, F.; De Leo, K.; Della Ricca, G.; Dogra, S.; Hong, J.; Kim, J.; Lee, D.; Lee, H.; Lee, S. W.; Moon, C. S.; Oh, Y. D.; Ryu, M. S.; Sekmen, S.; Tae, B.; Yang, Y. C.; Kim, M. S.; Bak, G.; Gwak, P.; Kim, H.; Moon, D. H.; Asilar, E.; Choi, J.; Kim, D.; Kim, T. J.; Merlin, J. A.; Ryou, Y.; Choi, S.; Han, S.; Hong, B.; Lee, K.; Lee, K. S.; Lee, S.; Yoo, J.; Goh, J.; Yang, S.; Kang, Y.; Kim, H. S.; Kim, Y.; Lee, S.; Almond, J.; Bhyun, J. H.; Choi, J.; Choi, J.; Jun, W.; Kim, J.; Kim, Y. W.; Ko, S.; Lee, H.; Lee, J.; Lee, J.; Oh, B. H.; Oh, S. B.; Seo, H.; Yang, U. K.; Yoon, I.; Jang, W.; Kang, D. Y.; Kim, S.; Ko, B.; Lee, J. S. H.; Lee, Y.; Park, I. C.; Roh, Y.; Watson, I. J.; Ha, S.; Hwang, K.; Kim, B.; Yoo, H. D.; Choi, M.; Kim, M. R.; Lee, H.; Lee, Y.; Yu, I.; Beyrouthy, T.; Gharbia, Y.; Alazemi, F.; Dreimanis, K.; Gaile, A.; Munoz Diaz, C.; Osite, D.; Pikurs, G.; Potrebko, A.; Seidel, M.; Sidiropoulos Kontos, D.; Strautnieks, N. R.; Ambrozas, M.; Juodagalvis, A.; Rinkevicius, A.; Tamulaitis, G.; Yusuff, I.; Zolkapli, Z.; Benitez, J. F.; Castaneda Hernandez, A.; Encinas Acosta, H. A.; Gallegos Marí nez, L. G.; León Coello, M.; Murillo Quijada, J. A.; Sehrawat, A.; Valencia Palomo, L.; Ayala, G.; Castilla-Valdez, H.; Crotte Ledesma, H.; De La Cruz-Burelo, E.; Heredia-De La Cruz, I.; Lopez-Fernandez, R.; Mejia Guisao, J.; Mondragon Herrera, C. A.; Sánchez Hernández, A.; Oropeza Barrera, C.; Ramirez Guadarrama, D. L.; Ramírez García, M.; Bautista, I.; Neri Huerta, F. E.; Pedraza, I.; Salazar Ibarguen, H. A.; Uribe Estrada, C.; Bubanja, I.; Raicevic, N.; Butler, P. H.; Ahmad, A.; Asghar, M. I.; Awais, A.; Awan, M. I. M.; Hoorani, H. R.; Khan, W. A.; Avati, V.; Bellora, A.; Forthomme, L.; Grzanka, L.; Malawski, M.; Piotrzkowski, K.; Bialkowska, H.; Bluj, M.; Górski, M.; Kazana, M.; Szleper, M.; Zalewski, P.; Bunkowski, K.; Doroba, K.; Kalinowski, A.; Konecki, M.; Krolikowski, J.; Muhammad, A.; Fokow, P.; Pozniak, K.; Zabolotny, W.; Araujo, M.; Bastos, D.; Beirão Da Cruz E Silva, C.; Boletti, A.; Bozzo, M.; Camporesi, T.; Da Molin, G.; Faccioli, P.; Gallinaro, M.; Hollar, J.; Leonardo, N.; Marozzo, G. B.; Petrilli, A.; Pisano, M.; Seixas, J.; Varela, J.; Wulff, J. W.; Adzic, P.; Milenovic, P.; Devetak, D.; Dordevic, M.; Milosevic, J.; Nadderd, L.; Rekovic, V.; Stojanovic, M.; Alcaraz Maestre, J.; Bedoya, Cristina F.; Brochero Cifuentes, J. A.; Carretero, Oliver M.; Cepeda, M.; Cerrada, M.; Colino, N.; Cruz, B. De La; Delgado Peris, A.; Escalante Del Valle, A.; Fernández Del Val, D.; Fernández Ramos, J. P.; Flix, J.; Fouz, M. C.; Gonzalez Lopez, O.; Goy Lopez, S.; Hernandez, J. M.; Josa, M. I.; Llorente Merino, J.; Martin Perez, C.; Martin Viscasillas, E.; Moran, D.; Morcillo Perez, C. M.; Tobar, Á. Navarro; Perez Dengra, C.; Pérez-Calero Yzquierdo, A.; Puerta Pelayo, J.; Redondo, I.; Sastre, J.; Vazquez Escobar, J.; de Trocóniz, J. F.; Alvarez Gonzalez, B.; Cuevas, J.; Fernandez Menendez, J.; Folgueras, S.; Gonzalez Caballero, I.; Leguina, P.; Palencia Cortezon, E.; Prado Pico, J.; Rodríguez Bouza, V.; Soto Rodríguez, A.; Trapote, A.; Vico Villalba, C.; Vischia, P.; Blanco Fernández, S.; Cabrillo, I. J.; Calderon, A.; Duarte Campderros, J.; Fernandez, M.; Gomez, G.; Lasaosa García, C.; Lopez Ruiz, R.; Martinez Rivero, C.; Martinez Ruiz del Arbol, P.; Matorras, F.; Matorras Cuevas, P.; Navarrete Ramos, E.; Piedra Gomez, J.; Scodellaro, L.; Vila, I.; Vizan Garcia, J. M.; Kailasapathy, B.; Wickramarathna, D. D. C.; Dharmaratna, W. G. D.; Liyanage, K.; Perera, N.; Abbaneo, D.; Amendola, C.; Auffray, E.; Auzinger, G.; Baechler, J.; Barney, D.; Bermúdez Martínez, A.; Bianco, M.; Bin Anuar, A. A.; Bocci, A.; Borgonovi, L.; Botta, C.; Bragagnolo, A.; Brondolin, E.; Brown, C. E.; Caillol, C.; Cerminara, G.; Chernyavskaya, N.; d'Enterria, D.; Dabrowski, A.; David, A.; De Roeck, A.; Defranchis, M. M.; Deile, M.; Dobson, M.; Franzoni, G.; Funk, W.; Giani, S.; Gigi, D.; Gill, K.; Glege, F.; Glowacki, M.; Hegeman, J.; Heikkilä, J. K.; Huber, B.; Innocente, V.; James, T.; Janot, P.; Kaluzinska, O.; Karacheban, O.; Karathanasis, G.; Laurila, S.; Lecoq, P.; Leutgeb, E.; Lourenço, C.; Magherini, M.; Malgeri, L.; Mannelli, M.; Matthewman, M.; Mehta, A.; Meijers, F.; Mersi, S.; Meschi, E.; Milosevic, V.; Monti, F.; Moortgat, F.; Mulders, M.; Neutelings, I.; Orfanelli, S.; Pantaleo, F.; Petrucciani, G.; Pfeiffer, A.; Pierini, M.; Qu, H.; Rabady, D.; Ribeiro Lopes, B.; Riti, F.; Rovere, M.; Sakulin, H.; Salvatico, R.; Sanchez Cruz, S.; Scarfi, S.; Schwick, C.; Selvaggi, M.; Sharma, A.; Shchelina, K.; Silva, P.; Sphicas, P.; Stahl Leiton, A. G.; Steen, A.; Summers, S.; Treille, D.; Tropea, P.; Walter, D.; Wanczyk, J.; Wang, J.; Wuchterl, S.; Zehetner, P.; Zejdl, P.; Zeuner, W. D.; Bevilacqua, T.; Caminada, L.; Ebrahimi, A.; Erdmann, W.; Horisberger, R.; Ingram, Q.; Kaestli, H. C.; Kotlinski, D.; Lange, C.; Missiroli, M.; Noehte, L.; Rohe, T.; Samalan, A.; Aarrestad, T. K.; Backhaus, M.; Bonomelli, G.; Calandri, A.; Cazzaniga, C.; Datta, K.; De Bryas Dexmiers D'archiac, P.; De Cosa, A.; Dissertori, G.; Dittmar, M.; Donegà, M.; Eble, F.; Galli, M.; Gedia, K.; Glessgen, F.; Grab, C.; Härringer, N.; Harte, T. G.; Hits, D.; Lustermann, W.; Lyon, A.-M.; Manzoni, R. A.; Marchegiani, M.; Marchese, L.; Mascellani, A.; Nessi-Tedaldi, F.; Pauss, F.; Perovic, V.; Pigazzini, S.; Ristic, B.; Seidita, R.; Steggemann, J.; Tarabini, A.; Valsecchi, D.; Wallny, R.; Amsler, C.; Bärtschi, P.; Canelli, M. F.; Cormier, K.; Huwiler, M.; Jin, W.; Jofrehei, A.; Kilminster, B.; Leontsinis, S.; Liechti, S. P.; Macchiolo, A.; Meiring, P.; Meng, F.; Motta, J.; Reimers, A.; Robmann, P.; Senger, M.; Shokr, E.; Stäger, F.; Tramontano, R.; Adloff, C.; Bhowmik, D.; Kuo, C. M.; Lin, W.; Rout, P. K.; Tiwari, P. C.; Ceard, L.; Chen, K. F.; Chen, Z. g.; De Iorio, A.; Hou, W.-S.; Hsu, T. h.; Kao, Y. w.; Karmakar, S.; Kole, G.; Li, Y. y.; Lu, R.-S.; Paganis, E.; Su, X. f.; Thomas-Wilsker, J.; Tsai, L. s.; Tsionou, D.; Wu, H. y.; Yazgan, E.; Asawatangtrakuldee, C.; Srimanobhas, N.; Wachirapusitanand, V.; Maghrbi, Y.; Agyel, D.; Boran, F.; Dolek, F.; Dumanoglu, I.; Eskut, E.; Guler, Y.; Gurpinar Guler, E.; Isik, C.; Kara, O.; Kayis Topaksu, A.; Komurcu, Y.; Onengut, G.; Ozdemir, K.; Polatoz, A.; Tali, B.; Tok, U. G.; Uslan, E.; Zorbakir, I. S.; Yalvac, M.; Akgun, B.; Atakisi, I. O.; Gülmez, E.; Kaya, M.; Kaya, O.; Tekten, S.; Cakir, A.; Cankocak, K.; Sen, S.; Aydilek, O.; Hacisahinoglu, B.; Hos, I.; Kaynak, B.; Ozkorucuklu, S.; Potok, O.; Sert, H.; Simsek, C.; Zorbilmez, C.; Cerci, S.; Isildak, B.; Sunar Cerci, D.; Yetkin, T.; Boyaryntsev, A.; Grynyov, B.; Levchuk, L.; Anthony, D.; Brooke, J. J.; Bundock, A.; Bury, F.; Clement, E.; Cussans, D.; Flacher, H.; Goldstein, J.; Heath, H. F.; Holmberg, M.-L.; Kreczko, L.; Paramesvaran, S.; Robertshaw, L.; Smith, V. J.; Walkingshaw Pass, K.; Ball, A. H.; Bell, K. W.; Belyaev, A.; Brew, C.; Brown, R. M.; Cockerill, D. J. A.; Cooke, C.; Elliot, A.; Ellis, K. V.; Harder, K.; Harper, S.; Linacre, J.; Manolopoulos, K.; Newbold, D. M.; Olaiya, E.; Petyt, D.; Reis, T.; Sahasransu, A. R.; Salvi, G.; Schuh, T.; Shepherd-Themistocleous, C. H.; Tomalin, I. R.; Whalen, K. C.; Williams, T.; Andreou, I.; Bainbridge, R.; Bloch, P.; Buchmuller, O.; Carrillo Montoya, C. A.; Chahal, G. S.; Colling, D.; Dancu, J. S.; Das, I.; Dauncey, P.; Davies, G.; Della Negra, M.; Fayer, S.; Fedi, G.; Hall, G.; Howard, A.; Iles, G.; Knight, C. R.; Krueper, P.; Langford, J.; Law, K. H.; León Holgado, J.; Lyons, L.; Magnan, A.-M.; Maier, B.; Mallios, S.; Mieskolainen, M.; Nash, J.; Pesaresi, M.; Pradeep, P. B.; Radburn-Smith, B. C.; Richards, A.; Rose, A.; Savva, K.; Seez, C.; Shukla, R.; Tapper, A.; Uchida, K.; Uttley, G. P.; Virdee, T.; Vojinovic, M.; Wardle, N.; Winterbottom, D.; Cole, J. E.; Khan, A.; Kyberd, P.; Reid, I. D.; Abdullin, S.; Brinkerhoff, A.; Collins, E.; Darwish, M. R.; Dittmann, J.; Hatakeyama, K.; Hegde, V.; Hiltbrand, J.; McMaster, B.; Samudio, J.; Sawant, S.; Sutantawibul, C.; Wilson, J.; Bartek, R.; Dominguez, A.; Simsek, A. E.; Yu, S. S.; Bam, B.; Buchot Perraguin, A.; Chudasama, R.; Cooper, S. I.; Crovella, C.; Gleyzer, S. V.; Pearson, E.; Perez, C. U.; Rumerio, P.; Usai, E.; Yi, R.; Akpinar, A.; Cosby, C.; De Castro, G.; Demiragli, Z.; Erice, C.; Fangmeier, C.; Fernandez Madrazo, C.; Fontanesi, E.; Gastler, D.; Golf, F.; Jeon, S.; O'cain, J.; Reed, I.; Rohlf, J.; Salyer, K.; Sperka, D.; Spitzbart, D.; Suarez, I.; Tsatsos, A.; Zecchinelli, A. G.; Barone, G.; Benelli, G.; Cutts, D.; Gouskos, L.; Hadley, M.; Heintz, U.; Ho, K. W.; Hogan, J. M.; Kwon, T.; Landsberg, G.; Lau, K. T.; Luo, J.; Mondal, S.; Russell, T.; Sagir, S.; Shen, X.; Stamenkovic, M.; Venkatasubramanian, N.; Abbott, S.; Barton, B.; Brainerd, C.; Breedon, R.; Cai, H.; Calderon De La Barca Sanchez, M.; Chertok, M.; Citron, M.; Conway, J.; Cox, P. T.; Erbacher, R.; Jensen, F.; Kukral, O.; Mocellin, G.; Mulhearn, M.; Ostrom, S.; Wei, W.; Yoo, S.; Zhang, F.; Adamidis, K.; Bachtis, M.; Campos, D.; Cousins, R.; Datta, A.; Flores Avila, G.; Hauser, J.; Ignatenko, M.; Iqbal, M. A.; Lam, T.; Lo, Y. f.; Manca, E.; Nunez Del Prado, A.; Saltzberg, D.; Valuev, V.; Clare, R.; Gary, J. W.; Hanson, G.; Aportela, A.; Arora, A.; Branson, J. G.; Cittolin, S.; Cooperstein, S.; Diaz, D.; Duarte, J.; Giannini, L.; Gu, Y.; Guiang, J.; Kansal, R.; Krutelyov, V.; Lee, R.; Letts, J.; Masciovecchio, M.; Mokhtar, F.; Mukherjee, S.; Pieri, M.; Primosch, D.; Quinnan, M.; Sharma, V.; Tadel, M.; Vourliotis, E.; Würthwein, F.; Xiang, Y.; Yagil, A.; Barzdukas, A.; Brennan, L.; Campagnari, C.; Downham, K.; Grieco, C.; Hussain, M. M.; Incandela, J.; Kim, J.; Li, A. J.; Masterson, P.; Mei, H.; Richman, J.; Santpur, S. N.; Sarica, U.; Schmitz, R.; Setti, F.; Sheplock, J.; Stuart, D.; Vámi, T. Á.; Yan, X.; Zhang, D.; Bhattacharya, S.; Bornheim, A.; Cerri, O.; Mao, J.; Newman, H. B.; Reales Gutiérrez, G.; Spiropulu, M.; Vlimant, J. R.; Wang, C.; Xie, S.; Zhu, R. Y.; Alison, J.; An, S.; Bryant, P.; Cremonesi, M.; Dutta, V.; Ferguson, T.; Gómez Espinosa, T. A.; Harilal, A.; Kallil Tharayil, A.; Kanemura, M.; Liu, C.; Mudholkar, T.; Murthy, S.; Palit, P.; Park, K.; Paulini, M.; Roberts, A.; Sanchez, A.; Terrill, W.; Cumalat, J. P.; Ford, W. T.; Hart, A.; Hassani, A.; Manganelli, N.; Pearkes, J.; Savard, C.; Schonbeck, N.; Stenson, K.; Ulmer, K. A.; Wagner, S. R.; Zipper, N.; Zuolo, D.; Alexander, J.; Chen, X.; Cranshaw, D. J.; Dickinson, J.; Fan, J.; Fan, X.; Hogan, S.; Kotamnives, P.; Monroy, J.; Oshiro, M.; Patterson, J. R.; Reid, M.; Ryd, A.; Thom, J.; Wittich, P.; Zou, R.; Albrow, M.; Alyari, M.; Amram, O.; Apollinari, G.; Apresyan, A.; Bauerdick, L. A. T.; Berry, D.; Berryhill, J.; Bhat, P. C.; Burkett, K.; Butler, J. N.; Canepa, A.; Cerati, G. B.; Cheung, H. W. K.; Chlebana, F.; Cummings, G.; Dutta, I.; Elvira, V. D.; Freeman, J.; Gandrakota, A.; Gecse, Z.; Gray, L.; Green, D.; Grummer, A.; Grünendahl, S.; Guerrero, D.; Gutsche, O.; Harris, R. M.; Herwig, T. C.; Hirschauer, J.; Jayatilaka, B.; Jindariani, S.; Johnson, M.; Joshi, U.; Klijnsma, T.; Klima, B.; Kwok, K. H. M.; Lammel, S.; Lee, C.; Lincoln, D.; Lipton, R.; Liu, T.; Maeshima, K.; Mason, D.; McBride, P.; Merkel, P.; Mrenna, S.; Nahn, S.; Ngadiuba, J.; Noonan, D.; Norberg, S.; Papadimitriou, V.; Pastika, N.; Pedro, K.; Pena, C.; Ravera, F.; Reinsvold Hall, A.; Ristori, L.; Safdari, M.; Sexton-Kennedy, E.; Smith, N.; Soha, A.; Spiegel, L.; Stoynev, S.; Strait, J.; Taylor, L.; Tkaczyk, S.; Tran, N. V.; Uplegger, L.; Vaandering, E. W.; Zoi, I.; Aruta, C.; Avery, P.; Bourilkov, D.; Chang, P.; Cherepanov, V.; Field, R. D.; Huh, C.; Koenig, E.; Kolosova, M.; Konigsberg, J.; Korytov, A.; Matchev, K.; Menendez, N.; Mitselmakher, G.; Mohrman, K.; Muthirakalayil Madhu, A.; Rawal, N.; Rosenzweig, S.; Takahashi, Y.; Wang, J.; Adams, T.; Al Kadhim, A.; Askew, A.; Bower, S.; Hashmi, R.; Kim, R. S.; Kim, S.; Kolberg, T.; Martinez, G.; Prosper, H.; Prova, P. R.; Wulansatiti, M.; Yohay, R.; Zhang, J.; Alsufyani, B.; Butalla, S.; Das, S.; Elkafrawy, T.; Hohlmann, M.; Yanes, E.; Adams, M. R.; Baty, A.; Bennett, C.; Cavanaugh, R.; Escobar Franco, R.; Evdokimov, O.; Gerber, C. E.; Hawksworth, M.; Hingrajiya, A.; Hofman, D. J.; Lee, J. h.; Lemos, D. S.; Mills, C.; Nanda, S.; Oh, G.; Ozek, B.; Pilipovic, D.; Pradhan, R.; Prifti, E.; Roy, T.; Rudrabhatla, S.; Singh, N.; Tonjes, M. B.; Varelas, N.; Wadud, M. A.; Ye, Z.; Yoo, J.; Alhusseini, M.; Blend, D.; Dilsiz, K.; Emediato, L.; Karaman, G.; Köseyan, O. K.; Merlo, J.-P.; Mestvirishvili, A.; Neogi, O.; Ogul, H.; Onel, Y.; Penzo, A.; Snyder, C.; Tiras, E.; Blumenfeld, B.; Corcodilos, L.; Davis, J.; Gritsan, A. V.; Kang, L.; Kyriacou, S.; Maksimovic, P.; Roguljic, M.; Roskes, J.; Sekhar, S.; Swartz, M.; Abreu, A.; Alcerro Alcerro, L. F.; Anguiano, J.; Arteaga Escatel, S.; Baringer, P.; Bean, A.; Flowers, Z.; Grove, D.; King, J.; Krintiras, G.; Lazarovits, M.; Le Mahieu, C.; Marquez, J.; Murray, M.; Nickel, M.; Pitt, M.; Popescu, S.; Rogan, C.; Royon, C.; Sanders, S.; Smith, C.; Wilson, G.; Allmond, B.; Gujju Gurunadha, R.; Ivanov, A.; Kaadze, K.; Maravin, Y.; Natoli, J.; Roy, D.; Sorrentino, G.; Baden, A.; Belloni, A.; Bistany-riebman, J.; Chen, Y. M.; Eno, S. C.; Hadley, N. J.; Jabeen, S.; Kellogg, R. G.; Koeth, T.; Kronheim, B.; Lai, Y.; Lascio, S.; Mignerey, A. C.; Nabili, S.; Palmer, C.; Papageorgakis, C.; Paranjpe, M. M.; Popova, E.; Shevelev, A.; Wang, L.; Zhang, L.; Baldenegro Barrera, C.; Bendavid, J.; Bright-Thonney, S.; Cali, I. A.; Chou, P. c.; D'Alfonso, M.; Eysermans, J.; Freer, C.; Gomez-Ceballos, G.; Goncharov, M.; Grosso, G.; Harris, P.; Hoang, D.; Kovalskyi, D.; Krupa, J.; Lavezzo, L.; Lee, Y.-J.; Long, K.; Mcginn, C.; Novak, A.; Park, M. I.; Paus, C.; Reissel, C.; Roland, C.; Roland, G.; Rothman, S.; Stephans, G. S. F.; Wang, Z.; Wyslouch, B.; Yang, T. J.; Crossman, B.; Kapsiak, C.; Krohn, M.; Mahon, D.; Mans, J.; Marzocchi, B.; Revering, M.; Rusack, R.; Saradhy, R.; Strobbe, N.; Bloom, K.; Claes, D. R.; Haza, G.; Hossain, J.; Joo, C.; Kravchenko, I.; Rohilla, A.; Siado, J. E.; Tabb, W.; Vagnerini, A.; Wightman, A.; Yan, F.; Yu, D.; Bandyopadhyay, H.; Hay, L.; Hsia, H. w.; Iashvili, I.; Kalogeropoulos, A.; Kharchilava, A.; Morris, M.; Nguyen, D.; Rappoccio, S.; Rejeb Sfar, H.; Williams, A.; Young, P.; Alverson, G.; Barberis, E.; Bonilla, J.; Bylsma, B.; Campana, M.; Dervan, J.; Haddad, Y.; Han, Y.; Israr, I.; Krishna, A.; Levchenko, P.; Li, J.; Lu, M.; Mccarthy, R.; Morse, D. M.; Nguyen, V.; Orimoto, T.; Parker, A.; Skinnari, L.; Tsai, E.; Wood, D.; Dittmer, S.; Hahn, K. A.; Li, D.; Liu, Y.; Mcginnis, M.; Miao, Y.; Monk, D. G.; Schmitt, M. H.; Taliercio, A.; Velasco, M.; Agarwal, G.; Band, R.; Bucci, R.; Castells, S.; Das, A.; Goldouzian, R.; Hildreth, M.; Hurtado Anampa, K.; Ivanov, T.; Jessop, C.; Lannon, K.; Lawrence, J.; Loukas, N.; Lutton, L.; Mariano, J.; Marinelli, N.; Mcalister, I.; McCauley, T.; Mcgrady, C.; Moore, C.; Musienko, Y.; Nelson, H.; Osherson, M.; Piccinelli, A.; Ruchti, R.; Townsend, A.; Wan, Y.; Wayne, M.; Yockey, H.; Zarucki, M.; Zygala, L.; Basnet, A.; Carrigan, M.; Durkin, L. S.; Hill, C.; Joyce, M.; Nunez Ornelas, M.; Wei, K.; Wenzl, D. A.; Winer, B. L.; Yates, B. R.; Bouchamaoui, H.; Coldham, K.; Das, P.; Dezoort, G.; Elmer, P.; Fackeldey, P.; Frankenthal, A.; Greenberg, B.; Haubrich, N.; Kennedy, K.; Kopp, G.; Kwan, S.; Lange, D.; Loeliger, A.; Marlow, D.; Ojalvo, I.; Olsen, J.; Simpson, F.; Stickland, D.; Tully, C.; Vage, L. H.; Malik, S.; Sharma, R.; Bakshi, A. S.; Chandra, S.; Chawla, R.; Gu, A.; Gutay, L.; Jones, M.; Jung, A. W.; Koshy, A. M.; Liu, M.; Negro, G.; Neumeister, N.; Paspalaki, G.; Piperov, S.; Schulte, J. F.; Virdi, A. K.; Wang, F.; Wildridge, A.; Xie, W.; Yao, Y.; Dolen, J.; Parashar, N.; Pathak, A.; Acosta, D.; Agrawal, A.; Carnahan, T.; Ecklund, K. M.; Fernández Manteca, P. J.; Freed, S.; Gardner, P.; Geurts, F. J. M.; Krommydas, I.; Li, W.; Lin, J.; Miguel Colin, O.; Padley, B. P.; Redjimi, R.; Rotter, J.; Yigitbasi, E.; Zhang, Y.; Bodek, A.; de Barbaro, P.; Demina, R.; Dulemba, J. L.; Garcia-Bellido, A.; Hindrichs, O.; Khukhunaishvili, A.; Parmar, N.; Parygin, P.; Taus, R.; Chiarito, B.; Chou, J. P.; Clark, S. V.; Gadkari, D.; Gershtein, Y.; Halkiadakis, E.; Heindl, M.; Houghton, C.; Jaroslawski, D.; Konstantinou, S.; Laflotte, I.; Lath, A.; Montalvo, R.; Nash, K.; Reichert, J.; Saha, P.; Salur, S.; Schnetzer, S.; Somalwar, S.; Stone, R.; Thayil, S. A.; Thomas, S.; Vora, J.; Ally, D.; Delannoy, A. G.; Fiorendi, S.; Higginbotham, S.; Holmes, T.; Kanuganti, A. R.; Karunarathna, N.; Lee, L.; Nibigira, E.; Spanier, S.; Aebi, D.; Ahmad, M.; Akhter, T.; Androsov, K.; Bouhali, O.; Eusebi, R.; Gilmore, J.; Huang, T.; Kamon, T.; Kim, H.; Luo, S.; Mueller, R.; Overton, D.; Safonov, A.; Akchurin, N.; Damgov, J.; Feng, Y.; Gogate, N.; Kazhykarim, Y.; Lamichhane, K.; Lee, S. W.; Madrid, C.; Mankel, A.; Peltola, T.; Volobouev, I.; Appelt, E.; Chen, Y.; Greene, S.; Gurrola, A.; Johns, W.; Kunnawalkam Elayavalli, R.; Melo, A.; Rathjens, D.; Romeo, F.; Sheldon, P.; Tuo, S.; Velkovska, J.; Viinikainen, J.; Cardwell, B.; Chung, H.; Cox, B.; Hakala, J.; Hirosky, R.; Ledovskoy, A.; Mantilla, C.; Neu, C.; Ramón Álvarez, C.; Bhattacharya, S.; Karchin, P. E.; Aravind, A.; Banerjee, S.; Black, K.; Bose, T.; Chavez, E.; Dasu, S.; Everaerts, P.; Galloni, C.; He, H.; Herndon, M.; Herve, A.; Koraka, C. K.; Lanaro, A.; Loveless, R.; Madhusudanan Sreekala, J.; Mallampalli, A.; Mohammadi, A.; Mondal, S.; Parida, G.; Pétré, L.; Pinna, D.; Savin, A.; Shang, V.; Sharma, V.; Smith, W. H.; Teague, D.; Tsoi, H. F.; Vetens, W.; Warden, A.; Afanasiev, S.; Alexakhin, V.; Budkouski, D.; Golutvin, I.; Gorbunov, I.; Karjavine, V.; Kodolova, O.; Korenkov, V.; Lanev, A.; Malakhov, A.; Matveev, V.; Nikitenko, A.; Palichik, V.; Perelygin, V.; Savina, M.; Shalaev, V.; Shmatov, S.; Shulha, S.; Smirnov, V.; Teryaev, O.; Voytishin, N.; Yuldashev, B. S.; Zarubin, A.; Zhizhin, I.; Andreev, Y u.; Dermenev, A.; Gninenko, S.; Golubev, N.; Karneyeu, A.; Kirpichnikov, D.; Kirsanov, M.; Krasnikov, N.; Tlisova, I.; Toropin, A.; Gavrilov, G.; Golovtcov, V.; Ivanov, Y.; Kim, V.; Murzin, V.; Oreshkin, V.; Sosnov, D.; Sulimov, V.; Uvarov, L.; Vorobyev, A.; Aushev, T.; Ivanov, K.; Gavrilov, V.; Lychkovskaya, N.; Popov, V.; Zhokin, A.; Chadeeva, M.; Chistov, R.; Polikarpov, S.; Andreev, V.; Azarkin, M.; Kirakosyan, M.; Terkulov, A.; Boos, E.; Bunichev, V.; Dubinin, M.; Dudko, L.; Ershov, A.; Gribushin, A.; Klyukhin, V.; Perfilov, M.; Savrin, V.; Volkov, P.; Blinov, V.; Dimova, T.; Kozyrev, A.; Radchenko, O.; Skovpen, Y.; Kachanov, V.; Slabospitskii, S.; Uzunian, A.; Babaev, A.; Borshch, V.; Druzhkin, D.

doi:10.1140/epjc/s10052-025-14713-w

Published November 2025 | Version Published

Journal Article Open

Development of systematic uncertainty-aware neural network trainings for binned-likelihood analyses at the LHC

1. Alikhanyan National Laboratory
2. Yerevan State University
3. Institute of High Energy Physics
4. TU Wien
5. University of Antwerp
6. Vrije Universiteit Brussel
7. Ghent University
8. Université Libre de Bruxelles
9. Université Catholique de Louvain
10. Centro Brasileiro de Pesquisas Físicas
11. Rio de Janeiro State University
12. State University of Campinas
13. Federal University of Rio Grande do Sul
14. Universidade Federal do ABC
15. Bulgarian Academy of Sciences
16. Sofia University
17. University of Tarapacá
18. Beihang University
19. Tsinghua University
20. University of Chinese Academy of Sciences
21. China Center of Advanced Science and Technology
22. China Spallation Neutron Source
23. Peking University
24. South China Normal University
25. Sun Yat-sen University
26. University of Science and Technology of China
27. Nanjing Normal University
28. Henan Normal University
29. University of Shanghai for Science and Technology
30. University of Iowa
31. Fudan University
32. Zhejiang University
33. Universidad de Los Andes
34. University of Antioquia
35. University of Split
36. Rudjer Boskovic Institute
37. European Organization for Nuclear Research
38. University of Cyprus
39. Charles University
40. National Polytechnic School
41. Universidad San Francisco de Quito
42. Academy of Scientific Research and Technology
43. Cairo University
44. Suez University
45. British University in Egypt
46. Fayoum University
47. National Institute of Chemical Physics and Biophysics
48. University of Helsinki
49. Helsinki Institute of Physics
50. Lappeenranta University of Technology
51. University of Paris-Saclay
52. Purdue University West Lafayette
53. Institut Polytechnique de Paris
54. University of Strasbourg
55. University of Upper Alsace
56. Istinye University
57. Georgian Technical University
58. RWTH Aachen University
59. University of the State of Amazonas
60. Deutsches Elektronen-Synchrotron DESY
61. Universität Hamburg
62. University of Wuppertal
63. Brandenburg University of Technology
64. Forschungszentrum Jülich
65. Karlsruhe Institute of Technology
66. National Centre of Scientific Research Demokritos
67. National and Kapodistrian University of Athens
68. National Technical University of Athens
69. University of Ioannina
70. Wigner Research Centre for Physics
71. Institute for Nuclear Research
72. Babeș-Bolyai University
73. Eötvös Loránd University
74. Assiut University
75. University of Debrecen
76. Panjab University
77. Punjab Agricultural University
78. University of Delhi
79. Saha Institute of Nuclear Physics
80. Visva-Bharati University
81. Indian Institute of Technology Madras
82. Indian Institute of Science Bangalore
83. Amity University
84. Tata Institute of Fundamental Research
85. National Institute of Science Education and Research
86. Indian Institute of Technology Bhubaneswar
87. Institute of Physics
88. Indian Institute of Science Education and Research Pune
89. University of Hyderabad
90. Isfahan University of Technology
91. Sharif University of Technology
92. Institute for Research in Fundamental Sciences
93. University of Science and Technology of Mazandaran
94. Arak University
95. University College Dublin
96. Polytechnic University of Bari
97. Helwan University
98. University of Bologna
99. National Agency for New Technologies, Energy and Sustainable Economic Development
100. University of Catania
101. INFN Sezione di Firenze
102. National Laboratory of Frascati
103. Marconi University
104. University of Genoa
105. University of Milano-Bicocca
106. Scuola Superiore Meridionale
107. University of Trento
108. Fermilab
109. Luleå University of Technology
110. Legnaro National Laboratories
111. University of Pavia
112. University of Perugia
113. National Research Council
114. University of Siena
115. Sapienza University of Rome
116. INFN Sezione di Torino
117. University of Trieste
118. Kyungpook National University
119. Gangneung–Wonju National University
120. Chonnam National University
121. Hanyang University
122. Korea University
123. Kyung Hee University
124. Sejong University
125. Seoul National University
126. University of Seoul
127. Yonsei University
128. Sungkyunkwan University
129. American University of the Middle East
130. Kuwait University
131. Riga Technical University
132. University of Latvia
133. Vilnius University
134. University of Malaya
135. National University of Malaysia
136. Universidad de Sonora
137. Consejo Nacional de Ciencia y Tecnología
138. Ibero American University
139. Benemérita Universidad Autónoma de Puebla
140. University of Montenegro
141. University of Canterbury
142. Quaid-i-Azam University
143. AGH University of Science and Technology
144. National Centre for Nuclear Research
145. University of Warsaw
146. Warsaw University of Technology
147. Laboratory of Instrumentation and Experimental Particles Physics
148. University of Belgrade
149. Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas
150. Autonomous University of Madrid
151. University of Oviedo
152. University of Cantabria
153. University of Colombo
154. Eastern University, Sri Lanka
155. University of Ruhuna
156. École Polytechnique Fédérale de Lausanne
157. Paul Scherrer Institute
158. University of Zurich
159. ETH Zurich
160. Stefan Meyer Institute for Subatomic Physics
161. National Central University
162. Laboratoire d'Annecy-le-Vieux de Physique des Particules
163. National Taiwan University
164. Chulalongkorn University
165. Tunis El Manar University
166. Cukurova University
167. Konya Technical University
168. Adıyaman University
169. Middle East Technical University
170. Bozok Universitesi
171. Boğaziçi University
172. Marmara University
173. Kafkas University
174. Istanbul Technical University
175. Okan University
176. Hacettepe University
177. Istanbul University
178. Erzincan University
179. Istanbul University Cerrahpaşa
180. Yıldız Technical University
181. Institute for Scintillation Materials
182. Kharkiv Institute of Physics and Technology
183. University of Bristol
184. Rutherford Appleton Laboratory
185. University of Southampton
186. Imperial College London
187. Durham University
188. Monash University
189. Brunel University London
190. Baylor University
191. Catholic University of America
192. University of Alabama
193. University of Turin
194. Boston University
195. Brown University
196. Bethel University
197. Karamanoğlu Mehmetbey University
198. California Coast University
199. University of California, Los Angeles
200. University of California, Santa Barbara
201. California Institute of Technology
202. Carnegie Mellon University
203. University of Colorado Boulder
204. Cornell University
205. United States Naval Academy
206. University of Florida
207. Florida State University
208. Florida Institute of Technology
209. Ain Shams University
210. University of Illinois at Chicago
211. Bingöl University
212. Sinop University
213. Erciyes University
214. Johns Hopkins University
215. University of Kansas
216. Horia Hulubei National Institute for R and D in Physics and Nuclear Engineering
217. Kansas State University
218. University of Maryland, College Park
219. Massachusetts Institute of Technology
220. University of Minnesota
221. University of Nebraska–Lincoln
222. University at Buffalo, State University of New York
223. Northeastern University
224. Northwestern University
225. University of Notre Dame
226. The Ohio State University
227. Princeton University
228. University of Puerto Rico-Mayaguez
229. Purdue University Northwest
230. Rice University
231. University of Rochester
232. Rutgers, The State University of New Jersey
233. University of Tennessee at Knoxville
234. Texas A&M University
235. Texas A&M University at Qatar
236. Texas Tech University
237. Vanderbilt University
238. University of Virginia
239. Wayne State University
240. University of Wisconsin–Madison
241. Institute of Nuclear Physics

We propose a neural network training method capable of accounting for the effects of systematic variations of the data model in the training process and describe its extension towards neural network multiclass classification. The procedure is evaluated on the realistic case of the measurement of Higgs boson production via gluon fusion and vector boson fusion in the ττ decay channel at the CMS experiment. The neural network output functions are used to infer the signal strengths for inclusive production of Higgs bosons as well as for their production via gluon fusion and vector boson fusion. We observe improvements of 12 and 16% in the uncertainty in the signal strengths for gluon and vector-boson fusion, respectively, compared with a conventional neural network training based on cross-entropy.

Copyright and License

© CERN for the benefit of the CMS Collaboration 2025. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. Funded by SCOAP³.

Acknowledgement

We congratulate our colleagues in the CERN accelerator departments for the excellent performance of the LHC and thank the technical and administrative staffs at CERN and at other CMS institutes for their contributions to the success of the CMS effort. In addition, we gratefully acknowledge the computing centers and personnel of the Worldwide LHC Computing Grid and other centers for delivering so effectively the computing infrastructure essential to our analyses. Finally, we acknowledge the enduring support for the construction and operation of the LHC, the CMS detector, and the supporting computing infrastructure provided by the following funding agencies: SC (Armenia), BMBWF and FWF (Austria); FNRS and FWO (Belgium); CNPq, CAPES, FAPERJ, FAPERGS, and FAPESP (Brazil); MES and BNSF (Bulgaria); CERN; CAS, MoST, and NSFC (China); MINCIENCIAS (Colombia); MSES and CSF (Croatia); RIF (Cyprus); SENESCYT (Ecuador); ERC PRG, RVTT3 and MoER TK202 (Estonia); Academy of Finland, MEC, and HIP (Finland); CEA and CNRS/IN2P3 (France); SRNSF (Georgia); BMBF, DFG, and HGF (Germany); GSRI (Greece); NKFIH (Hungary); DAE and DST (India); IPM (Iran); SFI (Ireland); INFN (Italy); MSIP and NRF (Republic of Korea); MES (Latvia); LMTLT (Lithuania); MOE and UM (Malaysia); BUAP, CINVESTAV, CONACYT, LNS, SEP, and UASLP-FAI (Mexico); MOS (Montenegro); MBIE (New Zealand); PAEC (Pakistan); MES and NSC (Poland); FCT (Portugal); MESTD (Serbia); MICIU/AEI and PCTI (Spain); MOSTR (Sri Lanka); Swiss Funding Agencies (Switzerland); MST (Taipei); MHESI and NSTDA (Thailand); TUBITAK and TENMAK (Turkey); NASU (Ukraine); STFC (United Kingdom); DOE and NSF (USA). Individuals have received support from the Marie-Curie program and the European Research Council and Horizon 2020 Grant, contract Nos. 675440, 724704, 752730, 758316, 765710, 824093, 101115353, 101002207, and COST Action CA16108 (European Union); the Leventis Foundation; the Alfred P. Sloan Foundation; the Alexander von Humboldt Foundation; the Science Committee, project no. 22rl-037 (Armenia); the Fonds pour la Formation à la Recherche dans l’Industrie et dans l’Agriculture (FRIA-Belgium); the Beijing Municipal Science & Technology Commission, No. Z191100007219010 and Fundamental Research Funds for the Central Universities (China); the Ministry of Education, Youth and Sports (MEYS) of the Czech Republic; the Shota Rustaveli National Science Foundation, grant FR-22-985 (Georgia); the Deutsche Forschungsgemeinschaft (DFG), among others, under Germany’s Excellence Strategy -- EXC 2121 “Quantum Universe” -- 390833306, and under project number 400140256 - GRK2497; the Hellenic Foundation for Research and Innovation (HFRI), Project Number 2288 (Greece); the Hungarian Academy of Sciences, the New National Excellence Program - ÚNKP, the NKFIH research grants K 131991, K 133046, K 138136, K 143460, K 143477, K 146913, K 146914, K 147048, 2020-2.2.1-ED-2021-00181, TKP2021-NKTA-64, and 2021-4.1.2-NEMZ_KI-2024-00036 (Hungary); the Council of Science and Industrial Research, India; ICSC -- National Research Center for High Performance Computing, Big Data and Quantum Computing and FAIR -- Future Artificial Intelligence Research, funded by the NextGenerationEU program (Italy); the Latvian Council of Science; the Ministry of Education and Science, project no. 2022/WK/14, and the National Science Center, contracts Opus 2021/41/B/ST2/01369 and 2021/43/B/ST2/01552 (Poland); the Fundação para a Ciência e a Tecnologia, grant CEECIND/01334/2018 (Portugal); the National Priorities Research Program by Qatar National Research Fund; MICIU/AEI/10.13039/501100011033, ERDF/EU, “European Union NextGenerationEU/PRTR”, and Programa Severo Ochoa del Principado de Asturias (Spain); the Chulalongkorn Academic into Its 2nd Century Project Advancement Project, and the National Science, Research and Innovation Fund via the Program Management Unit for Human Resources & Institutional Development, Research and Innovation, grant B39G670016 (Thailand); the Kavli Foundation; the Nvidia Corporation; the SuperMicro Corporation; the Welch Foundation, contract C-1845; and the Weston Havens Foundation (USA).

Data Availability

Release and preservation of data used by the CMS Collaboration as the basis for publications is guided by the CMS data preservation, re-use and open access policy.

Code Availability

The CMS core software is publicly available on GitHub (https://github.com/cms-sw/cmssw).

Files

s10052-025-14713-w.pdf

Files (2.9 MB)

Name	Size	Download all
s10052-025-14713-w.pdf md5:ceb2d146c91bfda173991116b393f7cc	2.9 MB	Preview Download

Additional details

Is new version of: Discussion Paper: arXiv:2502.13047 (arXiv)
Is supplemented by: Dataset: 10.7483/OPENDATA.CMS.1BNU.8V1W (DOI); Software: https://github.com/cms-sw/cmssw (URL)

SCOAP3

Accepted: 2025-08-29
Available: 2025-11-26

Published

Caltech groups: CMS@Caltech, Division of Physics, Mathematics and Astronomy (PMA)
Publication Status: Published

	All versions	This version
Views	43	43
Downloads	10	10
Data volume	49.7 MB	49.7 MB

Development of systematic uncertainty-aware neural network trainings for binned-likelihood analyses at the LHC

Copyright and License

Acknowledgement

Data Availability

Code Availability

Files

s10052-025-14713-w.pdf

Files (2.9 MB)

Additional details

Related works

Funding

Dates

Caltech Custom Metadata

Development of systematic uncertainty-aware neural network trainings for binned-likelihood analyses at the LHC

Creators

Abstract

Copyright and License

Acknowledgement

Data Availability

Code Availability

Files

s10052-025-14713-w.pdf

Files (2.9 MB)

Additional details

Related works

Funding

Dates

Caltech Custom Metadata