Copyright 2020 Society of Photo-Optical Instrumentation Engineers. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
All documents in ORBi are protected by a user license.
[en] The Exoplanet Imaging Data Challenge is a community-wide effort meant to offer a platform for a fair and common comparison of image processing methods designed for exoplanet direct detection. For this purpose, it gathers on a dedicated repository (Zenodo), data from several high-contrast ground-based instruments worldwide in which we injected synthetic planetary signals. The data challenge is hosted on the CodaLab competition platform, where participants can upload their results. The specifications of the data challenge are published on our website https://exoplanet-imaging-challenge.github.io/ . The first phase, launched on the 1st of September 2019 and closed on the 1st of October 2020, consisted in detecting point sources in two types of common data-set in the field of high-contrast imaging: data taken in pupil-tracking mode at one wavelength (subchallenge 1, also referred to as ADI) and multispectral data taken in pupil-tracking mode (subchallenge 2, also referred to as ADI+mSDI). In this paper, we describe the approach, organisational lessons-learnt and current limitations of the data challenge, as well as preliminary results of the participants’ submissions for this first phase. In the future, we plan to provide permanent access to the standard library of data sets and metrics, in order to guide the validation and support the publications of innovative image processing algorithms dedicated to high-contrast imaging of planetary systems.
Research center :
Montefiore Institute - Montefiore Institute of Electrical Engineering and Computer Science - ULiège STAR - Space sciences, Technologies and Astrophysics Research - ULiège Telim
Disciplines :
Space science, astronomy & astrophysics
Author, co-author :
Cantalloube, F.
Gomez Gonzalez, Carlos
Absil, Olivier ; Université de Liège - ULiège > Département d'astrophys., géophysique et océanographie (AGO) > PSILab
Cantero Mitjans, Carles ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Big Data
Bacher, R.
Bonse, M. J.
Bottom, M.
Dahlqvist, Carl-Henrik ; Université de Liège - ULiège > Département d'astrophys., géophysique et océanographie (AGO) > PSILab
Desgrange, C.
Flasseur, O.
Fuhrmann, T.
Henning, Th.
Jensen-Clem, R.
Kenworthy, M.
Mawet, D.
Mesa, D.
Meshkat, T.
Mouillet, D.
Müller, A.
Nasedkin, E.
Pairet, B.
Pierard, Sébastien ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Télécommunications
Ruffio, J.-B.
Samland, M.
Stone, J.
Van Droogenbroeck, Marc ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Télécommunications
Marois, C., Lafrenìere, D., Doyon, R., Macintosh, B., and Nadeau, D., "Angular Differential Imaging: A Powerful High-Contrast Imaging Technique," 641, 556-564 (Apr. 2006).
Beuzit, J. L., Vigan, A., Mouillet, D., Dohlen, K., Gratton, R., Boccaletti, A., Sauvage, J. F., Schmid, H. M., Langlois, M., Petit, C., Baruffolo, A., Feldt, M., Milli, J., Wahhaj, Z., Abe, L., Anselmi, U., Antichi, J., Barette, R., Baudrand, J., Baudoz, P., Bazzon, A., Bernardi, P., Blanchard, P., Brast, R., Bruno, P., Buey, T., Carbillet, M., Carle, M., Cascone, E., Chapron, F., Charton, J., Chauvin, G., Claudi, R., Costille, A., De Caprio, V., de Boer, J., Delboulbé, A., Desidera, S., Dominik, C., Downing, M., Dupuis, O., Fabron, C., Fantinel, D., Farisato, G., Feautrier, P., Fedrigo, E., Fusco, T., Gigan, P., Ginski, C., Girard, J., Giro, E., Gisler, D., Gluck, L., Gry, C., Henning, T., Hubin, N., Hugot, E., Incorvaia, S., Jaquet, M., Kasper, M., Lagadec, E., Lagrange, A. M., Le Coroller, H., Le Mignant, D., Le Ruyet, B., Lessio, G., Lizon, J. L., Llored, M., Lundin, L., Madec, F., Magnard, Y., Marteaud, M., Martinez, P., Maurel, D., Ménard, F., Mesa, D., Möller-Nilsson, O., Moulin, T., Moutou, C., Origné, A., Parisot, J., Pavlov, A., Perret, D., Pragt, J., Puget, P., Rabou, P., Ramos, J., Reess, J. M., Rigal, F., Rochat, S., Roelfsema, R., Rousset, G., Roux, A., Saisse, M., Salasnich, B., Santambrogio, E., Scuderi, S., Segransan, D., Sevin, A., Siebenmorgen, R., Soenke, C., Stadler, E., Suarez, M., Tiphène, D., Turatto, M., Udry, S., Vakili, F., Waters, L. B. F. M., Weber, L., Wildi, F., Zins, G., and Zurlo, A., "SPHERE: the exoplanet imager for the Very Large Telescope," 631, A155 (Nov 2019).
Dohlen, K., Langlois, M., Saisse, M., Hill, L., Origne, A., Jacquet, M., Fabron, C., Blanc, J.-C., Llored, M., Carle, M., Moutou, C., Vigan, A., Boccaletti, A., Carbillet, M., Mouillet, D., and Beuzit, J.-L., "The infra-red dual imaging and spectrograph for sphere: design and performance," (2008).
Serabyn, E., Huby, E., Matthews, K., Mawet, D., Absil, O., Femenia, B., Wizinowich, P., Karlsson, M., Bottom, M., Campbell, R., et al., "The wm keck observatory infrared vortex coronagraph and a first image of hip 79124 b," The Astronomical Journal 153(1), 43 (2017).
Skrutskie, M., Jones, T., Hinz, P., Garnavich, P., Wilson, J., Nelson, M., Solheid, E., Durney, O., Hoffmann, W., Vaitheeswaran, V., et al., "The large binocular telescope mid-infrared camera (lmircam): final design and status," in [Ground-based and Airborne Instrumentation for Astronomy III], 7735, 77353H, International Society for Optics and Photonics (2010).
Fusco, T., Rousset, G., Sauvage, J.-F., Petit, C., Beuzit, J.-L., Dohlen, K., Mouillet, D., Charton, J., Nicolle, M., Kasper, M., Baudoz, P., and Puget, P., "High-order adaptive optics requirements for direct detection of extrasolar planets: Application to the SPHERE instrument," Optics Express 14, 7515 (2006).
Soummer, R., "Apodized Pupil Lyot Coronagraphs for Arbitrary Telescope Apertures," 618, L161-L164 (Jan. 2005).
Vigan, A., Moutou, C., Langlois, M., Allard, F., Boccaletti, A., Carbillet, M., Mouillet, D., and Smith, I., "Photometric characterization of exoplanets using angular and spectral differential imaging," 407, 71-82 (Sept. 2010).
Wizinowich, P., Acton, D., Shelton, C., Stomski, P., Gathright, J., Ho, K., Lupton, W., Tsubota, K., Lai, O., Max, C., et al., "First light adaptive optics images from the keck ii telescope: a new era of high angular resolution imagery," Publications of the Astronomical Society of the Pacific 112(769), 315 (2000).
Mawet, D., Riaud, P., Absil, O., and Surdej, J., "Annular Groove Phase Mask Coronagraph," 633, 1191-1200 (Nov. 2005).
Esposito, S., Riccardi, A., Fini, L., Puglisi, A. T., Pinna, E., Xompero, M., Briguglio, R., Quiros-Pacheco, F., Stefanini, P., Guerra, J. C., et al., "First light ao (flao) system for lbt: final integration, acceptance test in europe, and preliminary on-sky commissioning results," in [adaptive Optics Systems II], 7736, 773609, International Society for Optics and Photonics (2010).
Wells, D. C., Greisen, E. W., and Harten, R. H., "FITS-A Flexible Image Transport System," 44, 363 (June 1981).
Delorme, P., Meunier, N., Albert, D., Lagadec, E., Coroller, H. L., Galicher, R., Mouillet, D., Boccaletti, A., Mesa, D., Meunier, J.-C., et al., "The sphere data center: a reference for high contrast imaging processing," arXiv preprint arXiv:1712.06948 (2017).
Pavlov, A., Moller-Nilsson, O., Feldt, M., Henning, T., Beuzit, J.-L., and Mouillet, D., "SPHERE data reduction and handling system: overview, project status, and development," in [advanced Software and Control for Astronomy II], 7019, 701939 (July 2008).
Xuan, W. J., Mawet, D., Ngo, H., Ruane, G., Bailey, V. P., Choquet, E., Absil, O., Alvarez, C, Bryan, M., Cook, T., Femenía Castella, B., Gomez Gonzalez, C, Huby, E., Knutson, H. A., Matthews, K., Ragland, S., Serabyn, E., and Zawol, Z., "Characterizing the Performance of the NIRC2 Vortex Coronagraph at W. M. Keck Observatory," 156, 156 (Oct. 2018).
Stone, J. M., Skemer, A. J., Hinz, P. M., Bonavita, M., Kratter, K. M., Maire, A.-L., Defrere, D., Bailey, V. P., Spalding, E., Leisenring, J. M., Desidera, S., Bonnefoy, M., Biller, B., Woodward, C. E., Henning, T., Skrutskie, M. F., Eisner, J. A., Crepp, J. R., Patience, J., Weigelt, G., De Rosa, R. J., Schlieder, J., Brandner, W., Apai, D., Su, K., Ertel, S., Ward-Duong, K., Morzinski, K. M., Schertl, D., Hofmann, K.-H., Close, L. M., Brems, S. S., Fortney, J. J., Oza, A., Buenzli, E., and Bass, B., "The LEECH Exoplanet Imaging Survey: Limits on Planet Occurrence Rates under Conservative Assumptions," 156, 286 (Dec. 2018).
Racine, R., Walker, G. A. H., Nadeau, D., Doyon, R., and Marois, C, "Speckle Noise and the Detection of Faint Companions," 111, 587-594 (May 1999).
Sparks, W. B. and Ford, H. C, "Imaging Spectroscopy for Extrasolar Planet Detection," 578, 543-564 (Oct. 2002).
Antichi, J., Gratton, R. G., Claudi, R. U., Giro, E., Mesa, D., Desidera, S., Scuderi, S., Bruno, P., Turatto, M., Cascone, E., De Caprio, V., Beuzit, J.-L., Puget, P., and Dohlen, K., "Sphere ifs optical concept description and design overview," (2008).
Macintosh, B. A., Graham, J. R., Palmer, D. W., Doyon, R., Dunn, J., Gavel, D. T., Larkin, J., Oppen-heimer, B., Saddlemyer, L., Sivaramakrishnan, A., Wallace, J. K., Bauman, B., Erickson, D. A., Marois, C, Poyneer, L. A., and Soummer, R., "The Gemini Planet Imager: from science to design to construction," in [adaptive Optics Systems], 7015, 701518 (July 2008).
Wang, J. J., Perrin, M. D., Savransky, D., Arriaga, P., Chilcote, J. K., De Rosa, R. J., Millar-Blanchaer, M. A., Marois, C, Rameau, J., Wolff, S. G., Shapiro, J., Ruffio, J.-B., Maire, J., Marchis, F., Graham, J. R., Macintosh, B., Ammons, S. M., Bailey, V. P., Barman, T. S., Bruzzone, S., Bulger, J., Cotten, T., Doyon, R., Duchene, G., Fitzgerald, M. P., Follette, K. B., Goodsell, S., Greenbaum, A. Z., Hibon, P., Hung, L.-W., Ingraham, P., Kalas, P., Konopacky, Q. M., Larkin, J. E., Marley, M. S., Metchev, S., Nielsen, E. L., Oppenheimer, R., Palmer, D. W., Patience, J., Poyneer, L. A., Pueyo, L., Rajan, A., Rantakyro, F. T., Schneider, A. C, Sivaramakrishnan, A., Song, I., Soummer, R., Thomas, S., Wallace, J. K., Ward-Duong, K., and Wiktorowicz, S. J., "Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey," Journal of Astronomical Telescopes, Instruments, and Systems 4, 018002 (Jan. 2018).
Perrin, M. D., Ingraham, P., Follette, K. B., Maire, J., Wang, J. J., Savransky, D., Arriaga, P., Bailey, V. P., Bruzzone, S., Chilcote, J. K., De Rosa, R. J., Draper, Z. H., Fitzgerald, M. P., Greenbaum, A. r. Z., Hung, L.-W., Konopacky, Q., Macintosh, B., Marchis, F., Marois, C, Millar-Blanchaer, M. A., Nielsen, E., Rajan, A., Rameau, J., Rantakyro, F. T., Ruffio, J.-B., Ward-Duong, K., Wolff, S. G., and Zalesky, J., "Gemini Planet Imager observational calibrations XI: pipeline improvements and enhanced calibrations after two years on sky," in [Ground-based and Airborne Instrumentation for Astronomy VI], Evans, C. J., Simard, L., and Takami, H., eds., Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series 9908, 990837 (Aug. 2016).
Gonzalez, C. A. G., Wertz, O., Absil, O., Christiaens, V., Defrère, D., Mawet, D., Milli, J., Absil, P.-A., Van Droogenbroeck, M., Cantalloube, F., et al., "Vip: Vortex image processing package for high-contrast direct imaging," The Astronomical Journal 154(1), 7 (2017).
Amara, A. and Quanz, S. P., "PYNPOINT: an image processing package for finding exoplanets," 427, 948-955 (Dec. 2012).
Soummer, R., Pueyo, L., and Larkin, J., "Detection and Characterization of Exoplanets and Disks Using Projections on Karhunen-Lòeve Eigenimages," 755, L28 (Aug. 2012).
Burgasser, A. J., "The SpeX Prism Library: 1000+ low-resolution, near-infrared spectra of ultracool M, L, T and Y dwarfs," in [astronomical Society of India Conference Series], Astronomical Society of India Conference Series 11, 7-16 (Jan. 2014).
Cantalloube, F., Mouillet, D., Mugnier, L. M., Milli, J., Absil, O., Gomez Gonzalez, C. A., Chauvin, G., Beuzit, J. L., and Cornia, A., "Direct exoplanet detection and characterization using the ANDROMEDA method: Performance on VLT/NaCo data," 582, A89 (Oct. 2015).
Galicher, R., Boccaletti, A., Mesa, D., Delorme, P., Gratton, R., Langlois, M., Lagrange, A.-M., Maire, A.-L., Le Coroller, H., Chauvin, G., et al., "Astrometric and photometric accuracies in high contrast imaging: The sphere speckle calibration tool (specal)," Astronomy & Astrophysics 615, A92 (2018).
Lafrenìere, D., Marois, C., Doyon, R., Nadeau, D., and Artigau, E., "A New Algorithm for Point-Spread Function Subtraction in High-Contrast Imaging: A Demonstration with Angular Differential Imaging," 660, 770-780 (May 2007).
Marois, C., Correia, C., Galicher, R., Ingraham, P., Macintosh, B., Currie, T., and De Rosa, R., "Gpi psf subtraction with tloci: the next evolution in exoplanet/disk high-contrast imaging," in [adaptive Optics Systems IV], 9148, 91480U, International Society for Optics and Photonics (2014).
Launhardt, R., Henning, T., Quirrenbach, A., Ségransan, D., Avenhaus, H., van Boekel, R., Brems, S. S., Cheetham, A. C., Cugno, G., Girard, J., et al., "Ispy-naco imaging survey for planets around young stars-survey description and results from the first 2.5 years of observations," Astronomy & Astrophysics 635, A162 (2020).
Mesa, D., Gratton, R., Zurlo, A., Vigan, A., Claudi, R. U., Alberi, M., Antichi, J., Baruffolo, A., Beuzit, J. L., Boccaletti, A., Bonnefoy, M., Costille, A., Desidera, S., Dohlen, K., Fantinel, D., Feldt, M., Fusco, T., Giro, E., Henning, T., Kasper, M., Langlois, M., Maire, A. L., Martinez, P., Moeller-Nilsson, O., Mouillet, D., Moutou, C., Pavlov, A., Puget, P., Salasnich, B., Sauvage, J. F., Sissa, E., Turatto, M., Udry, S., Vakili, F., Waters, R., and Wildi, F., "Performance of the VLT Planet Finder SPHERE. II. Data analysis and results for IFS in laboratory," 576, A121 (Apr. 2015).
Chauvin, G., Desidera, S., Lagrange, A.-M., Vigan, A., Feldt, M., Gratton, R., Langlois, M., Cheetham, A., Bonnefoy, M., and Meyer, M., "Shine, the sphere infrared survey for exoplanets," in [SF2A-2017: Proceedings of the Annual meeting of the French Society of Astronomy and Astrophysics], 331-335 (2017).
Pairet, B., Cantalloube, F., Gomez Gonzalez, C. A., Absil, O., and Jacques, L., "STIM map: detection map for exoplanets imaging beyond asymptotic Gaussian residual speckle noise," 487, 2262-2277 (Aug. 2019).
Pairet, B., Signal processing methods for high-contrast observations of planetary systems, PhD thesis, Ph. D. thesis, Université de Louvain-la-Neuve, ICTEAM/ELEN (2020).
Dahlqvist, C.-H., Cantalloube, F., and Absil, O., "Regime-switching model detection map for direct exo-planet detection in adi sequences," Astronomy & Astrophysics 633, A95 (2020).
Ren, B., Pueyo, L., Zhu, G. B., Debes, J., and Duchêne, G., "Non-negative matrix factorization: robust extraction of extended structures," The Astrophysical Journal 852(2), 104 (2018).
Gonzalez, C. G., Absil, O., Absil, P.-A., Van Droogenbroeck, M., Mawet, D., and Surdej, J., "Low-rank plus sparse decomposition for exoplanet detection in direct-imaging adi sequences-the llsg algorithm," Astronomy & Astrophysics 589, A54 (2016).
Ruffio, J.-B., Macintosh, B., Wang, J. J., Pueyo, L., Nielsen, E. L., De Rosa, R. J., Czekala, I., Marley, M. S., Arriaga, P., Bailey, V. P., et al., "Improving and assessing planet sensitivity of the gpi exoplanet survey with a forward model matched filter," The Astrophysical Journal 842(1), 14 (2017).
Wang, J. J., Ruffio, J.-B., De Rosa, R. J., Aguilar, J., Wolff, S. G., and Pueyo, L., "pyKLIP: PSF Subtraction for Exoplanets and Disks," (June 2015).
Nielsen, E. L., De Rosa, R. J., Macintosh, B., Wang, J. J., Ruffio, J.-B., Chiang, E., Marley, M. S., Saumon, D., Savransky, D., Ammons, S. M., Bailey, V. P., Barman, T., Blain, C., Bulger, J., Burrows, A., Chilcote, J., Cotten, T., Czekala, I., Doyon, R., Duchêne, G., Esposito, T. M., Fabrycky, D., Fitzgerald, M. P., Follette, K. B., Fortney, J. J., Gerard, B. L., Goodsell, S. J., Graham, J. R., Greenbaum, A. Z., Hibon, P., Hinkley, S., Hirsch, L. A., Hom, J., Hung, L.-W., Dawson, R. I., Ingraham, P., Kalas, P., Konopacky, Q., Larkin, J. E., Lee, E. J., Lin, J. W., Maire, J., Marchis, F., Marois, C., Metchev, S., Millar-Blanchaer, M. A., Morzinski, K. M., Oppenheimer, R., Palmer, D., Patience, J., Perrin, M., Poyneer, L., Pueyo, L., Rafikov, R. R., Rajan, A., Rameau, J., Rantakyrö, F. T., Ren, B., Schneider, A. C., Sivaramakrishnan, A., Song, I., Soummer, R., Tallis, M., Thomas, S., Ward-Duong, K., and Wolff, S., "The Gemini Planet Imager Exoplanet Survey: Giant Planet and Brown Dwarf Demographics from 10 to 100 au," 158, 13 (July 2019).
Flasseur, O., Denis, L., Thiébaut, E., and Langlois, M., "Exoplanet detection in angular differential imaging by statistical learning of the nonstationary patch covariances. The PACO algorithm," 618, A138 (Oct. 2018).
Samland, M., Bouwman, J., Hogg, D. W., Brandner, W., Henning, T., and Janson, M., "TRAP: A temporal systematics model for improved direct detection of exoplanets at small angular separations," arXiv e-prints, arXiv:2011.12311 (Nov. 2020).
Gonzalez, C. G., Absil, O., and Van Droogenbroeck, M., "Supervised detection of exoplanets in high-contrast imaging sequences," Astronomy & Astrophysics 613, A71 (2018).
Flasseur, O., Denis, L., Thiébaut, E., and Langlois, M., "Paco asdi: an algorithm for exoplanet detection and characterization in direct imaging with integral field spectrographs," Astronomy & Astrophysics 637, A9 (2020).
Kasper, M., Arsenault, R., Käufl, U., Jakob, G., Leveratto, S., Zins, G., Pantin, E., Duhoux, P., Riquelme, M., Kirchbauer, J. P., Kolb, J., Pathak, P., Siebenmorgen, R., Soenke, C., Fuenteseca, E., Sterzik, M., Ageorges, N., Gutruf, S., Kampf, D., Reutlinger, A., Absil, O., Delacroix, C., Maire, A. L., Huby, E., Guyon, O., Klupar, P., Mawet, D., Ruane, G., Karlsson, M., Dohlen, K., Vigan, A., N'Diaye, M., Quanz, S., and Carlotti, A., "NEAR: First Results from the Search for Low-Mass Planets in a Cen," The Messenger 178, 5-9 (Dec. 2019).
Hoeijmakers, H. J., Schwarz, H., Snellen, I. A. G., de Kok, R. J., Bonnefoy, M., Chauvin, G., Lagrange, A. M., and Girard, J. H., "Medium-resolution integral-field spectroscopy for high-contrast exoplanet imaging. Molecule maps of the ß Pictoris system with SINFONI," 617, A144 (Oct. 2018).
Haffert, S. Y., Bohn, A. J., de Boer, J., Snellen, I. A. G., Brinchmann, J., Girard, J. H., Keller, C. U., and Bacon, R., "Two accreting protoplanets around the young star PDS 70," Nature Astronomy 3, 749-754 (June 2019).
