IAS-LAB PUBLICATIONS

Clear

Improving Existing Segmentators Performance with Zero-Shot Segmentators

Authors: Nanni Loris; Fusaro Daniel; Fantozzi Carlo; Pretto Alberto

Journal: ENTROPY

Published: 2023

DOI: 10.3390/e25111502

This paper explores the potential of using the SAM (Segment-Anything Model) segmentator to enhance the segmentation capability of known methods. SAM is a promptable segmentation system that offers zero-shot generalization to unfamiliar objects and images, eliminating the need for additional training. The open-source nature of SAM allows for easy access and implementation. In our experiments, we aim to improve the segmentation performance by providing SAM with checkpoints extracted from the masks produced by mainstream segmentators, and then merging the segmentation masks provided by these two networks. We examine the “oracle” method (as upper bound baseline performance), where segmentation masks are inferred only by SAM with checkpoints extracted from the ground truth. One of the main contributions of this work is the combination (fusion) of the logit segmentation masks produced by the SAM model with the ones provided by specialized segmentation models such as DeepLabv3+ and PVTv2. This combination allows for a consistent improvement in segmentation performance in most of the tested datasets. We exhaustively tested our approach on seven heterogeneous public datasets, obtaining state-of-the-art results in two of them (CAMO and Butterfly) with respect to the current best-performing method with a combination of an ensemble of mainstream segmentator transformers and the SAM segmentator. The results of our study provide valuable insights into the potential of incorporating the SAM segmentator into existing segmentation techniques. We release with this paper the open-source implementation of our method.

Volume: 25

Keywords: deep learning; ensemble; segmentation; zero-shot segmentator;

A Sol-Gel/Solvothermal Synthetic Approach to Titania Nanoparticles for Raman Thermometry

Authors: Pretto Thomas; Franca Marina; Zani Veronica; Gross Silvia; Pedron Danilo; Pilot Roberto; Signorini Raffaella

Journal: SENSORS

Published: 2023

DOI: 10.3390/s23052596

The accurate determination of the local temperature is one of the most important challenges in the field of nanotechnology and nanomedicine. For this purpose, different techniques and materials have been extensively studied in order to identify both the best-performing materials and the techniques with greatest sensitivity. In this study, the Raman technique was exploited for the determination of the local temperature as a non-contact technique and titania nanoparticles (NPs) were tested as nanothermometer Raman active material. Biocompatible titania NPs were synthesized following a combination of sol-gel and solvothermal green synthesis approaches, with the aim of obtaining pure anatase samples. In particular, the optimization of three different synthesis protocols allowed materials to be obtained with well-defined crystallite dimensions and good control over the final morphology and dispersibility. TiO2 powders were characterized by X-ray diffraction (XRD) analyses and room-temperature Raman measurements, to confirm that the synthesized samples were single-phase anatase titania, and using SEM measurements, which clearly showed the nanometric dimension of the NPs. Stokes and anti-Stokes Raman measurements were collected, with the excitation laser at 514.5 nm (CW Ar/Kr ion laser), in the temperature range of 293–323 K, a range of interest for biological applications. The power of the laser was carefully chosen in order to avoid possible heating due to the laser irradiation. The data support the possibility of evaluating the local temperature and show that TiO2 NPs possess high sensitivity and low uncertainty in the range of a few degrees as a Raman nanothermometer material.

Volume: 23

Keywords: anatase; green synthesis; nanoparticles; nanothermometer; non-contact technique; Raman; temperature;

An MPAI/IEEE International Standard for Audio: Overview of CAE Audio Recording Preservation (ARP) Technology

Authors: Bosi Marina; Canazza Sergio; Russo Alessandro; Pretto Niccolò; Chiariglione Leonardo

Journal: 21101195017

Published: 2023

The Audio Recording Preservation (ARP) technology represents a significant development in the field of audio preservation and is an essential component of the Moving Picture, Audio and Data Coding by Artificial Intelligence (MPAI) Context-based Audio Enhancement (CAE) standard. This standard has been adopted by the IEEE Standard Association as IEEE 3302-2022 and it specifies a range of AI-based technologies for various audio applications, including communication, entertainment, post-production, teleconferencing, and preservation. This article aims to highlight the specific contribution of CAE-ARP technology to audio preservation applications. The CAE-ARP technology has several innovative features that make it a valuable tool in the digitization and preservation of open-reel audio tapes. It leverages automated AI for extracting relevant information from digitized audio files and for creating preservation and access copies. By using the ARP standard, archives can effectively manage all the information stored onto tapes, along with related metadata, to automatically prepare the content for storage and/or immediate use. This technology represents a significant advancement in the field of audio preservation and provides an effective solution for managing small and large collections of open-reel audio tapes.

Pages: 21-28

Noninvasive respiratory support after extubation: a systematic review and network meta-analysis

Authors: Boscolo Annalisa; Pettenuzzo Tommaso; Sella Nicola; Zatta Matteo; Salvagno Michele; Tassone Martina; Pretto Chiara; Peralta Arianna; Muraro Luisa; Zarantonello Francesco; Bruni Andrea; Geraldini Federico; De Cassai Alessandro; Navalesi Paolo; Sella Nicolò; Cassai Alessandro De

Journal: EUROPEAN RESPIRATORY REVIEW

Published: 2023

DOI: 10.1183/16000617.0196-2022

Background The effect of noninvasive respiratory support (NRS), including high-flow nasal oxygen, bilevel positive airway pressure and continuous positive airway pressure (noninvasive ventilation (NIV)), for preventing and treating post-extubation respiratory failure is still unclear. Our objective was to assess the effects of NRS on post-extubation respiratory failure, defined as re-intubation secondary to post-extubation respiratory failure (primary outcome). Secondary outcomes included the incidence of ventilator-associated pneumonia (VAP), discomfort, intensive care unit (ICU) and hospital mortality, ICU and hospital length of stay (LOS), and time to re-intubation. Subgroup analyses considered “prophylactic” versus “therapeutic” NRS application and subpopulations (high-risk, low-risk, post-surgical and hypoxaemic patients). Methods We undertook a systematic review and network meta-analysis (Research Registry: reviewregistry1435). PubMed, Embase, CENTRAL, Scopus and Web of Science were searched (from inception until 22 June 2022). Randomised controlled trials (RCTs) investigating the use of NRS after extubation in ICU adult patients were included. Results 32 RCTs entered the quantitative analysis (5063 patients). Compared with conventional oxygen therapy, NRS overall reduced re-intubations and VAP (moderate certainty). NIV decreased hospital mortality (moderate certainty), and hospital and ICU LOS (low and very low certainty, respectively), and increased discomfort (moderate certainty). Prophylactic NRS did not prevent extubation failure in low-risk or hypoxaemic patients. Conclusion Prophylactic NRS may reduce the rate of post-extubation respiratory failure in ICU patients.

Volume: 32

Deep Learning-Based Medical Images Segmentation of Musculoskeletal Anatomical Structures: A Survey of Bottlenecks and Strategies

Authors: Bonaldi Lorenza; Pretto Andrea; Pirri Carmelo; Uccheddu Francesca; Fontanella Chiara Giulia; Stecco Carla

Journal: BIOENGINEERING-BASEL

Published: 2023

DOI: 10.3390/bioengineering10020137

By leveraging the recent development of artificial intelligence algorithms, several medical sectors have benefited from using automatic segmentation tools from bioimaging to segment anatomical structures. Segmentation of the musculoskeletal system is key for studying alterations in anatomical tissue and supporting medical interventions. The clinical use of such tools requires an understanding of the proper method for interpreting data and evaluating their performance. The current systematic review aims to present the common bottlenecks for musculoskeletal structures analysis (e.g., small sample size, data inhomogeneity) and the related strategies utilized by different authors. A search was performed using the PUBMED database with the following keywords: deep learning, musculoskeletal system, segmentation. A total of 140 articles published up until February 2022 were obtained and analyzed according to the PRISMA framework in terms of anatomical structures, bioimaging techniques, pre/post-processing operations, training/validation/testing subset creation, network architecture, loss functions, performance indicators and so on. Several common trends emerged from this survey; however, the different methods need to be compared and discussed based on each specific case study (anatomical region, medical imaging acquisition setting, study population, etc.). These findings can be used to guide clinicians (as end users) to better understand the potential benefits and limitations of these tools.

Volume: 10

Keywords: anatomical structures; artificial intelligence; CT; deep learning; medical imaging; MRI; musculoskeletal system; segmentation; ultrasonography; X-ray;

Anatase Nanoparticles for Raman Nanothermometry

Authors: Pretto Thomas; Franca Marina; Zani Veronica; Gross Silvia; Pedron Danilo; Pilot Roberto; Signorini Raffaella

Journal: 21100856785

Published: 2023

DOI: 10.11159/icnnfc23.122

The determination of the local temperature is an interesting and intriguing topic in the nanotechnology and nanomedicine world, in terms of tuning the best noninvasive measurement protocol and identification of the more versatile and performing material. In this paper, the Raman technique and titania NPs have been exploited for the realization of a new optical nanotermometer. Biocompatible titania NPs have been properly synthesized, following a combination of sol-gel and solvothermal green synthesis approaches, with the aim of obtaining samples of pure anatase, characterized by crystallite dimensions defined and good control over the final morphology and dispersibility. Powder XRD measurements and room temperature Raman measurements confirmed that the synthesized samples are single-phase anatase. The SEM images clearly showed the nanometric dimension of NPs. Stokes and anti-Stokes Raman measurements, collected with the excitation laser at 514.5 nm (CW Ar/Kr ion laser), substantiate the possibility of evaluating the local temperature, which has been tested in the range of 298 – 313 K, a range of interest for biological applications. The power of the laser has been carefully chosen in order to avoid eventual heating due to the laser irradiation. The data show that TiO2 NPs possess a high sensitivity and low uncertainty in the range of a few degrees as Raman nanothermometer material.

Keywords: Anatase; Green synthesis; Nanoparticles; Nanothermometer; Non-contact technique; Raman; Temperature;

Improving Generalization of Synthetically Trained Sonar Image Descriptors for Underwater Place Recognition

Authors: Donadi Ivano; Olivastri Emilio; Li Wanmeng; Evangelista Daniele; Pretto Alberto; Fusaro Daniel

Journal: COMPUTER VISION SYSTEMS, ICVS 2023

Published: 2023

DOI: 10.1007/978-3-031-44137-0_28

Autonomous navigation in underwater environments presents challenges due to factors such as light absorption and water turbidity, limiting the effectiveness of optical sensors. Sonar systems are commonly used for perception in underwater operations as they are unaffected by these limitations. Traditional computer vision algorithms are less effective when applied to sonar-generated acoustic images, while convolutional neural networks (CNNs) typically require large amounts of labeled training data that are often unavailable or difficult to acquire. To this end, we propose a novel compact deep sonar descriptor pipeline that can generalize to real scenarios while being trained exclusively on synthetic data. Our architecture is based on a ResNet18 back-end and a properly parameterized random Gaussian projection layer, whereas input sonar data is enhanced with standard ad-hoc normalization/prefiltering techniques. A customized synthetic data generation procedure is also presented. The proposed method has been evaluated extensively using both synthetic and publicly available real data, demonstrating its effectiveness compared to state-of-the-art methods.

Volume: 14253 Pages: 336-349

Keywords: Place Recognition; Sonar Imaging; Underwater Robotics;

SUBLINEAR ALGORITHMS FOR LOCAL GRAPH-CENTRALITY ESTIMATION*

Authors: Bressan Marco; Peserico Enoch; Pretto Luca

Journal: SIAM JOURNAL ON COMPUTING

Published: 2023

DOI: 10.1137/19M1266976

We study the complexity of local graph-centrality estimation, with the goal of approximating the centrality score of a given target node while exploring only a sublinear number of nodes/arcs of the graph and performing a sublinear number of elementary operations. We develop a technique, which we apply to PageRank and Heat Kernel, for constructing a low-variance score estimator through a local exploration of the graph. We obtain an algorithm that, given any node in any graph of n nodes and m arcs, with probability (1-delta) computes a multiplicative (1pmepsilon)-approximation of its score by examining only O~(min(n1/2Delta1/2,n1/2m1/4)) nodes/arcs, where Delta is the maximum outdegree of the graph and poly(epsilon-1) and polylog(delta-1) factors are omitted for readability. A similar bound holds for computational cost. We also prove a lower bound of Omega(min(n1/2Delta1/2, n1/3m1/3)) for both query complexity and computational complexity. Moreover, in the jump-and-crawl graph-access model, our technique yields a O~(min(n1/2Delta1/2,n2/3))-queries algorithm; we show that this algorithm is optimal up to a logarithmic factor-in fact, sublogarithmic in the case of PageRank. These are the first algorithms with sublinear worst-case bounds for general directed graphs and any choice of the target node.

Volume: 52 Pages: 968-1008

Keywords: computational complexity; graph centrality; Heat Kernel; local algorithms; PageRank; query complexity; random walks; sublinear algorithms;

Automatic Segmentation of Stomach of Patients Affected by Obesity

Authors: Pretto Andrea; Toniolo Ilaria; Berardo Alice; Savio Gianpaolo; Perretta Silvana; Carniel Emanuele Luigi; Uccheddu Francesca

Journal: 21100431311

Published: 2023

DOI: 10.1007/978-3-031-15928-2_24

Due to the increasing number of people with severe obesity, the demand for patient-specific modelling in bariatric surgery (BS) is increasing because its potentialities in the improvement of surgical planning, optimization of outcomes and prediction of the mechanical response of the stomach. However, the patient-specific anatomical reconstruction is a pivotal and often time-consuming step due to the lack of efficient and fully automatized tools. Ongoing studies on multi-organ segmentation methods based on neural networks for magnetic resonance images (MRI) are currently available, but they have still several limits, mainly due to both the highly flexible individuals anatomical properties, and convolutional neural networks (CNN) trained only in the detection of physiological stomachs. The aim of this work is to perform a convenient transfer learning from a general-purpose CNN, able to improve the performance in automatically detecting the stomach region of patients with severe obesity. The proposed approach represents the basis for the development of pre- and post-surgical computational models for rapid clinical analysis, especially to boost the mechanical stimulation of gastric receptors. The segmentation masks and the corresponding 3D models were compared with the corresponding manual MRI segmentation as ground truth. Intersection Over Union (IOU) and DICE coefficients (DICE) were used to evaluate 2D masks segmentation, while the Relative Volume Error (RVE), mean surface distance (MSD), standard deviation and the Normalised Hausdorff distance (NHD) were applied to assess the obtained 3D results.

Pages: 276-285

Keywords: Bariatric surgery; Image segmentation; MRI; Stomach;

Euclid preparation – XXIII. Derivation of galaxy physical properties with deep machine learning using mock fluxes and H-band images

Authors: AREA MIN. 02 - Scienze fisiche; MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY###0035-8711; HNI-9120-2023; IRB-5227-2023; I-6985-2013; O-9495-2015; J-2774-2019; B-4650-2017; EQT-2114-2022; M-4118-2013; GFK-2340-2022; GDK-6541-2022; ABC-8644-2021; H-4394-2019; EDW-5764-2022; EJM-8740-2022; CDR-2303-2022; C-4378-2014; HMR-4007-2023; EKV-4052-2022; DVB-2560-2022; L-8385-2017; M-2616-2015; AAG-7753-2020; GBO-0318-2022; E-2727-2014; L-8237-2014; E-8021-2017; IVA-4275-2023; GBS-0220-2022; H-8587-2015; DVC-6323-2022; B-4928-2015; GBN-8818-2022; PGG-2427-2026; C-1574-2008; A-2693-2010; PCA-2324-2025; GBB-1963-2022; EUO-2530-2022; ETL-7525-2022; EUK-3820-2022; J-3686-2012; AAR-6622-2021; CQF-5798-2022; DXA-1952-2022; ITP-9423-2023; DVG-8690-2022; GAZ-3876-2022; DWB-6758-2022; GQH-6424-2022; ABF-7029-2021; DWK-1716-2022; CTE-6775-2022; CSK-3817-2022; CUA-0149-2022; FBF-5584-2022; FBV-0790-2022; CTZ-4163-2022; GBH-2365-2022; DWQ-9372-2022; OOP-8239-2025; DXH-0671-2022; FFG-2233-2022; GEK-4486-2022; DAV-9216-2022; DUU-4676-2022; B-8502-2016; GFM-0308-2022; A-2699-2012; FIV-3763-2022; DWC-8789-2022; DWZ-6747-2022; DFQ-7859-2022; AAH-9937-2020; AAX-3485-2021; D-1300-2016; FNO-5530-2022; GNG-7078-2022; AAB-4321-2020; DVP-3997-2022; FNA-5485-2022; AAW-4410-2021; DWT-4779-2022; DZP-5216-2022; FNB-0821-2022; C-3218-2017; FQP-7090-2022; DWD-4131-2022; DLB-6897-2022; GBD-7573-2022; IVG-7504-2023; FSY-2184-2022; DMX-5934-2022; DNY-0415-2022; K-4114-2015; OON-3882-2025; AFE-8548-2022; HTB-0114-2023; DXL-4304-2022; GCA-5113-2022; FVF-5606-2022; GCT-2940-2022; DXO-8435-2022; H-1761-2016; DXM-5348-2022; DPD-7597-2022; PHJ-7571-2026; IZJ-2041-2023; GBV-4959-2022; I-8498-2012; J-5067-2012; EAA-4768-2022; L-8068-2014; CFK-7257-2022; MQB-6975-2025; Q-2220-2015; T-7378-2018; AAB-2503-2019; GCB-5227-2022; DYT-7473-2022; HNI-8187-2023; GCA-5567-2022; Q-6715-2019; DZU-8266-2022; EAZ-0566-2022; EIA-6036-2022; FYJ-9637-2022; O-9369-2015; GDW-2905-2022; HTG-8587-2023; HTA-5649-2023; GBY-6621-2022; GAU-7672-2022; FLK-4707-2022; FNC-4379-2022; FVK-3262-2022; GFA-3443-2022; P-2194-2018; O-9396-2015; B-3004-2019; AAZ-4907-2020; AAO-6325-2021; CHT-0596-2022; DTO-7937-2022; EPI-1133-2022; O-9391-2015; KDL-3231-2024; JFJ-3489-2023; OZD-6988-2025; KUC-6512-2024; CMH-0439-2022; AGZ-3259-2022; PCU-7129-2025; PDR-7717-2025; ERD-3189-2022; CNT-5485-2022; IDQ-0489-2023; ISC-4027-2023; AAW-1061-2020; CPC-6980-2022; KLD-3528-2024; CRZ-8120-2022; C-2920-2017; PDR-5897-2025; DWN-8747-2022; ABB-8257-2020; JZW-7667-2024; S-8590-2017; GBV-7145-2022; ITW-2356-2023; DWS-1040-2022; HRX-7202-2023; IZP-8032-2023; FZY-7746-2022; DWL-3001-2022; FLM-0394-2022; HUJ-7899-2023; U-7309-2018; DZP-0372-2022; D-1237-2017; PHJ-0952-2026; AAI-1245-2021; AAN-7016-2021; LXV-7382-2024; DYG-8551-2022; FTV-6637-2022; GCY-0967-2022; AAY-8788-2021; GGM-6223-2022; GEF-7978-2022; FXG-6905-2022; FXS-9180-2022; GBG-9412-2022; IYS-3498-2023; GCB-1754-2022; DXU-7894-2022; LXA-1722-2024; ECF-2024-2022; A-9058-2016; DYK-4428-2022; 56426999100; 7003910265; 56261663500; 6602409206; 7004168457; 54924573500; 34569356300; 56276774200; 55538241000; 56257220200; 8842216700; 55929371000; 57374950500; 6701390827; 8651648800; 24482926400; 7102960752; 6506892241; 6602293713; 6701447926; 7004279376; 35117442400; 56592859600; 8316050500; 57193414472; 7004614794; 24439181000; 56260193000; 37121732700; 6507398813; 55757270100; 56018146100; 8856476200; 7004529134; 26663174300; 6603213706; 6701702242; 6506323808; 55978579700; 6601991850; 6602678698; 57200514857; 9639653200; 6506341877; 56592156500; 9535760600; 24173378000; 56261365400; 8724245000; 36657273100; 8527480900; 9270789600; 14008117700; 9337191600; 6603519641; 7202555066; 16024707000; 6603380199; 55539553700; 56216916000; 35227493200; 37123976000; 6701865592; 6506922416; 7102120605; 6603602446; 6603205767; 6603770482; 36195926600; 10239419900; 14025617800; 6506385309; 36933808800; 13407562800; 7102174334; 56229506700; 14056466700; 7005525798; 14832846900; 7004208543; 35299820900; 7004629002; 55668172300; 14050522100; 58095754900; 57203234808; 55913343900; 57544565000; 57203250534; 6602930238; 57190439701; 7006538931; 6506955003; 55337191500; 7402364894; 57225899623; 35350466600; 57190443165; 8915699600; 6603484205; 6603819159; 7004160690; 15129157800; 48663031800; 57218941481; 57022106200; 14063887300; 54797318800; 6602208520; 6602315420; 14823864100; 57220082325; 54790157700; 55414427600; 6507831150; 17436196900; 57203391123; 57191960842; 6701439004; 6602565951; 57191419742; 10244106400; 56273947300; 8042894900; 55595999000; 56176939800; 57225389323; 57189300153; 55543336500; 9244606800; 12809267200; 56403356600; 14058603600; 7102846243; 56512377200; 15069791500; 35194662000; 9333441800; 56134803400; 56818885600; 7004185737; 36905906400; 6603819488; 6602458029; 9337037600; 7103030457; 57090221700; 55948641800; 35112881300; 23485171100; 24069757200; 6701734824; 35072386500; 6602521535; 57199061795; 6701458135; 54402554200; 6602348000; 56181792800; 36627225700; 7004144883; 7003645652; 57206536839; 56242244500; 15131601400; 8833942900; 7006022077; 23050749700; 57218097629; 55885669700; 26642611400; 57210924350; 6508080858; 6701309093; 35070066100; 57815020000; 56463558800; 55779479900; 7101983827; 7006221760; 35422761600; 42262265600; 6603351766; 7003762062; 55194301800; 16031797900; 35113641200; 57220131178; 36495525900; 56881732300; 57219119015; 8833942000; 6506381727; 7005050491; 7004680980; 6701718244; 6504758580; 6506892358; 7003963996

Journal: MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY

Published: 2023

DOI: 10.1093/mnras/stac3810

Next-generation telescopes, like Euclid, Rubin/LSST, and Roman, will open new windows on the Universe, allowing us to infer physical properties for tens of millions of galaxies. Machine-learning methods are increasingly becoming the most efficient tools to handle this enormous amount of data, because they are often faster and more accurate than traditional methods. We investigate how well redshifts, stellar masses, and star-formation rates (SFRs) can be measured with deep-learning algorithms for observed galaxies within data mimicking the Euclid and Rubin/LSST surveys. We find that deep-learning neural networks and convolutional neural networks (CNNs), which are dependent on the parameter space of the training sample, perform well in measuring the properties of these galaxies and have a better accuracy than methods based on spectral energy distribution fitting. CNNs allow the processing of multiband magnitudes together with HE-band images. We find that the estimates of stellar masses improve with the use of an image, but those of redshift and SFR do not. Our best results are deriving (i) the redshift within a normalized error of 3 in the HE band; (ii) the stellar mass within a factor of two (∼0.3 dex) for 99.5 per cent of the considered galaxies; and (iii) the SFR within a factor of two (∼0.3 dex) for ∼70 per cent of the sample. We discuss the implications of our work for application to surveys as well as how measurements of these galaxy parameters can be improved with deep learning.

Volume: 520 Pages: 3529-3548

Keywords: galaxies: evolution; galaxies: general; galaxies: photometry; galaxies: star formation;