Cargando…

Shallow Univariate ReLU Networks as Splines: Initialization, Loss Surface, Hessian, and Gradient Flow Dynamics

Understanding the learning dynamics and inductive bias of neural networks (NNs) is hindered by the opacity of the relationship between NN parameters and the function represented. Partially, this is due to symmetries inherent within the NN parameterization, allowing multiple different parameter setti...

Descripción completa

Detalles Bibliográficos
Autores principales:	Sahs, Justin, Pyle, Ryan, Damaraju, Aneel, Caro, Josue Ortega, Tavaslioglu, Onur, Lu, Andy, Anselmi, Fabio, Patel, Ankit B.
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	Frontiers Media S.A. 2022
Materias:	Artificial Intelligence
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9131019/ https://www.ncbi.nlm.nih.gov/pubmed/35647529 http://dx.doi.org/10.3389/frai.2022.889981

Ejemplares similares

Studying the Evolution of Neural Activation Patterns During Training of Feed-Forward ReLU Networks
por: Hartmann, David, et al.
Publicado: (2021)

Understanding Robustness and Generalization of Artificial Neural Networks Through Fourier Masks
por: Karantzas, Nikos, et al.
Publicado: (2022)

An Empirical Investigation Into Deep and Shallow Rule Learning
por: Beck, Florian, et al.
Publicado: (2021)

Integrating geometries of ReLU feedforward neural networks
por: Liu, Yajing, et al.
Publicado: (2023)

Training a Two-Layer ReLU Network Analytically
por: Barbu, Adrian
Publicado: (2023)

Improved Geometric Path Enumeration for Verifying ReLU Neural Networks
por: Bak, Stanley, et al.
Publicado: (2020)

A Cooperative Lightweight Translation Algorithm Combined with Sparse-ReLU
por: Xu, Xintao, et al.
Publicado: (2022)

Multimodal transistors as ReLU activation functions in physical neural network classifiers
por: Surekcigil Pesch, Isin, et al.
Publicado: (2022)

Predicting energy use in construction using Extreme Gradient Boosting
por: Han, Jiaming, et al.
Publicado: (2023)

Learning with privileged and sensitive information: a gradient-boosting approach
por: Yan, Siwen, et al.
Publicado: (2023)

Optimization of the image acquisition procedure in low-field MRI for non-destructive analysis of loin using predictive models
por: Caballero, Daniel, et al.
Publicado: (2021)

Quantum readout and gradient deep learning model for secure and sustainable data access in IWSN
por: Alzubi, Omar A.
Publicado: (2022)

Stacked ensemble deep learning for pancreas cancer classification using extreme gradient boosting
por: Bakasa, Wilson, et al.
Publicado: (2023)

Domain Adaptation Using Convolutional Autoencoder and Gradient Boosting for Adverse Events Prediction in the Intensive Care Unit
por: Zhu, Yuanda, et al.
Publicado: (2022)

Data augmentation-based conditional Wasserstein generative adversarial network-gradient penalty for XSS attack detection system
por: Mokbal, Fawaz Mahiuob Mohammed, et al.
Publicado: (2020)

Machine learning-based prediction of hospital prolonged length of stay admission at emergency department: a Gradient Boosting algorithm analysis
por: Zeleke, Addisu Jember, et al.
Publicado: (2023)

ReLU-FCM trained by quasi-oppositional bare bone imperialist competition algorithm for predicting employment rate
por: Guo, Aihua
Publicado: (2022)

Artificial intelligence for analyzing orthopedic trauma radiographs: Deep learning algorithms—are they on par with humans for diagnosing fractures?
por: Olczak, Jakub, et al.
Publicado: (2017)

Design Characteristics of Studies Reporting the Performance of Artificial Intelligence Algorithms for Diagnostic Analysis of Medical Images: Results from Recently Published Papers
por: Kim, Dong Wook, et al.
Publicado: (2019)

Mysteries, Epistemological Modesty, and Artificial Intelligence in Surgery
por: Loftus, Tyler J., et al.
Publicado: (2020)

A Frequency-Domain Machine Learning Method for Dual-Calibrated fMRI Mapping of Oxygen Extraction Fraction (OEF) and Cerebral Metabolic Rate of Oxygen Consumption (CMRO(2))
por: Germuska, Michael, et al.
Publicado: (2020)

Artificial intelligence-guided tissue analysis combined with immune infiltrate assessment predicts stage III colon cancer outcomes in PETACC08 study
por: Reichling, Cynthia, et al.
Publicado: (2020)

Bringing Big Data to Bear in Environmental Public Health: Challenges and Recommendations
por: Comess, Saskia, et al.
Publicado: (2020)

On the Adaptability of Recurrent Neural Networks for Real-Time Jazz Improvisation Accompaniment
por: Kritsis, Kosmas, et al.
Publicado: (2021)

Case Report: Utilizing AI and NLP to Assist with Healthcare and Rehabilitation During the COVID-19 Pandemic
por: Carriere, Jay, et al.
Publicado: (2021)

A survey on exponential random graph models: an application perspective
por: Ghafouri, Saeid, et al.
Publicado: (2020)

Effects of data count and image scaling on Deep Learning training
por: Hirahara, Daisuke, et al.
Publicado: (2020)

Deep learning based Sequential model for malware analysis using Windows exe API Calls
por: Catak, Ferhat Ozgur, et al.
Publicado: (2020)

Data augmentation based malware detection using convolutional neural networks
por: Catak, Ferhat Ozgur, et al.
Publicado: (2021)

Leveraging aspect phrase embeddings for cross-domain review rating prediction
por: Jiang, Aiqi, et al.
Publicado: (2019)

Conformational Changes of the Receptor Binding Domain of SARS-CoV-2 Spike Protein and Prediction of a B-Cell Antigenic Epitope Using Structural Data
por: Khare, Sangeeta, et al.
Publicado: (2021)

A real-time approach of diagnosing rice leaf disease using deep learning-based faster R-CNN framework
por: Bari, Bifta Sama, et al.
Publicado: (2021)

Strategy to improve the accuracy of convolutional neural network architectures applied to digital image steganalysis in the spatial domain
por: Tabares-Soto, Reinel, et al.
Publicado: (2021)

Classification model for accuracy and intrusion detection using machine learning approach
por: Agarwal, Arushi, et al.
Publicado: (2021)

Syntactic- and morphology-based text augmentation framework for Arabic sentiment analysis
por: Duwairi, Rehab, et al.
Publicado: (2021)

Feature-based detection of automated language models: tackling GPT-2, GPT-3 and Grover
por: Fröhling, Leon, et al.
Publicado: (2021)

Food/Non-Food Classification of Real-Life Egocentric Images in Low- and Middle-Income Countries Based on Image Tagging Features
por: Chen, Guangzong, et al.
Publicado: (2021)

Stance detection with BERT embeddings for credibility analysis of information on social media
por: Karande, Hema, et al.
Publicado: (2021)

Multi-level aspect based sentiment classification of Twitter data: using hybrid approach in deep learning
por: Janjua, Sadaf Hussain, et al.
Publicado: (2021)

Knowledge distillation in deep learning and its applications
por: Alkhulaifi, Abdolmaged, et al.
Publicado: (2021)

Cannot write session to /tmp/vufind_sessions/sess_lantb470vkghf5ttk9nru4dem6