{"id":"arxiv/2604.07715","url":"https://arxiv.org/abs/2604.07715","tags":["cs.LG","math.OC"],"score":0,"title":"Mathematical analysis of one-layer neural network with fixed biases, a new activation function and other observations","domain":"cs.LG","source":"arxiv","authors":["Fabricio Macià","Shu Nakamura"],"reviews":0,"subject":"cs.LG","summary":"We analyze a simple one-hidden-layer neural network with ReLU activation functions and fixed biases, with one-dimensional input and output. We study both continuous and discrete versions of the model, and we rigorously prove the convergence of the learning process with the $L^2$ squared loss function and the gradient descent procedure. We also prove the spectral bias property for this learning process. Several conclusions of this analysis are discussed; in particular, regarding the structure and properties that activation functions should possess, as well as the relationships between the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-09","reactions":{}}