Matrix multiplication - Wikipedia
https://en.wikipedia.org/wiki/Matrix_multiplicationHistorically, matrix multiplication has been introduced for facilitating and clarifying computations in linear algebra. This strong relationship between matrix multiplication and linear algebra remains fundamental in all mathematics, as well as in physics, chemistry, engineering and computer science. If a vector space has a finite basis, its vectors are each uniquely represented by a finite sequence of scalars, called a coordinate vector, whose elements are the co…
Vector, Matrix, and Tensor Derivatives
cs231n.stanford.edu/vecDerivs.pdfto do matrix math, summations, and derivatives all at the same time. Example. Suppose we have a column vector ~y of length C that is calculated by forming the product of a matrix W that is C rows by D columns with a column vector ~x of length D: ~y = W~x: (1) Suppose we are interested in the derivative of ~y with respect to ~x. A full ...