Skip to main content

Matrices and Matrix Arithmetic

Matrices and Matrix Arithmetic
Matrices are a foundational element of linear algebra. Matrices are used throughout the fi eld of machine learning in the description of algorithms and processes such as the input data variable (X) when training an algorithm.A matrix is a two-dimensional array of scalars with one or more columns and one or more rows.
Defining a Matrix
We can represent a matrix in Python using a two-dimensional NumPy array. A NumPy array can be constructed given a list of lists. For example, below is a 2 row, 3 column matrix.
# create matrix
from numpy import array
A = array([[1, 2, 3], [4, 5, 6]])
print(A)
o/p:
[[1 2 3]
[4 5 6]]
Matrix Addition
# matrix addition
from numpy import array
# define first matrix
A = array([[1, 2, 3],[4, 5, 6]])
print("Matrix A")
print(A)
# define second matrix
B = array([[1, 2, 3],[4, 5, 6]])
print("Matrix B")
print(B)
# add matrices
C = A + B
print("Matrix C")
print(C)
o/p:
Matrix A
[[1 2 3]
[4 5 6]]
Matrix B
[[1 2 3]
[4 5 6]]
Matrix C
[[ 2 4 6]
[ 8 10 12]]
Matrix Subtraction
# matrix subtraction
from numpy import array
# define first matrix
A = array([[1, 2, 3],[4, 5, 6]])
print("Matrix A")
print(A)
# define second matrix
B = array([[0.5, 0.5, 0.5],[0.5, 0.5, 0.5]])
print("Matrix B")
print(B)
# subtract matrices
C = A - B
print("Matrix C")
print(C)
o/p:
Matrix A
[[1 2 3]
[4 5 6]]
Matrix B
[[ 0.5 0.5 0.5]
[ 0.5 0.5 0.5]]
Matrix C
[[ 0.5 1.5 2.5]
[ 3.5 4.5 5.5]]
Matrix Multiplication (Hadamard Product)
Two matrices with the same size can be multiplied together, and this is often called element-wise matrix multiplication or the Hadamard product. It is not the typical operation meant when referring to matrix multiplication.
# matrix Hadamard product
from numpy import array
# define first matrix
A = array([[1, 2, 3],[4, 5, 6]])
print("Matrix A")
print(A)
# define second matrix
B = array([[1, 2, 3],[4, 5, 6]])
print("Matrix B")
print(B)
# multiply matrices
C = A * B
print("Matrix C")
print(C)
o/p:
Matrix A
[[1 2 3]
[4 5 6]]
Matrix B
[[1 2 3]
[4 5 6]]
Matrix C
[[ 1 4 9]
[16 25 36]]
Matrix Division
# matrix division
from numpy import array
# define first matrix
A = array([[1, 2, 3],[4, 5, 6]])
print("Matrix A")
print(A)
# define second matrix
B = array([[1, 2, 3],[4, 5, 6]])
print("Matrix B")
print(B)
# divide matrices
C = A / B
print("Matrix C")
print(C)
o/p:
Matrix A
[[1 2 3]
[4 5 6]]
Matrix B
[[1 2 3]
[4 5 6]]
Matrix C
[[ 1. 1. 1.]
[ 1. 1. 1.]]
Matrix-Matrix Multiplication
Matrix multiplication, also called the matrix dot product is more complicated than the previous
operations and involves a rule as not all matrices can be multiplied together.
C = A.B
or
C = AB
The rule for matrix multiplication is as follows:
The number of columns (n) in the rst matrix (A) must equal the number of rows (m) in
the second matrix (B).
For example, matrix A has the dimensions m rows and n columns and matrix B has the dimensions n and k. The n columns in A and n rows in B are equal. The result is a new matrix with m rows and k columns.
C(m; k) = A(m; n) . B(n; k)
# matrix dot product
import numpy as np
# define first matrix
A =np. array([
[1, 2],
[3, 4],
[5, 6]])
print("Matrix A")
print(A)
# define second matrix
B = np.array([
[1, 2],
[3, 4]])
print("Matrix B")
print(B)
# multiply matrices
C = A.dot(B)
print("Matrix C")
print(C)
# multiply matrices with @ operator
D = A @ B
print("Matrix D")
print(D)
print("Matrix E")
E=np.matmul(A,B)
o/p:
Matrix A
[[1 2]
[3 4]
[5 6]]
Matrix B
[[1 2]
[3 4]]
Matrix C
[[ 7 10]
[15 22]
[23 34]]
Matrix D
[[ 7 10]
[15 22]
[23 34]]
Matrix E
[[ 7 10]
[15 22]
[23 34]]

Matrix-Vector Multiplication
A matrix and a vector can be multiplied together as long as the rule of matrix multiplication is observed. Speci cally, that the number of columns in the matrix must equal the number of items in the vector. As with matrix multiplication, the operation can be written using the dot notation. Because the vector only has one column, the result is always a vector.
c = A . v
# matrix-vector multiplication
from numpy import array
# define matrix
A = array([[1, 2],[3, 4],[5, 6]])
print("Matrix A")
print(A)
# define vector
B = array([0.5, 0.5])
print("Matrix B")
print(B)
# multiply
C = A.dot(B)
print("Matrix C")
print(C)
o/p
Matrix A
[[1 2]
[3 4]
[5 6]]
Matrix B
[ 0.5 0.5]
Matrix C
[ 1.5 3.5 5.5]
Matrix-Scalar Multiplication
A matrix can be multiplied by a scalar. This can be represented using the dot notation between
the matrix and the scalar.
C = A. b
# matrix-scalar multiplication
from numpy import array
# define matrix
A = array([[1, 2], [3, 4], [5, 6]])
print("Matrix A")
print(A)
# define scalar
b = 0.5
print("Scalar b")
print(b)
# multiply
C = A * b
print("Matrix C")
print(C)
o/p:
Matrix A
[[1 2]
[3 4]
[5 6]]
Scalar B
0.5
Matrix C
[[ 0.5 1. ]
[ 1.5 2. ]
[ 2.5 3. ]]


Labels:

Comments

Post a Comment

Popular posts from this blog

Mathematics for Machine Learning- CST 284 - KTU Minor Notes - Dr Binu V P

  Introduction About Me Syllabus Course Outcomes and Model Question Paper University Question Papers and Evaluation Scheme -Mathematics for Machine learning CST 284 KTU Overview of Machine Learning What is Machine Learning (video) Learn the Seven Steps in Machine Learning (video) Linear Algebra in Machine Learning Module I- Linear Algebra 1.Geometry of Linear Equations (video-Gilbert Strang) 2.Elimination with Matrices (video-Gilbert Strang) 3.Solving System of equations using Gauss Elimination Method 4.Row Echelon form and Reduced Row Echelon Form -Python Code 5.Solving system of equations Python code 6. Practice problems Gauss Elimination ( contact) 7.Finding Inverse using Gauss Jordan Elimination  (video) 8.Finding Inverse using Gauss Jordan Elimination-Python code Vectors in Machine Learning- Basics 9.Vector spaces and sub spaces 10.Linear Independence 11.Linear Independence, Basis and Dimension (video) 12.Generating set basis and span 13.Rank of a Matrix 14.Linear Mapping...
Post a Comment
Read more

Vectors in Machine Learning

As data scientists we work with data in various formats such as text images and numerical values We often use vectors to represent data in a structured and efficient manner especially in machine learning applications In this blog post we will explore what vectors are in terms of machine learning their significance and how they are used What is a Vector? In mathematics, a vector is a mathematical object that has both magnitude and direction. In machine learning, a vector is a mathematical representation of a set of numerical values. Vectors are usually represented as arrays or lists of numbers, and each number in the list represents a specific feature or attribute of the data. For example, suppose we have a dataset of houses, and we want to predict their prices based on their features such as the number of bedrooms, the size of the house, and the location. We can represent each house as a vector, where each element of the vector represents a specific feature of the house, such as the nu...
Post a Comment
Read more

2.14 Singular Value Decomposition

The Singular Value Decomposition ( SVD) of a matrix is a central matrix decomposition method in linear algebra.It can be applied to all matrices,not only to square matrices and it always exists.It has been referred to as the 'fundamental theorem of linear algebra'( strang 1993). SVD Theorem: Let $A^{m \times n}$ be a rectangular matrix of rank $r \in [0,min(m,n)]$. The SVD of A is a decomposition of the form. $A= U \Sigma V^T $ with an orthogonal matrix $U \in \mathbb{R}^{m \times m}$ with column vectors $u_i, i=1,\ldots,m$ and an orthogonal matrix $V \in \mathbb{R}^{n \times n}$ with column vectors $v_j, j=1,\ldots,n$.Moreover, $\Sigma$ is an $m \times n$ matrix with $\sum_{ii} = \sigma \ge 0$ and $\sigma_{ij}=0, i \ne j$. The diagonal entries $\Sigma_i=1,\ldots,r$ of $\sigma$ are called singular values . $u_i$ are called left singular vectors , and $v_j$ are called right singular vectors .By convention singular values are ordered ie; $\sigma_1 \ge \sigma_2 \ldots \sigma_r \...
Post a Comment
Read more