 Vector space

This article is about linear (vector) spaces. For the structure in incidence geometry, see Linear space (geometry).
A vector space is a mathematical structure formed by a collection of vectors: objects that may be added together and multiplied ("scaled") by numbers, called scalars in this context. Scalars are often taken to be real numbers, but one may also consider vector spaces with scalar multiplication by complex numbers, rational numbers, or even more general fields instead. The operations of vector addition and scalar multiplication have to satisfy certain requirements, called axioms, listed below. An example of a vector space is that of Euclidean vectors which are often used to represent physical quantities such as forces: any two forces (of the same type) can be added to yield a third, and the multiplication of a force vector by a real factor is another force vector. In the same vein, but in more geometric parlance, vectors representing displacements in the plane or in threedimensional space also form vector spaces.
Vector spaces are the subject of linear algebra and are well understood from this point of view, since vector spaces are characterized by their dimension, which, roughly speaking, specifies the number of independent directions in the space. The theory is further enhanced by introducing on a vector space some additional structure, such as a norm or inner product. Such spaces arise naturally in mathematical analysis, mainly in the guise of infinitedimensional function spaces whose vectors are functions. Analytical problems call for the ability to decide if a sequence of vectors converges to a given vector. This is accomplished by considering vector spaces with additional data, mostly spaces endowed with a suitable topology, thus allowing the consideration of proximity and continuity issues. These topological vector spaces, in particular Banach spaces and Hilbert spaces, have a richer theory.
Historically, the first ideas leading to vector spaces can be traced back as far as 17th century's analytic geometry, matrices, systems of linear equations, and Euclidean vectors. The modern, more abstract treatment, first formulated by Giuseppe Peano in the late 19th century, encompasses more general objects than Euclidean space, but much of the theory can be seen as an extension of classical geometric ideas like lines, planes and their higherdimensional analogs.
Today, vector spaces are applied throughout mathematics, science and engineering. They are the appropriate linearalgebraic notion to deal with systems of linear equations; offer a framework for Fourier expansion, which is employed in image compression routines; or provide an environment that can be used for solution techniques for partial differential equations. Furthermore, vector spaces furnish an abstract, coordinatefree way of dealing with geometrical and physical objects such as tensors. This in turn allows the examination of local properties of manifolds by linearization techniques. Vector spaces may be generalized in several directions, leading to more advanced notions in geometry and abstract algebra.
Contents
Introduction and definition
First example: arrows in the plane
The concept of vector space will first be explained by describing two particular examples. The first example of a vector space consists of arrows in a fixed plane, starting at one fixed point. This is used in physics to describe forces or velocities. Given any two such arrows, v and w, the parallelogram spanned by these two arrows contains one diagonal arrow that starts at the origin, too. This new arrow is called the sum of the two arrows and is denoted v + w. Another operation that can be done with arrows is scaling: given any positive real number a, the arrow that has the same direction as v, but is dilated or shrunk by multiplying its length by a, is called multiplication of v by a. It is denoted a · v. When a is negative, a · v is defined as the arrow pointing in the opposite direction, instead.
The following shows a few examples: if a = 2, the resulting vector a · w has the same direction as w, but is stretched to the double length of w (right image below). Equivalently 2 · w is the sum w + w. Moreover, (−1) · v = −v has the opposite direction and the same length as v (blue vector pointing down in the right image).
Second example: ordered pairs of numbers
A second key example of a vector space is provided by pairs of real numbers x and y. (The order of the components x and y is significant, so such a pair is also called an ordered pair.) Such a pair is written as (x, y). The sum of two such pairs and multiplication of a pair with a number is defined as follows:
 (x_{1}, y_{1}) + (x_{2}, y_{2}) = (x_{1} + x_{2}, y_{1} + y_{2})
and
 a · (x, y) = (ax, ay).
Definition
A vector space over a field F is a set V together with two binary operators that satisfy the eight axioms listed below. Elements of V are called vectors. Elements of F are called scalars. In this article, vectors are differentiated from scalars by boldface.^{[nb 1]} In the two examples above, our set consists of the planar arrows with fixed starting point and of pairs of real numbers, respectively, while our field is the real numbers. The first operation, vector addition, takes any two vectors v and w and assigns to them a third vector which is commonly written as v + w, and called the sum of these two vectors. The second operation takes any scalar a and any vector v and gives another vector a · v. In view of the first example, where the multiplication is done by rescaling the vector v by a scalar a, the multiplication is called scalar multiplication of v by a.
To qualify as a vector space, the set V and the operations of addition and multiplication have to adhere to a number of requirements called axioms.^{[1]} In the list below, let u, v, w be arbitrary vectors in V, and a, b be scalars in F.
Axiom Signification Associativity of addition v_{1} + (v_{2} + v_{3}) = (v_{1} + v_{2}) + v_{3}. Commutativity of addition v_{1} + v_{2} = v_{2} + v_{1}. Identity element of addition There exists an element 0 ∈ V, called the zero vector, such that v + 0 = v for all v ∈ V. Inverse elements of addition For all v ∈ V, there exists an element v ∈ V, called the additive inverse of v, such that v + (v) = 0. Distributivity of scalar multiplication with respect to vector addition s(v_{1} + v_{2}) = sv_{1} + sv_{2}. Distributivity of scalar multiplication with respect to field addition (n_{1} + n_{2})v = n_{1}v + n_{2}v. Respect of scalar multiplication over field's multiplication n_{1} (n_{2} s) = (n_{1} n_{2})s ^{[nb 2]} Identity element of scalar multiplication 1s = s, where 1 denotes the multiplicative identity in F. These axioms generalize properties of the vectors introduced in the above examples. Indeed, the result of addition of two ordered pairs (as in the second example above) does not depend on the order of the summands:
 (x_{v}, y_{v}) + (x_{w}, y_{w}) = (x_{w}, y_{w}) + (x_{v}, y_{v}),
Likewise, in the geometric example of vectors as arrows, v + w = w + v, since the parallelogram defining the sum of the vectors is independent of the order of the vectors. All other axioms can be checked in a similar manner in both examples. Thus, by disregarding the concrete nature of the particular type of vectors, the definition incorporates these two and many more examples in one notion of vector space.
Subtraction of two vectors and division by a (nonzero) scalar can be performed via
 v − w = v + (−w),
 v / a = (1 / a) · v.
The concept introduced above is called a real vector space. The word "real" refers to the fact that vectors can be multiplied by real numbers, as opposed to, say, complex numbers. When scalar multiplication is defined for complex numbers, the denomination complex vector space is used. These two cases are the ones used most often in engineering. The most general definition of a vector space allows scalars to be elements of a fixed field F. Then, the notion is known as Fvector spaces or vector spaces over F. A field is, essentially, a set of numbers possessing addition, subtraction, multiplication and division operations.^{[nb 3]} For example, rational numbers also form a field.
In contrast to the intuition stemming from vectors in the plane and higherdimensional cases, there is, in general vector spaces, no notion of nearness, angles or distances. To deal with such matters, particular types of vector spaces are introduced; see below.
Alternative formulations and elementary consequences
The requirement that vector addition and scalar multiplication be binary operations includes (by definition of binary operations) a property called closure: that u + v and av are in V for all a in F, and u, v in V. Some older sources mention these properties as separate axioms.^{[2]}
In the parlance of abstract algebra, the first four axioms can be subsumed by requiring the set of vectors to be an abelian group under addition. The remaining axioms give this group an Fmodule structure. In other words there is a ring homomorphism ƒ from the field F into the endomorphism ring of the group of vectors. Then scalar multiplication av is defined as (ƒ(a))(v).^{[3]}
There are a number of direct consequences of the vector space axioms. Some of them derive from elementary group theory, applied to the additive group of vectors: for example the zero vector 0 of V and the additive inverse −v of any vector v are unique. Other properties follow from the distributive law, for example av equals 0 if and only if a equals 0 or v equals 0.
History
Further information: History of algebraVector spaces stem from affine geometry, via the introduction of coordinates in the plane or threedimensional space. Around 1636, Descartes and Fermat founded analytic geometry by equating solutions to an equation of two variables with points on a plane curve.^{[4]} To achieve geometric solutions without using coordinates, Bolzano introduced, in 1804, certain operations on points, lines and planes, which are predecessors of vectors.^{[5]} This work was made use of in the conception of barycentric coordinates by Möbius in 1827.^{[6]} The foundation of the definition of vectors was Bellavitis' notion of the bipoint, an oriented segment one of whose ends is the origin and the other one a target. Vectors were reconsidered with the presentation of complex numbers by Argand and Hamilton and the inception of quaternions and biquaternions by the latter.^{[7]} They are elements in R^{2}, R^{4}, and R^{8}; treating them using linear combinations goes back to Laguerre in 1867, who also defined systems of linear equations.
In 1857, Cayley introduced the matrix notation which allows for a harmonization and simplification of linear maps. Around the same time, Grassmann studied the barycentric calculus initiated by Möbius. He envisaged sets of abstract objects endowed with operations.^{[8]} In his work, the concepts of linear independence and dimension, as well as scalar products are present. Actually Grassmann's 1844 work exceeds the framework of vector spaces, since his considering multiplication, too, led him to what are today called algebras. Peano was the first to give the modern definition of vector spaces and linear maps in 1888.^{[9]}
An important development of vector spaces is due to the construction of function spaces by Lebesgue. This was later formalized by Banach and Hilbert, around 1920.^{[10]} At that time, algebra and the new field of functional analysis began to interact, notably with key concepts such as spaces of pintegrable functions and Hilbert spaces.^{[11]} Vector spaces, including infinitedimensional ones, then became a firmly established notion, and many mathematical branches started making use of this concept.
Examples
Main article: Examples of vector spacesCoordinate and function spaces
The first example of a vector space over a field F is the field itself, equipped with its standard addition and multiplication. This is the case n = 1 of a vector space usually denoted F^{n}, known as the coordinate space whose elements are ntuples (sequences of length n):
 (a_{1}, a_{2}, ..., a_{n}), where the a_{i} are elements of F.^{[12]}
The case F = R and n = 2 was discussed in the introduction above. Infinite coordinate sequences, and more generally functions from any fixed set Ω to a field F also form vector spaces, by performing addition and scalar multiplication pointwise. That is, the sum of two functions ƒ and g is given by
 (ƒ + g)(w) = ƒ(w) + g(w)
and similarly for multiplication. Such function spaces occur in many geometric situations, when Ω is the real line or an interval, or other subsets of R^{n}. Many notions in topology and analysis, such as continuity, integrability or differentiability are wellbehaved with respect to linearity: sums and scalar multiples of functions possessing such a property still have that property.^{[13]} Therefore, the set of such functions are vector spaces. They are studied in greater detail using the methods of functional analysis, see below. Algebraic constraints also yield vector spaces: the vector space F[x] is given by polynomial functions:
 ƒ(x) = r_{0} + r_{1}x + ... + r_{n−1}x^{n−1} + r_{n}x^{n}, where the coefficients r_{0}, ..., r_{n} are in F.^{[14]}
Linear equations
Main articles: Linear equation, Linear differential equation, and Systems of linear equationsSystems of homogeneous linear equations are closely tied to vector spaces.^{[15]} For example, the solutions of

a + 3b + c = 0 4a + 2b + 2c = 0
are given by triples with arbitrary a, b = a/2, and c = −5a/2. They form a vector space: sums and scalar multiples of such triples still satisfy the same ratios of the three variables; thus they are solutions, too. Matrices can be used to condense multiple linear equations as above into one vector equation, namely
 Ax = 0,
where A = is the matrix containing the coefficients of the given equations, x is the vector (a, b, c), Ax denotes the matrix product and 0 = (0, 0) is the zero vector. In a similar vein, the solutions of homogeneous linear differential equations form vector spaces. For example
 ƒ''(x) + 2ƒ'(x) + ƒ(x) = 0
yields ƒ(x) = a e^{−x} + bx e^{−x}, where a and b are arbitrary constants, and e^{x} is the natural exponential function.
Field extensions
Field extensions F / E ("F over E") provide another class of examples of vector spaces, particularly in algebra and algebraic number theory: a field F containing a smaller field E becomes an Evector space, by the given multiplication and addition operations of F.^{[16]} For example the complex numbers are a vector space over R. A particularly interesting type of field extension in number theory is Q(α), the extension of the rational numbers Q by a fixed complex number α. Q(α) is the smallest field containing the rationals and a fixed complex number α. Its dimension as a vector space over Q depends on the choice of α.
Bases and dimension
Main articles: Basis and DimensionBases reveal the structure of vector spaces in a concise way. A basis is defined as a (finite or infinite) set B = {v_{i}}_{i ∈ I} of vectors v_{i} indexed by some index set I that spans the whole space, and is minimal with this property. The former means that any vector v can be expressed as a finite sum (called linear combination) of the basis elements
 ,
where the a_{k} are scalars and v_{ik} (k = 1, ..., n) elements of the basis B. Minimality, on the other hand, is made formal by requiring B to be linearly independent. A set of vectors is said to be linearly independent if none of its elements can be expressed as a linear combination of the remaining ones. Equivalently, an equation
can only hold if all scalars a_{1}, ..., a_{n} equal zero. Linear independence ensures that the representation of any vector in terms of basis vectors, the existence of which is guaranteed by the requirement that the basis span V, is unique.^{[17]} This is referred to as the coordinatized viewpoint of vector spaces, by viewing basis vectors as generalizations of coordinate vectors x, y, z in R^{3} and similarly in higherdimensional cases.
The coordinate vectors e_{1} = (1, 0, ..., 0), e_{2} = (0, 1, 0, ..., 0), to e_{n} = (0, 0, ..., 0, 1), form a basis of F^{n}, called the standard basis, since any vector (x_{1}, x_{2}, ..., x_{n}) can be uniquely expressed as a linear combination of these vectors:
 (x_{1}, x_{2}, ..., x_{n}) = x_{1}(1, 0, ..., 0) + x_{2}(0, 1, 0, ..., 0) + ... + x_{n}(0, ..., 0, 1) = x_{1}e_{1} + x_{2}e_{2} + ... + x_{n}e_{n}.
Every vector space has a basis. This follows from Zorn's lemma, an equivalent formulation of the axiom of choice.^{[18]} Given the other axioms of ZermeloFraenkel set theory, the existence of bases is equivalent to the axiom of choice.^{[19]} The ultrafilter lemma, which is weaker than the axiom of choice, implies that all bases of a given vector space have the same number of elements, or cardinality.^{[20]} It is called the dimension of the vector space, denoted dim V. If the space is spanned by finitely many vectors, the above statements can be proven without such fundamental input from set theory.^{[21]}
The dimension of the coordinate space F^{n} is n, by the basis exhibited above. The dimension of the polynomial ring F[x] introduced above is countably infinite, a basis is given by 1, x, x^{2}, ... A fortiori, the dimension of more general function spaces, such as the space of functions on some (bounded or unbounded) interval, is infinite.^{[nb 4]} Under suitable regularity assumptions on the coefficients involved, the dimension of the solution space of a homogeneous ordinary differential equation equals the degree of the equation.^{[22]} For example, the solution space for the above equation is generated by e^{−x} and xe^{−x}. These two functions are linearly independent over R, so the dimension of this space is two, as is the degree of the equation.
The dimension (or degree) of the field extension Q(α) over Q depends on α. If α satisfies some polynomial equation
 q_{n}α^{n} + q_{n−1}α^{n−1} + ... + q_{0} = 0, with rational coefficients q_{n}, ..., q_{0}.
("α is algebraic"), the dimension is finite. More precisely, it equals the degree of the minimal polynomial having α as a root.^{[23]} For example, the complex numbers C are a twodimensional real vector space, generated by 1 and the imaginary unit i. The latter satisfies i^{2} + 1 = 0, an equation of degree two. Thus, C is a twodimensional Rvector space (and, as any field, onedimensional as a vector space over itself, C). If α is not algebraic, the dimension of Q(α) over Q is infinite. For instance, for α = π there is no such equation, in other words π is transcendental.^{[24]}
Linear maps and matrices
Main article: Linear mapThe relation of two vector spaces can be expressed by linear map or linear transformation. They are functions that reflect the vector space structure—i.e., they preserve sums and scalar multiplication:
 ƒ(x + y) = ƒ(x) + ƒ(y) and ƒ(a · x) = a · ƒ(x) for all x and y in V, all a in F.^{[25]}
An isomorphism is a linear map ƒ : V → W such that there exists an inverse map g : W → V, which is a map such that the two possible compositions ƒ ∘ g : W → W and g ∘ ƒ : V → V are identity maps. Equivalently, ƒ is both onetoone (injective) and onto (surjective).^{[26]} If there exists an isomorphism between V and W, the two spaces are said to be isomorphic; they are then essentially identical as vector spaces, since all identities holding in V are, via ƒ, transported to similar ones in W, and vice versa via g.
For example, the vector spaces in the introduction are isomorphic: a planar arrow v departing at the origin of some (fixed) coordinate system can be expressed as an ordered pair by considering the x and ycomponent of the arrow, as shown in the image at the right. Conversely, given a pair (x, y), the arrow going by x to the right (or to the left, if x is negative), and y up (down, if y is negative) turns back the arrow v.
Linear maps V → W between two fixed vector spaces form a vector space Hom_{F}(V, W), also denoted L(V, W).^{[27]} The space of linear maps from V to F is called the dual vector space, denoted V^{∗}.^{[28]} Via the injective natural map V → V^{∗∗}, any vector space can be embedded into its bidual; the map is an isomorphism if and only if the space is finitedimensional.^{[29]}
Once a basis of V is chosen, linear maps ƒ : V → W are completely determined by specifying the images of the basis vectors, because any element of V is expressed uniquely as a linear combination of them.^{[30]} If dim V = dim W, a 1to1 correspondence between fixed bases of V and W gives rise to a linear map that maps any basis element of V to the corresponding basis element of W. It is an isomorphism, by its very definition.^{[31]} Therefore, two vector spaces are isomorphic if their dimensions agree and vice versa. Another way to express this is that any vector space is completely classified (up to isomorphism) by its dimension, a single number. In particular, any ndimensional Fvector space V is isomorphic to F^{n}. There is, however, no "canonical" or preferred isomorphism; actually an isomorphism φ: F^{n} → V is equivalent to the choice of a basis of V, by mapping the standard basis of F^{n} to V, via φ. Appending an automorphism, i.e. an isomorphism ψ: V → V yields another isomorphism ψ∘φ: F^{n} → V, the composition of ψ and φ, and therefore a different basis of V.^{[citation needed]} The freedom of choosing a convenient basis is particularly useful in the infinitedimensional context, see below.
Matrices
Main articles: Matrix and DeterminantMatrices are a useful notion to encode linear maps.^{[32]} They are written as a rectangular array of scalars as in the image at the right. Any mbyn matrix A gives rise to a linear map from F^{n} to F^{m}, by the following
 , where denotes summation,
or, using the matrix multiplication of the matrix A with the coordinate vector x:
 x ↦ Ax.
Moreover, after choosing bases of V and W, any linear map ƒ : V → W is uniquely represented by a matrix via this assignment.^{[33]}
The determinant det (A) of a square matrix A is a scalar that tells whether the associated map is an isomorphism or not: to be so it is sufficient and necessary that the determinant is nonzero.^{[34]} The linear transformation of R^{n} corresponding to a real nbyn matrix is orientation preserving if and only if the determinant is positive.^{[citation needed]}
Eigenvalues and eigenvectors
Main article: Eigenvalues and eigenvectorsEndomorphisms, linear maps ƒ : V → V, are particularly important since in this case vectors v can be compared with their image under ƒ, ƒ(v). Any nonzero vector v satisfying λv = ƒ(v), where λ is a scalar, is called an eigenvector of ƒ with eigenvalue λ.^{[nb 5]}^{[35]} Equivalently, v is an element of the kernel of the difference ƒ − λ · Id (where Id is the identity map V → V). If V is finitedimensional, this can be rephrased using determinants: ƒ having eigenvalue λ is equivalent to
 det (ƒ − λ · Id) = 0.
By spelling out the definition of the determinant, the expression on the left hand side can be seen to be a polynomial function in λ, called the characteristic polynomial of ƒ.^{[36]} If the field F is large enough to contain a zero of this polynomial (which automatically happens for F algebraically closed, such as F = C) any linear map has at least one eigenvector. The vector space V may or may not possess an eigenbasis, a basis consisting of eigenvectors. This phenomenon is governed by the Jordan canonical form of the map.^{[nb 6]} The set of all eigenvectors corresponding to a particular eigenvalue of ƒ forms a vector space known as the eigenspace corresponding to the eigenvalue (and ƒ) in question. To achieve the spectral theorem, the corresponding statement in the infinitedimensional case, the machinery of functional analysis is needed, see below.
Basic constructions
In addition to the above concrete examples, there are a number of standard linear algebraic constructions that yield vector spaces related to given ones. In addition to the definitions given below, they are also characterized by universal properties, which determine an object X by specifying the linear maps from X to any other vector space.
Subspaces and quotient spaces
Main articles: Linear subspace and Quotient vector spaceA nonempty subset W of a vector space V that is closed under addition and scalar multiplication (and therefore contains the 0vector of V) is called a subspace of V.^{[37]} Subspaces of V are vector spaces (over the same field) in their own right. The intersection of all subspaces containing a given set S of vectors is called its span, and is the smallest subspace of V containing the set S. Expressed in terms of elements, the span is the subspace consisting of all the linear combinations of elements of S.^{[38]}
The counterpart to subspaces are quotient vector spaces.^{[39]} Given any subspace W ⊂ V, the quotient space V/W ("V modulo W") is defined as follows: as a set, it consists of v + W = {v + w, w ∈ W}, where v is an arbitrary vector in V. The sum of two such elements v_{1} + W and v_{2} + W is (v_{1} + v_{2}) + W, and scalar multiplication is given by a · (v + W) = (a · v) + W. The key point in this definition is that v_{1} + W = v_{2} + W if and only if the difference of v_{1} and v_{2} lies in W.^{[nb 7]} This way, the quotient space "forgets" information that is contained in the subspace W.
The kernel ker(ƒ) of a linear map ƒ: V → W consists of vectors v that are mapped to 0 in W.^{[40]} Both kernel and image im(ƒ) = {ƒ(v), v ∈ V} are subspaces of V and W, respectively.^{[41]} The existence of kernels and images is part of the statement that the category of vector spaces (over a fixed field F) is an abelian category, i.e. a corpus of mathematical objects and structurepreserving maps between them (a category) that behaves much like the category of abelian groups.^{[42]} Because of this, many statements such as the first isomorphism theorem (also called ranknullity theorem in matrixrelated terms)
 V / ker(ƒ) ≅ im(ƒ).
and the second and third isomorphism theorem can be formulated and proven in a way very similar to the corresponding statements for groups.
An important example is the kernel of a linear map x ↦ Ax for some fixed matrix A, as above. The kernel of this map is the subspace of vectors x such that Ax = 0, which is precisely the set of solutions to the system of homogeneous linear equations belonging to A. This concept also extends to linear differential equations
 , where the coefficients a_{i} are functions in x, too.
In the corresponding map
 ,
the derivatives of the function ƒ appear linearly (as opposed to ƒ''(x)^{2}, for example). Since differentiation is a linear procedure (i.e., (ƒ + g)' = ƒ' + g ' and (c·ƒ)' = c·ƒ' for a constant c) this assignment is linear, called a linear differential operator. In particular, the solutions to the differential equation D(ƒ) = 0 form a vector space (over R or C).
Direct product and direct sum
Main articles: Direct product and Direct sum of modulesThe direct product of a family of vector spaces V_{i} consists of the set of all tuples (v_{i})_{i ∈ I}, which specify for each index i in some index set I an element v_{i} of V_{i}.^{[43]} Addition and scalar multiplication is performed componentwise. A variant of this construction is the direct sum (also called coproduct and denoted ), where only tuples with finitely many nonzero vectors are allowed. If the index set I is finite, the two constructions agree, but differ otherwise.
Tensor product
Main article: Tensor product of vector spacesThe tensor product V ⊗_{F} W, or simply V ⊗ W, of two vector spaces V and W is one of the central notions of multilinear algebra which deals with extending notions such as linear maps to several variables. A map g: V × W → X is called bilinear if g is linear in both variables v and w. That is to say, for fixed w the map v ↦ g(v, w) is linear in the sense above and likewise for fixed v.
The tensor product is a particular vector space that is a universal recipient of bilinear maps g, as follows. It is defined as the vector space consisting of finite (formal) sums of symbols called tensors
 v_{1} ⊗ w_{1} + v_{2} ⊗ w_{2} + ... + v_{n} ⊗ w_{n},
subject to the rules
 a · (v ⊗ w) = (a · v) ⊗ w = v ⊗ (a · w), where a is a scalar,
 (v_{1} + v_{2}) ⊗ w = v_{1} ⊗ w + v_{2} ⊗ w, and
 v ⊗ (w_{1} + w_{2}) = v ⊗ w_{1} + v ⊗ w_{2}.^{[44]}
These rules ensure that the map ƒ from the V × W to V ⊗ W that maps a tuple (v, w) to v ⊗ w is bilinear. The universality states that given any vector space X and any bilinear map g: V × W → X, there exists a unique map u, shown in the diagram with a dotted arrow, whose composition with ƒ equals g: u(v ⊗ w) = g(v, w).^{[45]} This is called the universal property of the tensor product, an instance of the method—much used in advanced abstract algebra—to indirectly define objects by specifying maps from or to this object.
Vector spaces with additional structure
From the point of view of linear algebra, vector spaces are completely understood insofar as any vector space is characterized, up to isomorphism, by its dimension. However, vector spaces ad hoc do not offer a framework to deal with the question—crucial to analysis—whether a sequence of functions converges to another function. Likewise, linear algebra is not adapted to deal with infinite series, since the addition operation allows only finitely many terms to be added. Therefore, the needs of functional analysis require considering additional structures. Much the same way the axiomatic treatment of vector spaces reveals their essential algebraic features, studying vector spaces with additional data abstractly turns out to be advantageous, too.^{[citation needed]}
A first example of an additional datum is an order ≤, a token by which vectors can be compared.^{[46]} For example, ndimensional real space R^{n} can be ordered by comparing its vectors componentwise. Ordered vector spaces, for example Riesz spaces, are fundamental to Lebesgue integration, which relies on the ability to express a function as a difference of two positive functions
 ƒ = ƒ^{+} − ƒ^{−},
where ƒ^{+} denotes the positive part of ƒ and ƒ^{−} the negative part.^{[47]}
Normed vector spaces and inner product spaces
Main articles: Normed vector space and Inner product space"Measuring" vectors is done by specifying a norm, a datum which measures lengths of vectors, or by an inner product, which measures angles between vectors. Norms and inner products are denoted and , respectively. The datum of an inner product entails that lengths of vectors can be defined too, by defining the associated norm . Vector spaces endowed with such data are known as normed vector spaces and inner product spaces, respectively.^{[48]}
Coordinate space F^{n} can be equipped with the standard dot product:
In R^{2}, this reflects the common notion of the angle between two vectors x and y, by the law of cosines:
Because of this, two vectors satisfying are called orthogonal. An important variant of the standard dot product is used in Minkowski space: R^{4} endowed with the Lorentz product
 ^{[49]}
In contrast to the standard dot product, it is not positive definite: also takes negative values, for example for x = (0, 0, 0, 1). Singling out the fourth coordinate—corresponding to time, as opposed to three spacedimensions—makes it useful for the mathematical treatment of special relativity.
Topological vector spaces
Main article: Topological vector spaceConvergence questions are treated by considering vector spaces V carrying a compatible topology, a structure that allows one to talk about elements being close to each other.^{[50]}^{[51]} Compatible here means that addition and scalar multiplication have to be continuous maps. Roughly, if x and y in V, and a in F vary by a bounded amount, then so do x + y and ax.^{[nb 8]} To make sense of specifying the amount a scalar changes, the field F also has to carry a topology in this context; a common choice are the reals or the complex numbers.
In such topological vector spaces one can consider series of vectors. The infinite sum
denotes the limit of the corresponding finite partial sums of the sequence (ƒ_{i})_{i∈N} of elements of V. For example, the ƒ_{i} could be (real or complex) functions belonging to some function space V, in which case the series is a function series. The mode of convergence of the series depends on the topology imposed on the function space. In such cases, pointwise convergence and uniform convergence are two prominent examples.
A way to ensure the existence of limits of certain infinite series is to restrict attention to spaces where any Cauchy sequence has a limit; such a vector space is called complete. Roughly, a vector space is complete provided that it contains all necessary limits. For example, the vector space of polynomials on the unit interval [0,1], equipped with the topology of uniform convergence is not complete because any continuous function on [0,1] can be uniformly approximated by a sequence of polynomials, by the Weierstrass approximation theorem.^{[52]} In contrast, the space of all continuous functions on [0,1] with the same topology is complete.^{[53]} A norm gives rise to a topology by defining that a sequence of vectors v_{n} converges to v if and only if
Banach and Hilbert spaces are complete topological spaces whose topologies are given, respectively, by a norm and an inner product. Their study—a key piece of functional analysis—focusses on infinitedimensional vector spaces, since all norms on finitedimensional topological vector spaces give rise to the same notion of convergence.^{[54]} The image at the right shows the equivalence of the 1norm and ∞norm on R^{2}: as the unit "balls" enclose each other, a sequence converges to zero in one norm if and only if it so does in the other norm. In the infinitedimensional case, however, there will generally be inequivalent topologies, which makes the study of topological vector spaces richer than that of vector spaces without additional data.
From a conceptual point of view, all notions related to topological vector spaces should match the topology. For example, instead of considering all linear maps (also called functionals) V → W, maps between topological vector spaces are required to be continuous.^{[55]} In particular, the (topological) dual space V^{∗} consists of continuous functionals V → R (or C). The fundamental Hahn–Banach theorem is concerned with separating subspaces of appropriate topological vector spaces by continuous functionals.^{[56]}
Banach spaces
Main article: Banach spaceBanach spaces, introduced by Stefan Banach, are complete normed vector spaces.^{[57]} A first example is the vector space ℓ ^{p} consisting of infinite vectors with real entries x = (x_{1}, x_{2}, ...) whose pnorm (1 ≤ p ≤ ∞) given by
 for p < ∞ and
is finite. The topologies on the infinitedimensional space ℓ ^{p} are inequivalent for different p. E.g. the sequence of vectors x_{n} = (2^{−n}, 2^{−n}, ..., 2^{−n}, 0, 0, ...), i.e. the first 2^{n} components are 2^{−n}, the following ones are 0, converges to the zero vector for p = ∞, but does not for p = 1:
 , but
More generally than sequences of real numbers, functions ƒ: Ω → R are endowed with a norm that replaces the above sum by the Lebesgue integral
The space of integrable functions on a given domain Ω (for example an interval) satisfying ƒ_{p} < ∞, and equipped with this norm are called Lebesgue spaces, denoted L^{p}(Ω).^{[nb 9]} These spaces are complete.^{[58]} (If one uses the Riemann integral instead, the space is not complete, which may be seen as a justification for Lebesgue's integration theory.^{[nb 10]}) Concretely this means that for any sequence of Lebesgueintegrable functions ƒ_{1}, ƒ_{2}, ... with ƒ_{n}_{p} < ∞, satisfying the condition
there exists a function ƒ(x) belonging to the vector space L^{p}(Ω) such that
Imposing boundedness conditions not only on the function, but also on its derivatives leads to Sobolev spaces.^{[59]}
Hilbert spaces
Main article: Hilbert spaceComplete inner product spaces are known as Hilbert spaces, in honor of David Hilbert.^{[60]} The Hilbert space L^{2}(Ω), with inner product given by
where denotes the complex conjugate of g(x).^{[61]}^{[nb 11]} is a key case.
By definition, in a Hilbert space any Cauchy sequences converges to a limit. Conversely, finding a sequence of functions ƒ_{n} with desirable properties that approximates a given limit function, is equally crucial. Early analysis, in the guise of the Taylor approximation, established an approximation of differentiable functions ƒ by polynomials.^{[62]} By the Stone–Weierstrass theorem, every continuous function on [a, b] can be approximated as closely as desired by a polynomial.^{[63]} A similar approximation technique by trigonometric functions is commonly called Fourier expansion, and is much applied in engineering, see below. More generally, and more conceptually, the theorem yields a simple description of what "basic functions", or, in abstract Hilbert spaces, what basic vectors suffice to generate a Hilbert space H, in the sense that the closure of their span (i.e., finite linear combinations and limits of those) is the whole space. Such a set of functions is called a basis of H, its cardinality is known as the Hilbert dimension.^{[nb 12]} Not only does the theorem exhibit suitable basis functions as sufficient for approximation purposes, together with the GramSchmidt process it also allows to construct a basis of orthogonal vectors.^{[64]} Such orthogonal bases are the Hilbert space generalization of the coordinate axes in finitedimensional Euclidean space.
The solutions to various differential equations can be interpreted in terms of Hilbert spaces. For example, a great many fields in physics and engineering lead to such equations and frequently solutions with particular physical properties are used as basis functions, often orthogonal.^{[65]} As an example from physics, the timedependent Schrödinger equation in quantum mechanics describes the change of physical properties in time, by means of a partial differential equation whose solutions are called wavefunctions.^{[66]} Definite values for physical properties such as energy, or momentum, correspond to eigenvalues of a certain (linear) differential operator and the associated wavefunctions are called eigenstates. The spectral theorem decomposes a linear compact operator acting on functions in terms of these eigenfunctions and their eigenvalues.^{[67]}
Algebras over fields
Main articles: Algebra over a field and Lie algebraGeneral vector spaces do not possess a multiplication operation. A vector space equipped with an additional bilinear operator defining the multiplication of two vectors is an algebra over a field.^{[68]} Many algebras stem from functions on some geometrical object: since functions with values in a field can be multiplied, these entities form algebras. The Stone–Weierstrass theorem mentioned above, for example, relies on Banach algebras which are both Banach spaces and algebras.
Commutative algebra makes great use of rings of polynomials in one or several variables, introduced above. Their multiplication is both commutative and associative. These rings and their quotients form the basis of algebraic geometry, because they are rings of functions of algebraic geometric objects.^{[69]}
Another crucial example are Lie algebras, which are neither commutative nor associative, but the failure to be so is limited by the constraints ([x, y] denotes the product of x and y):

 [x, y] = −[y, x] (anticommutativity), and
 [x, [y, z]] + [y, [z, x]] + [z, [x, y]] = 0 (Jacobi identity).^{[70]}
Examples include the vector space of nbyn matrices, with [x, y] = xy − yx, the commutator of two matrices, and R^{3}, endowed with the cross product.
The tensor algebra T(V) is a formal way of adding products to any vector space V to obtain an algebra.^{[71]} As a vector space, it is spanned by symbols, called simple tensors
 v_{1} ⊗ v_{2} ⊗ ... ⊗ v_{n}, where the degree n varies.
The multiplication is given by concatenating such symbols, imposing the distributive law under addition, and requiring that scalar multiplication commute with the tensor product ⊗, much the same way as with the tensor product of two vector spaces introduced above. In general, there are no relations between v_{1} ⊗ v_{2} and v_{2} ⊗ v_{1}. Forcing two such elements to be equal leads to the symmetric algebra, whereas forcing v_{1} ⊗ v_{2} = − v_{2} ⊗ v_{1} yields the exterior algebra.^{[72]}
When a field, F is explicitly stated, a common term used is Falgebra.
Applications
Vector spaces have manifold applications as they occur in many circumstances, namely wherever functions with values in some field are involved. They provide a framework to deal with analytical and geometrical problems, or are used in the Fourier transform. This list is not exhaustive: many more applications exist, for example in optimization. The minimax theorem of game theory stating the existence of a unique payoff when all players play optimally can be formulated and proven using vector spaces methods.^{[73]} Representation theory fruitfully transfers the good understanding of linear algebra and vector spaces to other mathematical domains such as group theory.^{[74]}
Distributions
Main article: DistributionA distribution (or generalized function) is a linear map assigning a number to each "test" function, typically a smooth function with compact support, in a continuous way: in the above terminology the space of distributions is the (continuous) dual of the test function space.^{[75]} The latter space is endowed with a topology that takes into account not only ƒ itself, but also all its higher derivatives. A standard example is the result of integrating a test function ƒ over some domain Ω:
When Ω = {p}, the set consisting of a single point, this reduces to the Dirac distribution, denoted by δ, which associates to a test function ƒ its value at the p: δ(ƒ) = ƒ(p). Distributions are a powerful instrument to solve differential equations. Since all standard analytic notions such as derivatives are linear, they extend naturally to the space of distributions. Therefore the equation in question can be transferred to a distribution space, which is bigger than the underlying function space, so that more flexible methods are available for solving the equation. For example, Green's functions and fundamental solutions are usually distributions rather than proper functions, and can then be used to find solutions of the equation with prescribed boundary conditions. The found solution can then in some cases be proven to be actually a true function, and a solution to the original equation (e.g., using the Lax–Milgram theorem, a consequence of the Riesz representation theorem).^{[76]}
Fourier analysis
Main article: Fourier analysisResolving a periodic function into a sum of trigonometric functions forms a Fourier series, a technique much used in physics and engineering.^{[nb 13]}^{[77]} The underlying vector space is usually the Hilbert space L^{2}(0, 2π), for which the functions sin mx and cos mx (m an integer) form an orthogonal basis.^{[78]} The Fourier expansion of an L^{2} function f is
The coefficients a_{m} and b_{m} are called Fourier coefficients of ƒ, and are calculated by the formulas^{[79]}
 ,
In physical terms the function is represented as a superposition of sine waves and the coefficients give information about the function's frequency spectrum.^{[80]} A complexnumber form of Fourier series is also commonly used.^{[79]} The concrete formulae above are consequences of a more general mathematical duality called Pontryagin duality.^{[81]} Applied to the group R, it yields the classical Fourier transform; an application in physics are reciprocal lattices, where the underlying group is a finitedimensional real vector space endowed with the additional datum of a lattice encoding positions of atoms in crystals.^{[82]}
Fourier series are used to solve boundary value problems in partial differential equations.^{[83]} In 1822, Fourier first used this technique to solve the heat equation.^{[84]} A discrete version of the Fourier series can be used in sampling applications where the function value is known only at a finite number of equally spaced points. In this case the Fourier series is finite and its value is equal to the sampled values at all points.^{[85]} The set of coefficients is known as the discrete Fourier transform (DFT) of the given sample sequence. The DFT is one of the key tools of digital signal processing, a field whose applications include radar, speech encoding, image compression.^{[86]} The JPEG image format is an application of the closely related discrete cosine transform.^{[87]}
The fast Fourier transform is an algorithm for rapidly computing the discrete Fourier transform.^{[88]} It is used not only for calculating the Fourier coefficients but, using the convolution theorem, also for computing the convolution of two finite sequences.^{[89]} They in turn are applied in digital filters^{[90]} and as a rapid multiplication algorithm for polynomials and large integers (SchönhageStrassen algorithm).^{[91]}^{[92]}
Differential geometry
Main article: Tangent spaceThe tangent plane to a surface at a point is naturally a vector space whose origin is identified with the point of contact. The tangent plane is the best linear approximation, or linearization, of a surface at a point.^{[nb 14]} Even in a threedimensional Euclidean space, there is typically no natural way to prescribe a basis of the tangent plane, and so it is conceived of as an abstract vector space rather than a real coordinate space. The tangent space is the generalization to higherdimensional differentiable manifolds.^{[93]}
Riemannian manifolds are manifolds whose tangent spaces are endowed with a suitable inner product.^{[94]} Derived therefrom, the Riemann curvature tensor encodes all curvatures of a manifold in one object, which finds applications in general relativity, for example, where the Einstein curvature tensor describes the matter and energy content of spacetime.^{[95]}^{[96]} The tangent space of a Lie group can be given naturally the structure of a Lie algebra and can be used to classify compact Lie groups.^{[97]}
Generalizations
Vector bundles
Main articles: Vector bundle and Tangent bundleA vector bundle is a family of vector spaces parametrized continuously by a topological space X.^{[93]} More precisely, a vector bundle over X is a topological space E equipped with a continuous map
 π : E → X
such that for every x in X, the fiber π^{−1}(x) is a vector space. The case dim V = 1 is called a line bundle. For any vector space V, the projection X × V → X makes the product X × V into a "trivial" vector bundle. Vector bundles over X are required to be locally a product of X and some (fixed) vector space V: for every x in X, there is a neighborhood U of x such that the restriction of π to π^{−1}(U) is isomorphic^{[nb 15]} to the trivial bundle U × V → U. Despite their locally trivial character, vector bundles may (depending on the shape of the underlying space X) be "twisted" in the large, i.e., the bundle need not be (globally isomorphic to) the trivial bundle X × V. For example, the Möbius strip can be seen as a line bundle over the circle S^{1} (by identifying open intervals with the real line). It is, however, different from the cylinder S^{1} × R, because the latter is orientable whereas the former is not.^{[98]}
Properties of certain vector bundles provide information about the underlying topological space. For example, the tangent bundle consists of the collection of tangent spaces parametrized by the points of a differentiable manifold. The tangent bundle of the circle S^{1} is globally isomorphic to S^{1} × R, since there is a global nonzero vector field on S^{1}.^{[nb 16]} In contrast, by the hairy ball theorem, there is no (tangent) vector field on the 2sphere S^{2} which is everywhere nonzero.^{[99]} Ktheory studies the isomorphism classes of all vector bundles over some topological space.^{[100]} In addition to deepening topological and geometrical insight, it has purely algebraic consequences, such as the classification of finitedimensional real division algebras: R, C, the quaternions H and the octonions.^{[citation needed]}
The cotangent bundle of a differentiable manifold consists, at every point of the manifold, of the dual of the tangent space, the cotangent space. Sections of that bundle are known as differential oneforms.
Modules
Main article: ModuleModules are to rings what vector spaces are to fields. The very same axioms, applied to a ring R instead of a field F yield modules.^{[101]} The theory of modules, compared to vector spaces, is complicated by the presence of ring elements that do not have multiplicative inverses. For example, modules need not have bases, as the Zmodule (i.e., abelian group) Z/2Z shows; those modules that do (including all vector spaces) are known as free modules.
To see why the requirement that for every scalar there exist multiplicative inverse makes a difference, consider this: the fact that every vector space has a basis amounts to saying that every vector space is a free module. The proof of this fact fails for general modules over any ring(at least for modules of finite type) in the step "in every list b of linearly dependent vectors, it is possible to remove one vector from b without changing span of b". This does not hold in a general module, but holds in any vector space. So when we have a linearly dependent finite list of vectors that spans the whole vector space at hand (which must exist in a finitedimensional vector space), we can remove one vector from the list and the list will still span the whole vector space. We can repeat this process until we get a basis; we cannot do this in general in a module. As it turns out, requiring that a module be over a field instead of a ring is a sufficient condition for this to hold.^{[102]}
Nevertheless, a vector space can be compactly defined as a module over a ring which is a field with the elements being called vectors. The algebrogeometric interpretation of commutative rings via their spectrum allows the development of concepts such as locally free modules, the algebraic counterpart to vector bundles.
Affine and projective spaces
Main articles: Affine space and Projective spaceRoughly, affine spaces are vector spaces whose origin is not specified.^{[103]} More precisely, an affine space is a set with a free transitive vector space action. In particular, a vector space is an affine space over itself, by the map
 V × V → V, (v, a) ↦ a + v.
If W is a vector space, then an affine subspace is a subset of W obtained by translating a linear subspace V by a fixed vector x ∈ W; this space is denoted by x + V (it is a coset of V in W) and consists of all vectors of the form x + v for v ∈ V. An important example is the space of solutions of a system of inhomogeneous linear equations
 Ax = b
generalizing the homogeneous case b = 0 above.^{[104]} The space of solutions is the affine subspace x + V where x is a particular solution of the equation, and V is the space of solutions of the homogeneous equation (the nullspace of A).
The set of onedimensional subspaces of a fixed finitedimensional vector space V is known as projective space; it may be used to formalize the idea of parallel lines intersecting at infinity.^{[105]} Grassmannians and flag manifolds generalize this by parametrizing linear subspaces of fixed dimension k and flags of subspaces, respectively.
Convex analysis
For more details on this topic, see Convex analysis.Over an ordered field, notably the real numbers, there are the added notions of convex analysis, most basically a cone, which allows only nonnegative linear combinations, and a convex set, which allows only nonnegative linear combinations that sum to 1. A convex set can be seen as the combinations of the axioms for an affine space and a cone, which is reflected in the standard space for it, the nsimplex, being the intersection of the affine hyperplane and orthant. Such spaces are particularly used in linear programming.
In the language of universal algebra, a vector space is an algebra over the universal vector space K^{∞} of finite sequences of coefficients, corresponding to finite sums of vectors, while an affine space is an algebra over the universal affine hyperplane in here (of finite sequences summing to 1), a cone is an algebra over the universal orthant, and a convex set is an algebra over the universal simplex. This geometrizes the axioms in terms of "sums with (possible) restrictions on the coordinates".
Many concepts in linear algebra have analogs in convex analysis, including basic ones such as basis and span (such as in the form of convex hull), and notably including duality (in the form of dual polyhedron, dual cone, dual problem). Unlike linear algebra, however, where every vector space or affine space is isomorphic to the standard spaces, not every convex set or cone is isomorphic to the simplex or orthant. Rather, there is always a map from the simplex onto a polytope, given by generalized barycentric coordinates, and a dual map from a polytope into the orthant (of dimension equal to the number of faces) given by slack variables, but these are rarely isomorphisms – most polytopes are not a simplex or an orthant.
See also
 Cartesian coordinate system
 Euclidean vector, for vectors in physics
 Gyrovector space
Notes
 ^ It is also common, especially in physics, to denote vectors with an arrow on top: .
 ^ This axiom is not asserting the associativity of an operation, since there are two operations in question, scalar multiplication: n_{2}s; and field multiplication: n_{1} n_{2}.
 ^ Some authors (such as Brown 1991) restrict attention to the fields R or C, but most of the theory is unchanged over an arbitrary field.
 ^ The indicator functions of intervals (of which there are infinitely many) are linearly independent, for example.
 ^ The nomenclature derives from German "eigen", which means own or proper.
 ^ Roman 2005, ch. 8, p. 140. See also Jordan–Chevalley decomposition.
 ^ Some authors (such as Roman 2005) choose to start with this equivalence relation and derive the concrete shape of V/W from this.
 ^ This requirement implies that the topology gives rise to a uniform structure, Bourbaki 1989, ch. II
 ^ The triangle inequality for −_{p} is provided by the Minkowski inequality. For technical reasons, in the context of functions one has to identify functions that agree almost everywhere to get a norm, and not only a seminorm.
 ^ "Many functions in L^{2} of Lebesgue measure, being unbounded, cannot be integrated with the classical Riemann integral. So spaces of Riemann integrable functions would not be complete in the L^{2} norm, and the orthogonal decomposition would not apply to them. This shows one of the advantages of Lebesgue integration.", Dudley 1989, sect. 5.3, p. 125
 ^ For p ≠2, L^{p}(Ω) is not a Hilbert space.
 ^ A basis of a Hilbert space is not the same thing as a basis in the sense of linear algebra above. For distinction, the latter is then called a Hamel basis.
 ^ Although the Fourier series is periodic, the technique can be applied to any L^{2} function on an interval by considering the function to be continued periodically outside the interval. See Kreyszig 1988, p. 601
 ^ That is to say (BSE3 2001), the plane passing through the point of contact P such that the distance from a point P_{1} on the surface to the plane is infinitesimally small compared to the distance from P_{1} to P in the limit as P_{1} approaches P along the surface.
 ^ That is, there is a homeomorphism from π^{−1}(U) to V × U which restricts to linear isomorphisms between fibers.
 ^ A line bundle, such as the tangent bundle of S^{1} is trivial if and only if there is a section that vanishes nowhere, see Husemoller 1994, Corollary 8.3. The sections of the tangent bundle are just vector fields.
Footnotes
 ^ Roman 2005, ch. 1, p. 27
 ^ van der Waerden 1993, Ch. 19
 ^ Bourbaki 1998, Section II.1.1. Bourbaki calls the group homomorphisms ƒ(a) homotheties.
 ^ Bourbaki 1969, ch. "Algèbre linéaire et algèbre multilinéaire", pp. 78–91
 ^ Bolzano 1804
 ^ Möbius 1827
 ^ Hamilton 1853
 ^ Grassmann 2000
 ^ Peano 1888, ch. IX
 ^ Banach 1922
 ^ Dorier 1995, Moore 1995
 ^ Lang 1987, ch. I.1
 ^ e.g. Lang 1993, ch. XII.3., p. 335
 ^ Lang 1987, ch. IX.1
 ^ Lang 1987, ch. VI.3.
 ^ Lang 2002, ch. V.1
 ^ Lang 1987, ch. II.2., pp. 47–48
 ^ Roman 2005, Theorem 1.9, p. 43
 ^ Blass 1984
 ^ Halpern 1966, pp. 670–673
 ^ Artin 1991, Theorem 3.3.13
 ^ Braun 1993, Th. 3.4.5, p. 291
 ^ Stewart 1975, Proposition 4.3, p. 52
 ^ Stewart 1975, Theorem 6.5, p. 74
 ^ Roman 2005, ch. 2, p. 45
 ^ Lang 1987, ch. IV.4, Corollary, p. 106
 ^ Lang 1987, Example IV.2.6
 ^ Lang 1987, ch. VI.6
 ^ Halmos 1974, p. 28, Ex. 9
 ^ Lang 1987, Theorem IV.2.1, p. 95
 ^ Roman 2005, Th. 2.5 and 2.6, p. 49
 ^ Lang 1987, ch. V.1
 ^ Lang 1987, ch. V.3., Corollary, p. 106
 ^ Lang 1987, Theorem VII.9.8, p. 198
 ^ Roman 2005, ch. 8, p. 135–156
 ^ Lang 1987, ch. IX.4
 ^ Roman 2005, ch. 1, p. 29
 ^ Roman 2005, ch. 1, p. 35
 ^ Roman 2005, ch. 3, p. 64
 ^ Lang 1987, ch. IV.3.
 ^ Roman 2005, ch. 2, p. 48
 ^ Mac Lane 1998
 ^ Roman 2005, ch. 1, pp. 31–32
 ^ Lang 2002, ch. XVI.1
 ^ Roman 2005, Th. 14.3. See also Yoneda lemma.
 ^ Schaefer & Wolff 1999, pp. 204–205
 ^ Bourbaki 2004, ch. 2, p. 48
 ^ Roman 2005, ch. 9
 ^ Naber 2003, ch. 1.2
 ^ Treves 1967
 ^ Bourbaki 1987
 ^ Kreyszig 1989, §4.115
 ^ Kreyszig 1989, §1.55
 ^ Choquet 1966, Proposition III.7.2
 ^ Treves 1967, p. 34–36
 ^ Lang 1983, Cor. 4.1.2, p. 69
 ^ Treves 1967, ch. 11
 ^ Treves 1967, Theorem 11.2, p. 102
 ^ Evans 1998, ch. 5
 ^ Treves 1967, ch. 12
 ^ Dennery 1996, p.190
 ^ Lang 1993, Th. XIII.6, p. 349
 ^ Lang 1993, Th. III.1.1
 ^ Choquet 1966, Lemma III.16.11
 ^ Kreyszig 1999, Chapter 11
 ^ Griffiths 1995, Chapter 1
 ^ Lang 1993, ch. XVII.3
 ^ Lang 2002, ch. III.1, p. 121
 ^ Eisenbud 1995, ch. 1.6
 ^ Varadarajan 1974
 ^ Lang 2002, ch. XVI.7
 ^ Lang 2002, ch. XVI.8
 ^ Luenberger 1997, Section 7.13
 ^ See representation theory and group representation.
 ^ Lang 1993, Ch. XI.1
 ^ Evans 1998, Th. 6.2.1
 ^ Folland 1992, p. 349 ff
 ^ Gasquet & Witomski 1999, p. 150
 ^ ^{a} ^{b} Gasquet & Witomski 1999, §4.5
 ^ Gasquet & Witomski 1999, p. 57
 ^ Loomis 1953, Ch. VII
 ^ Ashcroft & Mermin 1976, Ch. 5
 ^ Kreyszig 1988, p. 667
 ^ Fourier 1822
 ^ Gasquet & Witomski 1999, p. 67
 ^ Ifeachor & Jervis 2002, pp. 3–4, 11
 ^ Wallace Feb 1992
 ^ Ifeachor & Jervis 2002, p. 132
 ^ Gasquet & Witomski 1999, §10.2
 ^ Ifeachor & Jervis 2002, pp. 307–310
 ^ Gasquet & Witomski 1999, §10.3
 ^ Schönhage & Strassen 1971
 ^ ^{a} ^{b} Spivak 1999, ch. 3
 ^ Jost 2005. See also Lorentzian manifold.
 ^ Misner, Thorne & Wheeler 1973, ch. 1.8.7, p. 222 and ch. 2.13.5, p. 325
 ^ Jost 2005, ch. 3.1
 ^ Varadarajan 1974, ch. 4.3, Theorem 4.3.27
 ^ Kreyszig 1991, §34, p. 108
 ^ Eisenberg & Guy 1979
 ^ Atiyah 1989
 ^ Artin 1991, ch. 12
 ^ Mac Lane 1999, p. 197
 ^ Meyer 2000, Example 5.13.5, p. 436
 ^ Meyer 2000, Exercise 5.13.15–17, p. 442
 ^ Coxeter 1987
References
Linear algebra
 Artin, Michael (1991), Algebra, Prentice Hall, ISBN 9780898715101
 Blass, Andreas (1984), "Existence of bases implies the axiom of choice", Axiomatic set theory (Boulder, Colorado, 1983), Contemporary Mathematics, 31, Providence, R.I.: American Mathematical Society, pp. 31–33, MR763890
 Brown, William A. (1991), Matrices and vector spaces, New York: M. Dekker, ISBN 9780824784195
 Lang, Serge (1987), Linear algebra, Berlin, New York: SpringerVerlag, ISBN 9780387964126
 Lang, Serge (2002), Algebra, Graduate Texts in Mathematics, 211 (Revised third ed.), New York: SpringerVerlag, ISBN 9780387953854, MR1878556
 Mac Lane, Saunders (1999), Algebra (3rd ed.), pp. 193–222, ISBN 0821816462
 Meyer, Carl D. (2000), Matrix Analysis and Applied Linear Algebra, SIAM, ISBN 9780898714548, http://www.matrixanalysis.com/
 Roman, Steven (2005), Advanced Linear Algebra, Graduate Texts in Mathematics, 135 (2nd ed.), Berlin, New York: SpringerVerlag, ISBN 9780387247663
 Spindler, Karlheinz (1993), Abstract Algebra with Applications: Volume 1: Vector spaces and groups, CRC, ISBN 9780824791445
 (German) van der Waerden, Bartel Leendert (1993), Algebra (9th ed.), Berlin, New York: SpringerVerlag, ISBN 9783540567998
Analysis
 Bourbaki, Nicolas (1987), Topological vector spaces, Elements of mathematics, Berlin, New York: SpringerVerlag, ISBN 9783540136279
 Bourbaki, Nicolas (2004), Integration I, Berlin, New York: SpringerVerlag, ISBN 9783540411291
 Braun, Martin (1993), Differential equations and their applications: an introduction to applied mathematics, Berlin, New York: SpringerVerlag, ISBN 9780387978949
 BSE3 (2001), "Tangent plane", in Hazewinkel, Michiel, Encyclopaedia of Mathematics, Springer, ISBN 9781556080104, http://eom.springer.de/T/t092180.htm
 Choquet, Gustave (1966), Topology, Boston, MA: Academic Press
 Dennery, Philippe; Krzywicki, Andre (1996), Mathematics for Physicists, Courier Dover Publications, ISBN 9780486691930
 Dudley, Richard M. (1989), Real analysis and probability, The Wadsworth & Brooks/Cole Mathematics Series, Pacific Grove, CA: Wadsworth & Brooks/Cole Advanced Books & Software, ISBN 9780534100506
 Dunham, William (2005), The Calculus Gallery, Princeton University Press, ISBN 9780691095653
 Evans, Lawrence C. (1998), Partial differential equations, Providence, R.I.: American Mathematical Society, ISBN 9780821807729
 Folland, Gerald B. (1992), Fourier Analysis and Its Applications, BrooksCole, ISBN 9780534170943
 Gasquet, Claude; Witomski, Patrick (1999), Fourier Analysis and Applications: Filtering, Numerical Computation, Wavelets, Texts in Applied Mathematics, New York: SpringerVerlag, ISBN 0387984852
 Ifeachor, Emmanuel C.; Jervis, Barrie W. (2001), Digital Signal Processing: A Practical Approach (2nd ed.), Harlow, Essex, England: PrenticeHall (published 2002), ISBN 0201596199
 Krantz, Steven G. (1999), A Panorama of Harmonic Analysis, Carus Mathematical Monographs, Washington, DC: Mathematical Association of America, ISBN 0883850311
 Kreyszig, Erwin (1988), Advanced Engineering Mathematics (6th ed.), New York: John Wiley & Sons, ISBN 0471858242
 Kreyszig, Erwin (1989), Introductory functional analysis with applications, Wiley Classics Library, New York: John Wiley & Sons, ISBN 9780471504597, MR992618
 Lang, Serge (1983), Real analysis, AddisonWesley, ISBN 9780201141795
 Lang, Serge (1993), Real and functional analysis, Berlin, New York: SpringerVerlag, ISBN 9780387940014
 Loomis, Lynn H. (1953), An introduction to abstract harmonic analysis, TorontoNew York–London: D. Van Nostrand Company, Inc., pp. x+190
 Schaefer, Helmut H.; Wolff, M.P. (1999), Topological vector spaces (2nd ed.), Berlin, New York: SpringerVerlag, ISBN 9780387987262
 Treves, François (1967), Topological vector spaces, distributions and kernels, Boston, MA: Academic Press
Historical references
 (French) Banach, Stefan (1922), "Sur les opérations dans les ensembles abstraits et leur application aux équations intégrales (On operations in abstract sets and their application to integral equations)", Fundamenta Mathematicae 3, ISSN 00162736, http://matwbn.icm.edu.pl/ksiazki/fm/fm3/fm3120.pdf
 (German) Bolzano, Bernard (1804), Betrachtungen über einige Gegenstände der Elementargeometrie (Considerations of some aspects of elementary geometry), http://dml.cz/handle/10338.dmlcz/400338
 (French) Bourbaki, Nicolas (1969), Éléments d'histoire des mathématiques (Elements of history of mathematics), Paris: Hermann
 Dorier, JeanLuc (1995), "A general outline of the genesis of vector space theory", Historia Mathematica 22 (3): 227–261, doi:10.1006/hmat.1995.1024, MR1347828, http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WG945NJHDRC&_user=1634520&_coverDate=12%2F31%2F1995&_rdoc=2&_fmt=high&_orig=browse&_srch=docinfo(%23toc%236817%231995%23999779996%23308480%23FLP%23display%23Volume)&_cdi=6817&_sort=d&_docanchor=&_ct=9&_acct=C000054038&_version=1&_urlVersion=0&_userid=1634520&md5=fd995fe2dd19abde0c081f1e989af006
 (French) Fourier, Jean Baptiste Joseph (1822), Théorie analytique de la chaleur, Chez Firmin Didot, père et fils, http://books.google.com/?id=TDQJAAAAIAAJ
 (German) Grassmann, Hermann (1844), Die Lineale Ausdehnungslehre  Ein neuer Zweig der Mathematik, O. Wigand, http://books.google.com/?id=bKgAAAAAMAAJ&pg=PA1&dq=Die+Lineale+Ausdehnungslehre+ein+neuer+Zweig+der+Mathematik, reprint: Hermann Grassmann. Translated by Lloyd C. Kannenberg. (2000), Kannenberg, L.C., ed., Extension Theory, Providence, R.I.: American Mathematical Society, ISBN 9780821820315
 Hamilton, William Rowan (1853), Lectures on Quaternions, Royal Irish Academy, http://historical.library.cornell.edu/cgibin/cul.math/docviewer?did=05230001&seq=9
 (German) Möbius, August Ferdinand (1827), Der Barycentrische Calcul : ein neues Hülfsmittel zur analytischen Behandlung der Geometrie (Barycentric calculus: a new utility for an analytic treatment of geometry), http://mathdoc.emath.fr/cgibin/oeitem?id=OE_MOBIUS__1_1_0
 Moore, Gregory H. (1995), "The axiomatization of linear algebra: 1875–1940", Historia Mathematica 22 (3): 262–303, doi:10.1006/hmat.1995.1025, http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WG945NJHDRD&_user=1634520&_coverDate=12%2F31%2F1995&_rdoc=3&_fmt=high&_orig=browse&_srch=docinfo(%23toc%236817%231995%23999779996%23308480%23FLP%23display%23Volume)&_cdi=6817&_sort=d&_docanchor=&_ct=9&_acct=C000054038&_version=1&_urlVersion=0&_userid=1634520&md5=4327258ef37b4c293b560238058e21ad
 (Italian) Peano, Giuseppe (1888), Calcolo Geometrico secondo l'Ausdehnungslehre di H. Grassmann preceduto dalle Operazioni della Logica Deduttiva, Turin
Further references
 Ashcroft, Neil; Mermin, N. David (1976), Solid State Physics, Toronto: Thomson Learning, ISBN 9780030839931
 Atiyah, Michael Francis (1989), Ktheory, Advanced Book Classics (2nd ed.), AddisonWesley, ISBN 9780201093940, MR1043170
 Bourbaki, Nicolas (1998), Elements of Mathematics : Algebra I Chapters 13, Berlin, New York: SpringerVerlag, ISBN 9783540642435
 Bourbaki, Nicolas (1989), General Topology. Chapters 14, Berlin, New York: SpringerVerlag, ISBN 9783540642411
 Coxeter, Harold Scott MacDonald (1987), Projective Geometry (2nd ed.), Berlin, New York: SpringerVerlag, ISBN 9780387965321
 Eisenberg, Murray; Guy, Robert (1979), "A proof of the hairy ball theorem", The American Mathematical Monthly (Mathematical Association of America) 86 (7): 572–574, doi:10.2307/2320587, JSTOR 2320587
 Eisenbud, David (1995), Commutative algebra, Graduate Texts in Mathematics, 150, Berlin, New York: SpringerVerlag, ISBN 9780387942681; 9780387942698, MR1322960
 Goldrei, Derek (1996), Classic Set Theory: A guided independent study (1st ed.), London: Chapman and Hall, ISBN 0412606100
 Griffiths, David J. (1995), Introduction to Quantum Mechanics, Upper Saddle River, NJ: Prentice Hall, ISBN 0131244051
 Halmos, Paul R. (1974), Finitedimensional vector spaces, Berlin, New York: SpringerVerlag, ISBN 9780387900933
 Halpern, James D. (Jun 1966), "Bases in Vector Spaces and the Axiom of Choice", Proceedings of the American Mathematical Society (American Mathematical Society) 17 (3): 670–673, doi:10.2307/2035388, JSTOR 2035388
 Husemoller, Dale (1994), Fibre Bundles (3rd ed.), Berlin, New York: SpringerVerlag, ISBN 9780387940878
 Jost, Jürgen (2005), Riemannian Geometry and Geometric Analysis (4th ed.), Berlin, New York: SpringerVerlag, ISBN 9783540259077
 Kreyszig, Erwin (1991), Differential geometry, New York: Dover Publications, pp. xiv+352, ISBN 9780486667218
 Kreyszig, Erwin (1999), Advanced Engineering Mathematics (8th ed.), New York: John Wiley & Sons, ISBN 0471154962
 Luenberger, David (1997), Optimization by vector space methods, New York: John Wiley & Sons, ISBN 9780471181170
 Mac Lane, Saunders (1998), Categories for the Working Mathematician (2nd ed.), Berlin, New York: SpringerVerlag, ISBN 9780387984032
 Misner, Charles W.; Thorne, Kip; Wheeler, John Archibald (1973), Gravitation, W. H. Freeman, ISBN 9780716703440
 Naber, Gregory L. (2003), The geometry of Minkowski spacetime, New York: Dover Publications, ISBN 9780486432359, MR2044239
 (German) Schönhage, A.; Strassen, Volker (1971), "Schnelle Multiplikation großer Zahlen (Fast multiplication of big numbers)", Computing 7: 281–292, ISSN 0010485X, http://www.springerlink.com/content/y251407745475773/fulltext.pdf
 Spivak, Michael (1999), A Comprehensive Introduction to Differential Geometry (Volume Two), Houston, TX: Publish or Perish
 Stewart, Ian (1975), Galois Theory, Chapman and Hall Mathematics Series, London: Chapman and Hall, ISBN 0412108003
 Varadarajan, V. S. (1974), Lie groups, Lie algebras, and their representations, Prentice Hall, ISBN 9780135357323
 Wallace, G.K. (Feb 1992), "The JPEG still picture compression standard", IEEE Transactions on Consumer Electronics 38 (1): xviii–xxxiv, ISSN 00983063
 Weibel, Charles A. (1994), An introduction to homological algebra, Cambridge Studies in Advanced Mathematics, 38, Cambridge University Press, ISBN 9780521559874, OCLC 36131259, MR1269324
External links
 A lecture about fundamental concepts related to vector spaces (given at MIT)
 A graphical simulator for the concepts of span, linear dependency, base and dimension
Topics related to linear algebra Scalar · Vector · Vector space · Vector projection · Linear span · Linear map · Linear projection · Linear independence · Linear combination · Basis · Column space · Row space · Dual space · Orthogonality · Rank · Minor · Kernel · Eigenvalues and eigenvectors · Least squares regressions · Outer product · Inner product space · Dot product · Transpose · Gram–Schmidt process · Matrix decompositionCategories: Abstract algebra
 Fundamental physics concepts
 Group theory
 Linear algebra
 Mathematical structures
 Vectors
 Vector spaces
Wikimedia Foundation. 2010.