Linear combination

Linear combination

In mathematics, linear combinations are a concept central to linear algebra and related fields of mathematics.Most of this article deals with linear combinations in the context of a vector space over a field, with some generalisations given at the end of the article.

Definition

Suppose that "K" is a field and "V" is a vector space over "K". As usual, we call elements of "V" "vectors" and call elements of "K" "scalars".If "v"1,...,"v""n" are vectors and "a"1,...,"a""n" are scalars, then the "linear combination of those vectors with those scalars as coefficients" is:a_1 v_1 + a_2 v_2 + a_3 v_3 + cdots + a_n v_n ,

In a given situation, "K" and "V" may be specified explicitly, or they may be obvious from context.In that case, we often speak of "a linear combination of the vectors" "v"1,...,"v""n", with the coefficients unspecified (except that they must belong to "K").Or, if "S" is a subset of "V", we may speak of "a linear combination of vectors in S", where both the coefficients and the vectors are unspecified, except that the vectors must belong to the set "S" (and the coefficients must belong to "K").Finally, we may speak simply of "a linear combination", where nothing is specified (except that the vectors must belong to "V" and the coefficients must belong to "K").

Note that by definition, a linear combination involves only finitely many vectors (except as described in Generalisations below).However, the set "S" that the vectors are taken from (if one is mentioned) can still be infinite; each individual linear combination will only involve finitely many vectors.Also, there is no reason that "n" cannot be zero; in that case, we declare by convention that the result of the linear combination is the zero vector in "V".

Examples and counterexamples

Analytic geometry

Let the field "K" be the set R of real numbers, and let the vector space "V" be the Euclidean space R3.Consider the vectors "e"1 := (1,0,0), "e"2 := (0,1,0) and "e"3 = (0,0,1).Then "any" vector in R3 is a linear combination of "e"1, "e"2 and "e"3.

To see that this is so, take an arbitrary vector ("a"1,"a"2,"a"3) in R3, and write:: ( a_1 , a_2 , a_3) = ( a_1 ,0,0) + (0, a_2 ,0) + (0,0, a_3) , ::: = a_1 (1,0,0) + a_2 (0,1,0) + a_3 (0,0,1) , ::: = a_1 e_1 + a_2 e_2 + a_3 e_3 ,

Functional analysis

Let "K" be the set C of all complex numbers, and let "V" be the set CC("R") of all continuous functions from the real line R to the complex plane C.Consider the vectors (functions) "f" and "g" defined by "f"("t") := "e""it" and "g"("t") := "e"−"it".(Here, "e" is the base of the natural logarithm, about 2.71828..., and "i" is the imaginary unit, a square root of −1.)Some linear combinations of "f" and "g" are:
*.

cosh t = egin{matrix}frac12end{matrix} e^{i t} + egin{matrix}frac12end{matrix} e^{-i t} ,

*
2 sin t = (-i ) e^{i t} + ( i ) e^{-i t} ,
On the other hand, the constant function 3 is "not" a linear combination of "f" and "g". To see this, suppose that 3 could be written as a linear combination of "e""it" and "e"−"it". This means that there would exist complex scalars "a" and "b" such that "ae""it" + "be"−"it" = 3 for all real numbers "t". Setting "t" = 0 and "t" = π gives the equations "a" + "b" = 3 and "a" + "b" = −3, and clearly this cannot happen.

Algebraic geometry

Let "K" be any field (R, C, or whatever you like best), and let "V" be the set "P" of all polynomials with coefficients taken from the field "K".Consider the vectors (polynomials) "p"1 := 1, "p"2 := "x" + 1, and "p"3 := "x"2 + "x" + 1.

Is the polynomial "x"2 − 1 a linear combination of "p"1, "p"2, and "p"3?To find out, consider an arbitrary linear combination of these vectors and try to see when it equals the desired vector "x"2 − 1.Picking arbitrary coefficients "a"1, "a"2, and "a"3, we want: a_1 (1) + a_2 ( x + 1) + a_3 ( x^2 + x + 1) = x^2 - 1 ,Multiplying the polynomials out, this means: ( a_1 ) + ( a_2 x + a_2) + ( a_3 x^2 + a_3 x + a_3) = x^2 - 1 , and collecting like powers of "x", we get: a_3 x^2 + ( a_2 + a_3 ) x + ( a_1 + a_2 + a_3 ) = 1 x^2 + 0 x + (-1) , Two polynomials are equal if and only if their corresponding coefficients are equal, so we can conclude: a_3 = 1, quad a_2 + a_3 = 0, quad a_1 + a_2 + a_3 = -1 , This system of linear equations can easily be solved.First, the first equation simply says that "a"3 is 1.Knowing that, we can solve the second equation for "a"2, which comes out to −1.Finally, the last equation tells us that "a"1 is also −1.Therefore, the only possible way to get a linear combination is with these coefficients.Indeed,: x^2 - 1 = -1 - ( x + 1) + ( x^2 + x + 1) = - p_1 - p_2 + p_3 ,so "x"2 − 1 "is" a linear combination of "p"1, "p"2, and "p"3.

On the other hand, what about the polynomial "x"3 − 1?If we try to make this vector a linear combination of "p"1, "p"2, and "p"3, then following the same process as before, we’ll get the equation: 0 x^3 + a_3 x^2 + ( a_2 + a_3 ) x + ( a_1 + a_2 + a_3 ) , : = 1 x^3 + 0 x^2 + 0 x + (-1) , However, when we set corresponding coefficients equal in this case, the equation for "x"3 is: 0 = 1 , which is always false.Therefore, there is no way for this to work, and "x"3 − 1 is "not" a linear combination of "p"1, "p"2, and "p"3.

The linear span

"Main article: linear span"

Take an arbitrary field "K", an arbitrary vector space "V", and let "v"1,...,"v""n" be vectors (in "V").It’s interesting to consider the set of "all" linear combinations of these vectors.This set is called the "linear span" (or just "span") of the vectors, say S ={"v"1,...,"v""n"}. We write the span of S as span(S) or sp(S):: mathrm{Sp}( v_1 ,ldots, v_n) := { a_1 v_1 + cdots + a_n v_n : a_1 ,ldots, a_n subseteq K }. ,

Other related concepts

Sometimes, some single vector can be written in two different ways as a linear combination of "v"1,...,"v""n".If that is possible, then "v"1,...,"v""n" are called "linearly dependent"; otherwise, they are "linearly independent".Similarly, we can speak of linear dependence or independence of an arbitrary set "S" of vectors.

If "S" is linearly independent and the span of "S" equals "V", then "S" is a basis for "V".

We can think of linear combinations as the most general sort of operation on a vector space.The basic operations of addition and scalar multiplication, together with the existence of an additive identity and additive inverses, cannot be combined in any more complicated way than the generic linear combination.Ultimately, this fact lies at the heart of the usefulness of linear combinations in the study of vector spaces.

Another related concept is the affine combination, which is a linear combination with the additional constraint thatthe coefficients "a"1,...,"a""n" sum to unity.

Generalizations

If "V" is a topological vector space, then there may be a way to make sense of certain "infinite" linear combinations, using the topology of "V".For example, we might be able to speak of "a"1"v"1 + "a"2"v"2 + "a"3"v"3 + ..., going on forever.Such infinite linear combinations do not always make sense; we call them "convergent" when they do.Allowing more linear combinations in this case can also lead to a different concept of span, linear independence, and basis.The articles on the various flavours of topological vector spaces go into more detail about these.

If "K" is a commutative ring instead of a field, then everything that has been said above about linear combinations generalises to this case without change.The only difference is that we call spaces like "V" modules instead of vector spaces.If "K" is a noncommutative ring, then the concept still generalises, with one caveat:Since modules over noncommutative rings come in left and right versions, our linear combinations may also come in either of these versions, whatever is appropriate for the given module.This is simply a matter of doing scalar multiplication on the correct side.

A more complicated twist comes when "V" is a bimodule over two rings, "K"L and "K"R.In that case, the most general linear combination looks like: a_1 v_1 b_1 + cdots + a_n v_n b_n , where "a"1,...,"a""n" belong to "K"L, "b"1,...,"b""n" belong to "K"R, and "v"1,...,"v""n" belong to "V".


Wikimedia Foundation. 2010.

Look at other dictionaries:

  • linear combination — Math. (of mathematical quantities) a sum of products of each quantity times a constant: The expression aX + bY + cZ is a linear combination of X, Y, and Z, where a, b, and c are constants. [1955 60] * * * …   Universalium

  • linear combination — tiesinis derinys statusas T sritis fizika atitikmenys: angl. linear combination vok. Linearkombination, f rus. линейная комбинация, f pranc. combinaison linéaire, f …   Fizikos terminų žodynas

  • linear combination — noun : a mathematical entity (as 4x + 5y + 6z) which is composed of sums and differences of elements (as variables, matrices, or functions) whose coefficients are not all zero * * * Math. (of mathematical quantities) a sum of products of each… …   Useful english dictionary

  • linear combination — noun Date: 1960 a mathematical entity (as 4x + 5y + 6z) which is composed of sums and differences of elements (as variables, matrices, or functions) especially when the coefficients are not all zero …   New Collegiate Dictionary

  • linear combination — noun a sum, each of whose summands is an appropriate vector times an appropriate scalar (or ring element) …   Wiktionary

  • Linear combination of atomic orbitals molecular orbital method — A linear combination of atomic orbitals or LCAO is a quantum superposition of atomic orbitals and a technique for calculating molecular orbitals in quantum chemistry [Huheey, James. Inorganic Chemistry:Principles of Structure and Reactivity ] .… …   Wikipedia

  • linear combination of atomic orbitals approximation — atominių orbitalių tiesinių derinių artinys statusas T sritis fizika atitikmenys: angl. LCAO approximation; linear combination of atomic orbitals approximation vok. Annäherung der Linearkombinationen der Atomorbitale, f; LKAO Annäherung, f rus.… …   Fizikos terminų žodynas

  • linear combination of atomic orbitals method — atominių orbitalių tiesinių derinių metodas statusas T sritis fizika atitikmenys: angl. LCAO method; linear combination of atomic orbitals method vok. LKAO Methode, f; Methode der Linearkombinationen der Atomorbitale, f rus. ЛКАО метод, m; метод… …   Fizikos terminų žodynas

  • linear combination of atomic orbitals — atominių orbitalių tiesinis derinys statusas T sritis fizika atitikmenys: angl. linear combination of atomic orbitals vok. Linearkombination der Atomorbitalen, f rus. линейная комбинация атомных орбиталей, f pranc. combinaison linéaire des… …   Fizikos terminų žodynas

  • Linear discriminant analysis — (LDA) and the related Fisher s linear discriminant are methods used in statistics, pattern recognition and machine learning to find a linear combination of features which characterize or separate two or more classes of objects or events. The… …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”