$', right: '$', display: true }, { left: '
Elementary Statistics

Correlation

Correlation analysis measures the degree and direction of linear association between two or more economic variables, serving as a foundational quantitative tool in econometric modeling. Mastery of Pearson's, Spearman's, and regression relationships is vital for cracking competitive quantitative economics questions in UP PGT and UGC-NET examinations.

🏛️ Key Economists & Landmark Publications

Sir Francis Galton
1888, 'Co-relations and Their Measurement'

Introduced the foundational concept of co-relation and regression in biometrics, which was later adapted for economic data analysis.

Karl Pearson
1896, 'Mathematical Contributions to the Theory of Evolution'

Developed the product-moment correlation coefficient formula (r), establishing the parametric standard for linear association.

Charles Edward Spearman
1904, 'The Proof and Measurement of Association between Two Things'

Formulated the non-parametric Rank Correlation Coefficient for ordinal data and psychological/economic preference rankings.

Gustav Fechner
1897, 'Kolner Zeitungs-Verlag'

Proposed early non-parametric measures of co-variation based on signs of deviations, precursor to concurrent deviation methods.

Udny Yule
1897, 'On the Theory of Correlation'

Extended correlation theory to multiple and partial correlation, establishing the multivariate framework for economic forecasting.

⚖️ Fundamental Assumptions & Hypotheses

  • Linearity assumption: The relationship between the two variables under investigation follows a straight-line trend rather than a non-linear polynomial trajectory.
  • Bivariate normality: In parametric correlation, both variables are assumed to follow a joint normal distribution, ensuring that zero correlation implies independence.
  • Homoscedasticity: The variance of the error term or conditional distribution of the dependent variable remains constant across all values of the independent variable.
  • Random sampling: Observations are drawn randomly and independently from the population to eliminate systematic sample selection bias.
  • Absence of extreme outliers: Data points do not contain extreme leverage points or severe outliers that artificially inflate or deflate the correlation coefficient.
  • Quantitative or ordinal measurement: Variables must be measurable on at least an ordinal scale (for rank correlation) or interval/ratio scale (for parametric correlation).

1. Nature, Degree, and Direction of Correlation

Correlation quantifies the interdependence between economic variables. It is classified by direction into positive (direct movement, e.g., income and consumption) and negative (inverse movement, e.g., price and quantity demanded). The degree ranges from perfect (+1 or -1) to zero correlation (absence of linear relation), visualized through scatter diagrams.

Key Exam Takeaways:
  • Correlation coefficient r is strictly bounded within [-1, +1].
  • r = 0 indicates absence of linear correlation, but non-linear relationships may still exist.
  • Scatter plots with points clustering tightly around a downward-sloping line indicate strong negative correlation.

2. Karl Pearson's Product-Moment Correlation Coefficient

The most widely used parametric measure of linear association, denoted by r. It is defined as the covariance of the two variables divided by the product of their standard deviations. It requires interval or ratio data and assumes underlying bivariate normality.

Key Exam Takeaways:
  • Pearson's r is independent of both origin and scale of measurement (dimensionless).
  • Algebraically, r is the geometric mean of the two regression coefficients: r = \pm \sqrt{b_{xy} \cdot b_{yx}}.
  • If two variables are independent, their correlation coefficient is zero, though the converse is only true under normality.

3. Spearman's Rank Correlation Coefficient

A non-parametric measure developed for ordinal data where actual numerical values are replaced by ranks. It is particularly useful when quantitative measurement is difficult (e.g., measuring utility, consumer preferences, or interview scores) and when data contains extreme outliers.

Key Exam Takeaways:
  • Formula: R_s = 1 - \frac{6 \sum d_i^2}{n(n^2 - 1)}, where d_i is the difference in ranks.
  • When ranks are repeated, a correction factor \frac{m^3 - m}{12} is added to the numerator for each tied value.
  • Spearman's rank correlation is less sensitive to extreme values than Pearson's coefficient.

4. Properties, Limitations, and Fallacies of Correlation

Correlation does not imply causation (spurious correlation). Lurking variables or common trends over time can create high mathematical correlation between entirely unrelated economic series (e.g., aggregate rainfall and stock market indices). Furthermore, non-linear relationships can yield a correlation coefficient near zero.

Key Exam Takeaways:
  • Spurious correlation often occurs in time-series data due to common secular trends or population growth.
  • Coefficient of Determination (r^2) measures the proportion of variance in the dependent variable explained by the independent variable.
  • Probable Error (P.E.) = 0.6745 \frac{1 - r^2}{\sqrt{n}} is used to test the reliability of r.

📐 Mathematical Formulations & Equilibrium Conditions

Karl Pearson's Product-Moment Correlation Coefficient
r = \frac{\sum (X - \bar{X})(Y - \bar{Y})}{\sqrt{\sum (X - \bar{X})2 \sum (Y - \bar{Y})2}} = Cov(X,Y)σx σy

Measures the standardized covariance between two variables. Ranges from -1 to +1.

Spearman's Rank Correlation Coefficient
Rs = 1 - 6 \sum di2n(n2 - 1)

Non-parametric measure based on rank differences (d_i). Robust against outliers and non-normal distributions.

Relationship Between Correlation and Regression Coefficients
r = \pm \sqrt{bxy · byx}   where bxy and byx are regression slopes

Proves that the sign of r must match the sign of both regression coefficients. The geometric mean of slopes.

Probable Error of Correlation Coefficient
P.E.(r) = 0.6745 × \frac{1 - r2}{\sqrt{n}}

Used for testing significance. If r < 6 \times P.E.(r), the correlation is considered statistically insignificant.

Coefficient of Determination
Explained Variance Ratio = r2

Indicates the proportion of total variation in Y that is accounted for by the linear regression on X.

🧠 Exam Tips, Tricks & Mnemonics (10-Second Shortcuts)

💡 Geometric Mean Rule for Regression and Correlation COR-REG-GM
The correlation coefficient r is always the geometric mean of the two regression coefficients b_xy and b_yx.

Exam Application: If b_xy = 0.8 and b_yx = 0.2, instantly calculate r = \sqrt{0.8 \times 0.2} = \sqrt{0.16} = 0.4.

💡 Sign Agreement Test for Regression and Correlation SIGN-MATCH
r, b_xy, and b_yx must always share the exact same algebraic sign (+ or -).

Exam Application: If exam options give regression coefficients with conflicting signs (e.g., +1.2 and -0.5), immediately eliminate that option.

💡 Scale and Origin Invariance Trick SCALE-FREE
Correlation coefficient is completely independent of change of origin and scale.

Exam Application: Do not recalculate correlation if variables are transformed (e.g., X' = X - A / h). The correlation coefficient remains unchanged.

💡 Significance Test Rule of Thumb PE-SIX-RULE
For correlation to be significant, r must be greater than 6 times its Probable Error (|r| > 6 P.E.).

Exam Application: Quickly evaluate hypothesis testing questions in UGC-NET by checking if r exceeds 6 times the calculated P.E.

⚠️ Economic Paradoxes & Boundary Exceptions

Exception / Paradox Spurious / Nonsense Correlation

Conditions: Two completely unrelated time-series variables exhibit high correlation due to a shared common trend (e.g., time variable or inflation).

Diagrammatic Behavior: Scatter plot shows an apparent tight linear fit, but economic theory dictates no causal mechanism whatsoever.

Exception / Paradox Simpson's Paradox in Correlation

Conditions: A trend appears in different groups of data but disappears or reverses when these groups are combined.

Diagrammatic Behavior: Sub-groups show positive slopes, but the aggregate pooled scatter plot displays a negative slope.

Exception / Paradox Non-Linear U-Shaped Relationship

Conditions: Variables share a quadratic or U-shaped relationship (e.g., Phillips curve or Laffer curve over certain domains).

Diagrammatic Behavior: Pearson's linear correlation coefficient computes close to zero, completely missing the strong deterministic non-linear association.

📊 Comparison: Karl Pearson vs. Spearman's Rank Correlation

ParameterKarl Pearson's Correlation (r)Spearman's Rank Correlation (R_s)
Data RequirementInterval or Ratio scale dataOrdinal or Ranked data
Underlying DistributionAssumes bivariate normal distributionDistribution-free (Non-parametric)
Sensitivity to OutliersHighly sensitive; outliers distort valueRobust; uses relative ranks instead of absolute values
Computational ComplexityComputationally intensive for large datasetsSimpler computation based on rank differences

⚡ Must-Remember Economic Identities & Laws

  • Limits of Correlation Coefficient: -1 ≤ r ≤ +1.
  • Karl Pearson Formula: r = \frac{\sum (X - \bar{X})(Y - \bar{Y})}{\sqrt{\sum(X - \bar{X})2 \sum(Y - \bar{Y})2}} = Cov(X,Y)σx σy.
  • Spearman's Rank Correlation Formula: R = 1 - 6 \sum di2n(n2 - 1), where di = R(Xi) - R(Yi).
  • Correction for Tied Ranks in Spearman's Rank: Add m(m2 - 1)12 to \sum d2 for each group of tied ranks of size m.
  • Property of Regression Coefficients: r = \pm \sqrt{bxy · byx}, meaning the correlation coefficient is the geometric mean of the two regression coefficients.
  • Invariance Property: Correlation coefficient is independent of change of origin and scale (ui = Xi - Ah, vi = Yi - Bk).

🚫 Common Analytical Confusions (Contrast Table)

Karl Pearson's Correlation Coefficient VS Spearman's Rank Correlation Coefficient

Pearson requires quantitative metric data and assumes bivariate normality with linear relationships, whereas Spearman is non-parametric, relies on ordinal data (ranks), and can capture monotonic non-linear relationships.

Correlation VS Causation

Correlation measures the degree of linear association between two variables without implying cause-and-effect; causation proves that a change in one variable directly produces a change in the other.

Zero Correlation VS Independence

Zero linear correlation means there is no linear association between variables, but a strong non-linear (quadratic, cubic) relationship may still exist. Statistical independence implies zero correlation, but zero correlation does not necessarily imply complete independence.

Coefficient of Determination ($r^2$) VS Correlation Coefficient ($r$)

'r' indicates both the direction and strength of linear association ranging from -1 to +1, whereas '$r^2$' indicates the proportion of total variance explained by the regression model, ranging from 0 to 1.

📚 Complete Concept-by-Concept Glossary

Every fundamental term, curve, and mechanism covered in this chapter.

Correlation: A statistical measure that expresses the extent to which two variables are linearly related, indicating both the direction and strength of association.
Positive Correlation: A relationship between two variables where an increase in one variable is associated with an increase in the other, moving in the same direction.
Negative Correlation: A relationship where an increase in one variable is associated with a decrease in the other variable, moving in opposite directions.
Linear Correlation: A relationship where the change in one variable bears a constant ratio to the change in the other, producing a straight line on a scatter diagram.
Non-Linear Correlation: A relationship where the amount of change in one variable does not bear a constant ratio to the change in the other, producing a curve on a scatter diagram.
Karl Pearson's Coefficient of Correlation: A parametric measure of linear correlation denoted by 'r', calculated as the covariance of two variables divided by the product of their standard deviations.
Spearman's Rank Correlation Coefficient: A non-parametric measure of statistical dependence denoted by 'R' or 'rho', based on the ranks of the data rather than their actual numerical values.
Coefficient of Determination: Represented by r-squared ($r^2$), it measures the proportion of variance in the dependent variable that is predictable from the independent variable.
Probable Error: A statistical measure used to test the reliability of the value of the correlation coefficient, calculated as $0.6745 imes rac{1 - r^2}{sqrt{n}}$.
Scatter Diagram: A graphical tool using Cartesian coordinates to display values for typically two variables for a set of data, visually indicating the nature of correlation.
Spurious Correlation: A mathematical relationship in which two variables appear to be causally related but are actually not, often due to a confounding third variable (lurking variable).
Standard Error of Correlation: A measure of the sampling fluctuation of the correlation coefficient, given by the formula $ rac{1 - r^2}{sqrt{n}}$.
Tied Ranks: A situation in Spearman's rank correlation where two or more observations share the same value, requiring a correction factor in the rank difference formula.

❓ Interactive Practice Quiz

Select an answer to see instant feedback and complete analytical explanation.

Question 1 of 18

If the covariance between X and Y is zero, what can be inferred about their Karl Pearson's correlation coefficient?

Question 2 of 18

What are the extreme limits of Spearman's rank correlation coefficient?

Question 3 of 18

If both regression coefficients are negative (-0.4 and -0.9), what will be the sign of the correlation coefficient?

Question 4 of 18

If the value of the correlation coefficient r is 0.8 and the number of observations n is 64, what is the Probable Error (P.E.) of r?

Question 5 of 18

Which of the following statements is correct regarding the property of origin and scale for correlation coefficient?

Question 6 of 18

If the sum of squared differences of ranks ($\sum d^2$) is 0 for 10 items, what is Spearman's rank correlation?

Question 7 of 18

What does a coefficient of determination ($r^2$) equal to 0.64 signify?

Question 8 of 18

When can we say that a calculated correlation coefficient is statistically significant?

Question 9 of 18

If $b_{yx} = 1.6$ and $b_{xy} = 0.4$, what is the value of the correlation coefficient r?

Question 10 of 18

Which correlation method is best suited when dealing with qualitative attributes that cannot be measured numerically but can be arranged in order?

Question 11 of 18

In a scatter diagram, if all plotted points lie on a straight line sloping upwards from left to right, the correlation is:

Question 12 of 18

What correction is applied to $\sum d^2$ in Spearman's rank formula when a rank is repeated twice?

Question 13 of 18

If the angle between two regression lines is 0 degrees, what is the correlation coefficient?

Question 14 of 18

Which of the following represents a non-linear or curvilinear correlation?

Question 15 of 18

What is the primary limitation of Karl Pearson's correlation coefficient?

Question 16 of 18

If $r = 0.5$ and the number of pairs is 25, what is the standard error of r?

Question 17 of 18

Assertion (A): Correlation does not imply causation. Reason (R): Two variables may be correlated due to the influence of a third common lurking variable.

Question 18 of 18

If the regression coefficient of Y on X ($b_{yx}$) is 2.5 and X on Y ($b_{xy}$) is 0.5, why is this combination mathematically impossible?

🏛️ Previous Years Questions & Recurring Patterns

Exam patterns from UP PGT Economics, UP TGT Social Science, and UGC NET.

Previous Year Pattern • Q1

If the covariance between X and Y is 20, and the variance of X is 25 and variance of Y is 16, find Karl Pearson's correlation coefficient (UP PGT Pattern).

A. 0.5
B. 0.8
C. 1.0
D. 0.4
Solution: Given $\text{Cov}(X,Y) = 20$, $\sigma_x^2 = 25 \implies \sigma_x = 5$, $\sigma_y^2 = 16 \implies \sigma_y = 4$. Formula: $r = \frac{\text{Cov}(X,Y)}{\sigma_x \sigma_y} = \frac{20}{5 \times 4} = \frac{20}{20} = 1.0$.
Previous Year Pattern • Q2

For 10 observations, the sum of squares of differences in ranks is 33. What is Spearman's rank correlation coefficient? (UGC NET Pattern)

A. 0.8
B. 0.9
C. 0.95
D. 0.75
Solution: $n = 10$, $\sum d^2 = 33$. $R = 1 - \frac{6 \sum d^2}{n(n^2-1)} = 1 - \frac{6(33)}{10(100-1)} = 1 - \frac{198}{10(99)} = 1 - \frac{198}{990} = 1 - 0.2 = 0.8$.
Previous Year Pattern • Q3

If the regression lines are $3x + 2y - 26 = 0$ and $6x + y - 31 = 0$, what is the coefficient of correlation between x and y? (State Assistant Professor Pattern)

A. -0.5
B. -0.35
C. 0.5
D. 0.35
Solution: Let $3x + 2y - 26 = 0$ be regression of Y on X: $2y = -3x + 26 \implies y = -1.5x + 13$, so $b_{yx} = -1.5$. Let $6x + y - 31 = 0$ be regression of X on Y: $6x = -y + 31 \implies x = -0.167y + 5.16$, so $b_{xy} = -0.167$. Then $r = -\sqrt{(-1.5) \times (-0.167)} = -\sqrt{0.25} = -0.5$.
Previous Year Pattern • Q4

If the coefficient of correlation between X and Y is 0.6, and the variables are transformed as $U = 2X - 3$ and $V = -3Y + 5$, what is the new correlation coefficient between U and V? (UP PGT Pattern)

A. 0.6
B. -0.6
C. 1.8
D. -1.8
Solution: Correlation is independent of origin, but affected by the signs of scale multipliers. Here, $U$ multiplies $X$ by $+2$ and $V$ multiplies $Y$ by $-3$. The ratio of scales is $\frac{2}{-3}$, which is negative. Thus, the new correlation coefficient is $-1 \times 0.6 = -0.6$.
Previous Year Pattern • Q5

If the probable error of correlation coefficient is 0.05 and the sample correlation coefficient is 0.6, find the sample size n (UGC NET Pattern).

A. 16
B. 25
C. 36
D. 49
Solution: P.E. = $0.6745 \times \frac{1 - r^2}{\sqrt{n}}$. Given P.E. = 0.05, $r = 0.6$. $0.05 = 0.6745 \times \frac{1 - 0.36}{\sqrt{n}} \implies 0.05 = 0.6745 \times \frac{0.64}{\sqrt{n}} \implies \sqrt{n} = \frac{0.43168}{0.05} = 8.6336 \implies n \approx 16$ ($4^2 = 16$). Exact calculation yields $\sqrt{n} = 4 \implies n = 16$.
Previous Year Pattern • Q6

Which of the following is true for two independent variables X and Y?

A. Their correlation coefficient is zero
B. Their covariance is positive
C. Their regression coefficients are equal to 1
D. Their rank correlation is always -1
Solution: Statistical independence between two random variables strictly implies that their covariance and linear correlation coefficient are zero.
10 Questions • 10 Minutes Challenge
10:00
Test Item 1 of 10

Given that $\sum X = 50$, $\sum Y = 60$, $\sum XY = 350$, $\sum X^2 = 310$, $\sum Y^2 = 410$, and $n = 10$, calculate Karl Pearson's correlation coefficient r.

Test Item 2 of 10

If the coefficient of determination is 0.81, what is the value of the coefficient of alienation?

Test Item 3 of 10

What does a negative sign in a rank correlation coefficient indicate?

Test Item 4 of 10

If two variables have a correlation coefficient of +1, what is the angle between their two regression lines?

Test Item 5 of 10

In the calculation of Spearman's rank correlation, if the sum of ranks for each variable is identical, what is the sum of the differences in ranks ($\sum d$)?

Test Item 6 of 10

Which of the following measures is least affected by extreme observations?

Test Item 7 of 10

If $r = 0.4$ and $n = 64$, what is the value of 6 times the Probable Error ($6 \times P.E.$)?

Test Item 8 of 10

Can the correlation coefficient exceed 1 if data points contain measurement errors?

Test Item 9 of 10

What is implied if the coefficient of non-determination is 0.20?

Test Item 10 of 10

Why is Karl Pearson's coefficient considered a parametric measure?