Underfitting Explained: Machine Learning Model Kab Zyada Simple Ho Jaata Hai? | Day 24

Kal Day 23: Overfitting Explained mein humne dekha tha ki jab ek machine learning model training data ko over-memorize (rattamār) kar leta hai, toh wo naye unseeen data par fail ho jaata hai. Wo noise ko bhi pattern samajhne ki galti kar baithta hai.

Lekin kya hoga agar model memorze karna toh door, data ke basic underlying pattern ko bhi na samajh paaye?

Aaj Day 24 par hum Machine Learning ki doosri sabse common problem ko samjhenge: Underfitting. Agar Overfitting ka matlab hai over-complicating things, toh Underfitting ka matlab hai over-simplifying things.

Coach Krish says:

“Machine Learning mein balance hi sab kuch hai. Overfitting mein model zaroorat se zyada smart banne ki koshish karta hai, aur Underfitting mein model itna lazy ya simple hota hai ki wo basic pattern bhi catch nahi kar paata.”

What You Will Learn Today

  • Underfitting kya hai aur ye kyun hoti hai?
  • Overfitting aur Underfitting mein real-world difference kya hai?
  • Underfitting ko detect kaise karein (Training Error vs Testing Error)?
  • Underfitting ko fix karne ke 4 practical tarike
  • Python mein Underfitting ka live visual code example

1. Underfitting Kya Hai? (What is Underfitting?)

Underfitting tab hoti hai jab ek Machine Learning model itna simple hota hai ki wo training data ke andar maujood fundamental relationship ya patterns ko learn hi nahi kar pata.

Iska result ye hota hai ki model dono par poor performance deta hai:

  • Training Data par: High Error / Low Accuracy
  • Test/New Data par: High Error / Low Accuracy

Goldene Rule to Identify Underfitting: Agar aapka model Training Data par bhi achha score nahi kar paa raha hai, toh testing data par achha karne ka sawal hi paida nahi hota. Is condition ko hum Underfitting kehte hain.

2. Mental Model & Real-World Example

Is concept ko ek simple real-life example se samajhte hain:

The Exam Preparation Analogy 📚

  • Underfitting Student: Is student ne poore syllabus ke 10 chapters mein se sirf 1 chapter surface-level par padha. Wo test dene gaya aur fail ho gaya, kyunki usne padhai hi zaroorat se kam ki thi (Model too simple).
  • Overfitting Student: Isne textbook ke saare questions aur answers exact punctuation ke saath yaad kar liye. Lekin jab exam mein question ka format thoda sa change hua, toh wo fail ho gaya (Model memorized noise).
  • Good Fit Student: Isne core concepts aur formulas samjhe, practice ki, aur exam mein thode ghuma-phira kar poochhe gaye questions ko bhi solve kar liya (Balanced Model).

3. House Price Prediction Example (Curve vs Straight Line)

Imagine kijiye ki hum house size (sq ft) ke basis par house price predict kar rahe hain. Real world mein, house size aur price ka relation non-linear hota hai (jaise-jaise size badhta hai, price ek curve shape mein grow karti hai).

Agar aap is curved pattern par ek bilkul straight line (Linear Regression with no polynomial features) fit karne ki koshish karenge, toh line na toh chhote gharon ki value sahi bata payegi aur na bade gharon ki. Model data ke curve ko catch hi nahi kar paa raha kyunki uske paas flexibility (complexity) hi nahi hai.

Overfitting vs Underfitting vs Good Fit

Feature Underfitting Good Fit (Optimal) Overfitting
Model Complexity Too Simple Balanced Too Complex
Training Error High Error ❌ Low Error ✅ Very Low Error (Near 0) ✅
Test Error High Error ❌ Low Error ✅ High Error ❌
Analogy Padhai hi nahi ki Concept samjha Rattamār (Memorized)
Main Cause High Bias Optimal Trade-off High Variance

4. Python Code Demonstration

Dekhte hain ki Scikit-Learn mein jab hum ek complex non-linear pattern par ek simple linear model apply karte hain, toh Underfitting kaise dikhti hai:

import numpy as np
from sklearn.linear_model import LinearRegression
from sklearn.metrics import mean_squared_error

# Step 1: Generate non-linear data (y = x^2 + noise)
X = np.array([[1], [2], [3], [4], [5], [6], [7], [8]])
y = np.array([1, 4, 9, 16, 25, 36, 49, 64])  # Quadratic relationship

# Step 2: Fit a simple Linear Regression model (Too simple for quadratic data)
model = LinearRegression()
model.fit(X, y)

# Step 3: Check predictions and Training Error
predictions = model.predict(X)
mse = mean_squared_error(y, predictions)

print(f"Mean Squared Error (Training): {mse:.2f}")
# Output will have high error because a straight line cannot capture a square curve!
# This is UNDERFITTING.

5. Underfitting Kyun Hoti Hai Aur Isko Fix Kaise Karein?

Jab aapka model underfit kar raha ho, toh use solve karne ke ye primary techniques hain:

  1. Increase Model Complexity:

    Agar aap simple Linear Regression use kar rahe hain, toh Polynomial Regression, Decision Trees ya Neural Networks ki taraf shift karein jo complex patterns learn kar sakte hain.

  2. Add More / Better Features (Feature Engineering):

    Aapke model ko shayad zaroori information nahi mil rahi hai. Process mein naye relevant features add karein jo target variable ko predict karne mein madad karein.

  3. Decrease Regularization:

    L1/L2 Regularization techniques model ko over-simplify kar sakti hain. Agar regularization penalty bohot zyada high hai, toh model learn nahi kar pata. Regularization parameters (jaise alpha ya lambda) ko kam karein.

  4. Train for More Epochs / Reduce Early Stopping:

    Deep Learning models mein, agar aap training process ko bohot jaldi stop kar dete hain (under-training), toh model weights proper values tak converge nahi ho pate. Epochs badhayein.


Quick Recall Checkpoint 🧠

Apne understanding ko test kijiye (Click to reveal answer):

Question 1: Agar ek model ka Training Accuracy 55% hai aur Test Accuracy 52% hai, toh isme konsi problem hai?

Answer: Isme Underfitting hai! Kyunki model training data par hi achha perform nahi kar paa raha hai (dono accuracy low hain).

Question 2: Underfitting ko solve karne ke liye Regularization ko badhana chahiye ya kam karna chahiye?

Answer: Regularization ko kam (decrease) karna chahiye, kyunki high regularization model ko over-simplify kar deta hai.

Question 3: Underfitting high bias se related hai ya high variance se?

Answer: Underfitting **High Bias** se related hai, kyunki model data ke baare mein wrong strong assumptions bana leta hai.

Key Takeaways — Day 24

  • Underfitting tab hoti hai jab model data ke basic underlying patterns ko capture karne mein fail ho jaata hai.
  • Underfit model ka error Training Data aur Testing Data **dono** par high hota hai.
  • Iska main reason model ka excessively simple hona ya key features ka missing hona hai.
  • Fixes: Model complexity badhayein, feature engineering karein, aur regularization penalty kam karein.

What Comes Next?

Ab tak humne dekha ki Overfitting (Day 23) model ko bohot complex bana deti hai, aur Underfitting (Day 24) model ko bohot simple bana deti hai.

Toh phir perfect ML model kaise banayein? In dono extreme points ke beech ka balance kaise find karein?

Isi balance ko Machine Learning mein Bias-Variance Tradeoff kehte hain! Day 25: Bias vs Variance mein hum isi core concept ko detail mein samjhenge.

English mein continue karna chahte hain? Continue with the English version of this course.

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top