Starting off as a muggle that naïve to the Math's and Data Science world.

Day 100

Random Intercept Model

aka Ordinary Least Square (OLS) model

Some brief introduction, before start.

Fixed Effect (Taken only 1 group, level 1)

  • Explain about individual
  • Simple Model / Multiple Regression Model / Classical Model
  • Yij = B0 + B1Xij + Rij , handle individual effect
  • Yij = B0 + B1Xij + B2Zj + Rij , introduce group effect
  • Yij = B0 + B1Xij + B2Zj + B3ZjXij + Rij , introduce interaction effect
  • aka OLS model which just take nesting structure account at the minimum level, using Zj

Exception, when all group sample size nj are equal to one. The researcher need to have no qualied about using the model because nesting structure are not take place in this situation. The focus entirely on the regression coefficient, rather than how the variability of Y is fascinate within the group and between the group.

Random Effect (Taken multiple group, multi level)

  • Within Effect (Individual)
  • Between Effect (Group)
  • Each level corresponds to a population. Eg. for a study of students in schools, there is a population of schools and a population of students.
  • Mean (x) in one group maybe different to another group. X itself have a positive between group variance (interaction effect).
  • Yij = B0j + B1jXij + B2Zj + Rij , introduce group coefficient effect
  • Yij = B0j + B1jXij + Rij , removed group effect from group coefficient effect
  • Yij = γ00 + U0j + γ10 xij + Rij , replace B0j with γ00+U0j as
    • Y00 is average of intercept,
    • U0j is the main effect of the group aka level 2 residual,
    • Y10 is average coefficient for X
  • aka OLS model that do take the nesting structure into account; having larger number of regression parameter

Empty Model aka ANOVA

because it contains not a single explanatory variable. Only contain random group and random variation within group.

Yij = γ00 + U0j + Rij

  • Y00 is the sum of general mean
  • U0j is a random effect at group level
  • Rij is random effect at the individual level

Leave a comment