Mississippi State bounced back from a disappointing loss on the road to Western Kentucky last week to knock off then 14th ranked Ole Miss in Oxford to begin conference play.