When Berkshire Hathaway starts to dramatically underperform, it is time to be scared.