Perhaps the biggest diversification question on investors' minds today is whether they should go beyond public market stocks and bonds — easily accessed through low-cost, tax-efficient index funds — to also invest in alternative investments, from private equity to hedge funds and everything in between.