If a 10M-token context worked, you could download all of yesterday's financial news, put them into the context, and train the LLM on today's S&P 500 stocks to predict whether the stocks will go up or down next day.