It is quite possible that the château could have remained in power if it had not been for the Amboise Conspiracy during the French Wars of Religion which effectively cooled the French King's taste for it. They can hardly be blamed since about 1200 were hung from the walls until the stench became so unbearable that the royal family left. Having been unoccupied for years the château was given to Gaston d'Orlèans (brother of Louis XIII) but returned to the Crown upon his death. Louis XIV used the castle as a prison during the Fronde and when that matter was settled it was handed over to Nicolas Fouquet - until his disgrace - and then to the Duc de Lauzun.
Louis XV had no real admiration for the château either and gladly bestowed it on his minister, the Duc de Choiseul. Sadly, most of the original castle were destroyed during the First Empire.