Check out Making Optimized Personalized Touring Plans with FastPass+ for tips on how to deal with this.
And the answer to your question is never. Never stop optimizing - there is always a better plan out there that will shave 1 minute off your wait times. 