My kids are teens now, but we primarily stayed at moderates when they were younger with a couple of deluxe trips sprinkled in between.
FWIW, the two deluxe “counter service” options we experienced (Wilderness Lodge & Yacht Club) weren’t even close to being as good as Port Orleans Riverside (or PoP, a value but still far better for quick food options than WL or YC). While both were okay, they really weren’t great and with little ones we wanted more counter service variety…not needing the table service options.
Don’t get me wrong, I adored Wilderness Lodge (still my very favorite) but Roaring Forks was less than impressive and probably the only thing I didn’t love about our stay there.
For me it would come down to proximity and if you need more table service options, or more counter service.