Any chance the oil is foaming? If not, I would look at the control valve.
Usually there are springs that center the spools as soon as you release the lever. Either the lever and linkage may be binding and delaying the spool centering or maybe one of the springs is broken. They are usually contained inside the valve block to keep trash from accumulating, usually with a cap on each end of the spool.
D2-5J's, D6-9U's, D318 and D333 power units, 12E-99E grader, 922B & 944A wheel loaders, D330C generator set, DW20 water tanker and a bunch of Jersey cows to take care of in my spare time😄