Yes, the books for the D4400 will be very helpful working on a D3400 engine. Of course the bore and other dimensions will be different, but as you have noticed the designs are nearly identical otherwise.
You have to remember there are two things to seal around a PC chamber, coolant and compression pressure. The copper washers 4b5647 are at the base of the chamber and seal the chamber into the head/top of the cylinder, keeping the combustion gases out of the cooling system and coolant out of the cylinder. The water jacket to PC chamber joint at the top is sealed with a rubber o-ring 1a2298. These have probably lost all their resilience and are crumbling.
You will have to remove the injectors and then the chambers to change the o-rings. The injector removal requires a special socket that fits over the injector and has a window in the side to allow turning the injector hold down nut without breaking the nipple off the injector. There should be some posts here about how to make one out of a cheap 3/4 drive socket and a piece of pipe.
With the injectors out of the way, then you can remove the chambers with a large hex wrench. It may be helpful to use an impact wrench to rattle them out, switching directions if it binds up, to avoid taking the threads out of the head. If you are unlucky and damage the head getting the chambers out, there are kits to put thread inserts in, so all is not lost! And yes, the setscrews do lock the chamber in the head. These were deleted on later models.
New sealing washers may not be copper, some will be plated soft steel. With either copper or steel washers, a good coat of copper antiseize on all surfaces is a great idea when you reassemble it.
D2-5J's, D6-9U's, D318 and D333 power units, 12E-99E grader, 922B & 944A wheel loaders, D330C generator set, DW20 water tanker and a bunch of Jersey cows to take care of in my spare time😄