This issue appears to be a problem with Dozers and Workers not clearing their collision handling with their last placed scaffold.
IF you move a Dozer or worker away from their last placed scaffold, you can then make them path through that scaffold. This remains indefinitely until the scaffold is fully built or you tell the dozer or worker to build a different scaffold or building.
The new scaffold then becomes the scaffold that the dozer can pass through.
This is likely an issue when entering and exiting their building/construction state, when exiting they should clear their collision handling with their last set scaffold so they can no longer path through the scaffold.