Yes. Training, automation, internal development, and process improvement consume working time and are company investments. Without tracking, you cannot assess their actual cost or compare an in-house solution with an external contractor.
Create separate projects or categories for this work and define the expected outcome in advance. Review not only the hours spent but also the effect achieved: less manual work, fewer errors, a completed asset, or a new product capability.