When adding a caption to a text category that displays on the live site, provide an option for the text category display options to hide or show that caption. Right now the image will show, but the caption will not show on the live site as there are no display options for it.
See the screenshots attached.