At the moment, you can directly upload images for posts, but not comments. While you can technically include images in comments, you need to already know the URL of the image and manually type out the links.

The dev says built-in uploads for images in comments are coming in the next update: https://lemmy.ca/comment/706452