Open the Album or the current playlist, hold the track for 1s and select "show Artwork". That's not fullscreen but as big as it gets
Thanks, I knew it was a dumb question. What threw me off was that it wasn't available from the album context menu. Would it make sense to put it there?