You can with ASS subtitles. Click on the "Edit style" button on the lower right part of the screen (a pen-like button), open advanved options and under "border" select "Opaque box"
Then save as ASS format. The problem with this approach is that you need a aplayer that properly understands ASS format - and unbfortunately there aren't a lot of them