headful tag should be added to the tests which cannot be run in headless mode. Command line to check: jtreg/bin/jtreg -conc:auto -k:'!headful' -vmoptions:"-Djava.awt.headless=true" -a -verbose -jdk:./build/macosx-x64/images/jdk closed/test/jdk/:jdk_desktop