Generally if your Mac has been running Sierra it will be compatible with the new 10.13 Mac OS – High Sierra which introduces a new file system and a host of other updates.
However some users have found compatibility problems when using software with third party plug-ins such as the popular Nik Collection with Photoshop.
Some users have reported application crashes when rendering images after applying Nik filters or attempting to edit images within smart objects.
The work-around seems to be to launch the Nik software from the Selective Tool interface; not from the Photoshop filters menu.
I don’t know of any work-around for editing smart objects, but perhaps it is necessary to create a new flattened image before applying further Nik Collection filters.