Only hearing chat on PS4

In order to hear game audio on a headset connected to the PS4 controller, you must change the audio output mode to "All Audio":

Go into Settings, Devices, Audio Devices and set Output to Headphone to All Audio