I have never worked with that unit op in that simulator. Looking at your screenshot, I interpret that you have specified the flue gas temperature after your water coil to be 700C. You have less than 5 gpm water at low pressure in the water coil. Under those conditions, the water outlet would be very close to the flue gas temperature. The conditions you have set are unrealistic and perhaps beyond the capability of the code in the unit op. This is just a guess. With your air to fuel ratio of 28 (this seems high to me), the large amount of flue gas is not going to be affected much by the trickle of water in the coil. This means the combustion must be converged as if the water coil effectively does not exist. Use more realistic conditions and you may have better results.
If I were modeling this, I would likely use simple heat exchangers or a spreadsheet to get an idea of what the answer should look like before diving into an all-in-one unit op.