AN UPDATE..
I am still having the same issue with the bleeder valve popping up by the end of a drive.
Today I got the coolant system pressure tested in case the visual inspection had leaks that I did not see. The pressure was held so no leaks in the cooling system.
However, this still means that the pressure being built is higher than it should be. The friend who did the pressure test suggested that there may be a blockage somewhere. A Google on causes for high cooling system pressure bought up a few mentions of head gaskets!

I checked the coolant reservoir and the fluid looks quite brown (which was mentioned as a sign of head gasket issues). Would the pressure test hold pressure of this was the case?