As to relative humidity: This is the amount of water held in the atmosphere compared with the amount that could be theoretically held at that temperature. Usually the higher the air temperature the greater the theoretical amount of water that can be held in it without precipitation. Don't forget that once the amount of water gets above that theoretical level it precipitates out as rain.
A wet and dry bulb hygrometer (I'm showing my age) used to be the way of measuring RH.
In practice with my incubator I do not bother measuring the RH I just keep water in it from days 3 to 18 and occasionally let it run dry for a few hours now and again.
Temperature however, is really importent. From memory it should be 81.6 to 82.6. It is thought that temperature determines sex of chickens but I'm not sure if that is the main determinant. I suggest you check this temperature as its upper limit should not be exceeded.
Remember however, that in nature a broody hen will occasionally leave the nest to feed and the eggs cool slightly during those periods.
If you can get access to data from someone called Katie Thear she is an authority on keeping chickens in small numbers.
All the best