This may sound kind of insulting, but make sure that you are holding the power button on long enough to initiate the device. A lot of times, people will attempt to cut on the camera by being too hasty in pressing the button.
It is normal for electronic devices to get hot with extended use. Try cutting off the camera and giving it a 15 minute "break" to give the internal components a chance to cool off. It doesn't necessarily mean that anything is wrong with your device.