But that is not the entire picture, we receive this 'shortwave' radiation from the Sun:
Which is also balanced by an equal amount of energy radiating into space as 'longwave' thermal infrared radiation:
(Both images from NASA Earth Observatory)
Which leads to a major point - we have an atmosphere and a natural 'greenhouse effect' due to the water vapour and carbon dioxide (and other components) that are seen in the above solar radiation spectrum diagram.
Some of the thermal infrared is absorbed by the atmosphere and re-radiated back to the surface. This radiation budget is shown below:
Source: NASA
Something to consider, looking at the value the NASA has for the incoming radiation reaching the Earth's surface - 168 Wm-2 - imagine that being a 168 watt light globes for every square metre - that value increases markedly when the re-radiated thermal infrared is taken into account.
Also, please view the YouTube clip How the Sun Heats the Earth which is a handy verbal and diagrammatic explanation of the content of this answer.