Wood is a better insulator than brick actually. Sitting outside in the winter on a wooden bench would feel warmer than on one made of brick even if they are at the same temperature. A log cabin without insulation is better insulated than a brick building without insulation. Problem is that US homes aren’t log buildings but stick frames boarded up with cheap chipboard.