OK, so you swapped the HDD with a new formatted one. Assuming this drive is in perfect condition and correctly connected, The reason why after the chime (the sound) the folder with the question mark shows up is because the system does not find a bootable drive (I think EFI doesn’t have set up to boot from USB drives by default).
So It’s most likely that you don’t boot from the USB drive or even that USB bootable copy was not correctly made.
Try to start up with the drive attached and pressing and holding the Option (⌥) key immediately upon hearing the '''startup''' chime. Release the key when the '''Startup'''Manager appears, showing you two possible options: your internal HDD and the install USB drive.
Hope this helps!