A computer case holds all of your components and come in many different sizes to suit your needs.
A Power Supply takes voltage from the wall and converts it to several different voltages for the cpu, gpu, motherboard and storage.