The family first lived in Dumont, NJ where Ed's older brother and sisters were born.

The family moved to Buffalo, NY where Ed was born. His dad's job was with American Machine and Foundry.  Ed's dad worked with a team of engineers that developed the automatic pin stopper (picked up pins) for bowling alleys. Later on, they were told by the company if you don't join the Masons, you don't have a job in this company.  So the Sweeney family moved to Edgewater, NY where they lived with Ed's aunt and uncle.

Eventually the family moved to Bellrose, NY. where Ed attended Our Lady of Victory Elementary School, Floral Park, NY