According to officials, the flames sparked at a duplex located at 70-72 Gold Street around 1:45 p.m.
Firefighters said both floors on the right side received significant damage, while the left side also sustained minor damage.
Five people were living in the residence, but no one was home when the fire started.
No injuries from the incident were reported.
Fire crews did not yet say what may have started the blaze.