First off, GPS has inherent inaccuracy. About 8 meters radius I believe for any given location fix. Typically GPS devices will "smooth" the readings and can lead to a track that seems to be offset from the maps. Some GPS devices will "snap" this track to roads to hide this inaccuracy, others don't.
Second - be careful of assumptions that the road maps are an accurate representation and that mismatch from the GPS location is the GPS's fault. Both the GPS location *and* most maps representations are based on approximations of the fact that our planet isn't perfectly spherical. When you grab a couple different approximations of the oblate spheroid we live on and try to match them up, guess what happens... stuff doesn't always perfectly line up.
Lastly... Does it matter? Common sense says you were on the road not driving through the building. Video evidence will support that as well.