If there is an attractive force between all objects, why do we not feel ourselves gravitating toward massive buildings in our vicinity?

Because there is a far more massive nearby object that's attracting you to it. That object is the planet you're standing on. Compared to its mass, that massive building could just as well be a speck of dust or a clump of lint. The gravitational attraction toward Earth completely swamps out the attraction toward anything else.