Peace OneGOD,
Ka'baa was built by Abaraham and Ishmael. People after them used it for their pagan gods, it was restored at the time of muhammad(pbuh). Muhammad destroyed all the idols. Muslims do not bow to Ka'baa, it is only what they face when they pray. The ka'baa in a way is just like the temple.
Just how the temple was the house of God the Ka'baa is the house of God.
No! Abraham never went deep into the desert to build any Kaabah, that's only a myth.