The Ka’bah was not in one place and then moved, rather it was built in the place where it is now, and it has not been moved from that time. The scholars differed as to who built the Ka’bah. It was said that it was the angels, or Adam (peace be upon him), or Ibraaheem (peace be upon him) – the latter is the correct view. 

Allaah says (interpretation of the meaning): 

“And (remember) when Ibraaheem (Abraham) and (his son) Ismaa’eel (Ishmael) were raising the foundations of the House (the Ka‘bah at Makkah), (saying), ‘Our Lord! Accept (this service) from us. Verily, You are the All-Hearer, the All-Knower’”

[al-Baqarah 2:127]

It was narrated that Abu Dharr (may Allaah be pleased with him) said: I said, “O Messenger of Allaah, which mosque was built first on earth?” He said, “Al-Masjid al-Haraam.” I said, “Then which?” He said, “Al-Masjid al-Aqsa.” I asked, “How much time was between them?” He said, “Forty years. So wherever you are when the time for prayer comes, then pray.” 

Narrated by al-Bukhaari, 3186; Muslim, 520. 

The scholars of the Standing Committee said: 

The Holy Ka’bah is the qiblah of the Muslims towards which they face in every prayer, in obedience to the command of Allaah, as He says (interpretation of the meaning): 

“Verily, We have seen the turning of your (Muhammad’s) face towards the heaven. Surely, We shall turn you to a Qiblah (prayer direction) that shall please you, so turn your face in the direction of Al-Masjid Al-Haraam (at Makkah). And wheresoever you people are, turn your faces (in prayer) in that direction”

[al-Baqarah 2:144]

It is also the place where they perform the rituals of Hajj and ‘Umrah, by circumambulating it, in obedience to the command of Allaah (interpretation of the meaning): 

“and circumambulate the Ancient House (the Ka‘bah at Makkah)”

[al-Hajj 22:29]

And in obedience to what Allaah has prescribed on the lips of His Messenger Muhammad (peace and blessings of Allaah be upon him).  

It was built by Ibraaheem al-Khaleel and his son Ismaa’eel (peace be upon them both) as Allaah tells us (interpretation of the meaning): 

“And (remember) when Ibraaheem (Abraham) and (his son) Ismaa’eel (Ishmael) were raising the foundations of the House (the Ka‘bah at Makkah), (saying), ‘Our Lord! Accept (this service) from us. Verily, You are the All-Hearer, the All-Knower’”

[al-Baqarah 2:127]

And it has been renovated several times since then. 

Shaykh ‘Abd al-‘Azeez ibn ‘Abd-Allaah ibn Baaz, Shaykh ‘Abd al-Razzaaq ‘Afeefi, Shaykh ‘Abd-Allaah ibn Ghadyaan, Shaykh ‘Abd-Allaah ibn Qa’ood. 

Fataawa al-Lajnah al-Daa’imah, 6/310 

And Allaah knows best.