You need to read the whole Bible since Jesus also said:
John 17:3 "And this is eternal life, that they may know Thee, the only true God, and Jesus Christ whom Thou hast sent. NAS
The temple that existed in the Lord's time was a copy of the one that was destroyed when Judah went into the Babylonian captivity. The Lord was a living temple since the Father was in the Son. You can also find this bit of information in John 17.