The war of words continues between Alaska Gov. Sarah Palin and the father of her grandson.

Levi Johnston, 18, is the father of Tripp, the infant son the Alaska governor’s daughter, Bristol, gave birth to last December. The high school sweethearts have since broken off their engagement.

On The Tyra Banks Show Monday, Levi said Sarah Palin knew the two teens were having sex before Bristol got pregnant–a claim the Palin camp vehemently denies.

Levi says contrary to what the Palins think, he and his family are not “white trash,” and it’s time to set the record straight.

“They said I didn’t live there,” he said. “[They say] I ‘stayed’ there. I was like, ‘Okay, whatever you want to call it’ – I had all my stuff there. So, if you wanna call it staying there, that’s fine,” the teen contractor told CBS’ The Early Show Wednesday.