The speaker is caught in an argument, partly with others and partly with themselves. Someone dismisses the person they love as "just like everybody else," and the speaker insists he isn't. But the poem quickly turns on that certainty. Speaking directly to him, the speaker asks what actually makes him different, and admits that he has given them little reason to believe it.
The central image is the trees he has "grown" in their heart. They suggest love that has taken root and can't easily be removed. The speaker says they cannot cut the trees down, and wonders whether that was the point all along, as if he wanted to be loved this deeply and permanently.
The mood is raw and aching. The stumbling "so- so" makes it feel like spoken, unfiltered hurt. The ending questions, about why he couldn't love them back and why he leaves and returns "without a word," leave the speaker stuck in confusion and unresolved longing.