Do we think recursively? Or is language recursive in nature and hence leads to recursive thought? By the way, what is language? See this link. - Human uniqueness, learned symbols and recursive thought -James R Hurford.
PS: There is this blogger who claims that he thinks recursively. I doubt that he thinks, recursion is a far cry ;)