DC is very much a political capital and university city, so there's not much in the way of specific toy stores that I recall.

In terms of general places to go, I'd suggest going to Georgetown and Adams Morgan. Arlington Cemetery is interesting if you're a fan of history and historical figures.