Is East Harlem in New York City walkable? Can I walk to everything or do I need a car?

It's really walkable. And, most of it is close to some form of public transportation if not a number of trains. Unless you're at the very top of East Harlem, having a car will be more of a hindrance than anything.