Downtown SD is a crap hole. But the rest of SD around downtown is really nice. Also, Disneyland is just 40 min away from SD.
While you're cruising through Downtown, hit as many HoBos as you can. Fun sport. Don't worry, they won't go extinct. There's plenty of them. It's like Downtown SD is a HoBo preserve.