There are two belts when I pull up the parts diagram on the Honda Estore for timing belt. What is the second belt all about? It says something to the line of timing balancer and I'm assuming it's a good idea to replace it as well since I'll be there replacing the h2o pump and timing belt.

 

the second belt drives the balance shafts, and yes it should be replaced when replacing the timing belt.

here is a write-up that covers replacing the balance shaft belt, just for reference...
https://honda-tech.com/forums/honda-accord-1990-2002-2/how-replace-timing-belt-timing-balancer-belt-water-pump-f22b1-1908944/