I'm working on this part and you'll definitely need to implement deep sleep, but also measure voltage. Right now I'm using ESP.getVcc() but im not 100% that is correct. Basically once the battery packs voltage drop below ~2.5v the user should get a warning it needs a recharge (just as a failsafe even when using the solar pack). Also, I haven't tried to see, but also make sure the battery pack allows the esp to draw current when in deep sleep or it wont wake up :$.
I'm not sure you need to measure voltage on one of these power banks; they're made to charge phones over micro USB, so they will have a DC-DC transformer giving 5V all the way down to empty, I believe.
Edit: also, I think the ESP8266 draws about 0.2W on average when it's on. If you have a 10 Wh battery, you can run it for 50 hours in theory. Would you then need deep sleep?