This extension displays the number of open tabs for each window on the button and the total number of open tabs (in all windows) in a tip. This is based on the extension by Hilary Mason.