computil is a Python module that contains currently a single generator: track. It's a drop in solution for getting regular updates on how long the iteration is going to take.
For example, change this
for url in all_urls:
... into this:
for url in track(all_urls):
... in order to get output like this
2/100 (estimated 10.00mins left)
7/100 (estimated 9.20mins left)
15/100 (estimated 8.63mins left)
20/100 (estimated 7.91mins left)
28/100 (estimated 7.04mins left)
# and so on ...