The main limitation of the download count that it does not reflect usage. For example, a completely useless extension may get larger download count if its name suggests that it could be useful.
We would need to collect usage statistics to more accurately measure impact or usefulness - see Should we start collecting software usage data?