Every time your software, web browser, or computer program wants to load a web page it uses at least one connection.

A thread (in the context of proxies) is a connection to an IP address.

For example, 100 threads would provide a maximum of 100 simultaneous connections to a proxy.

Having more connections/threads available means you can process larger work queues faster.