[MTHCA] 1. feature: added a mechanism, preventing unloading MTHCA driver while there...

[MTHCA] 1. feature: added a mechanism, preventing unloading MTHCA driver while there are applications, working with it.
2. feature: (for applications in checked version) read dbg flag and level from MLNX_TRACE_LVL.
3. improvement: the polling interval for HCA command completion decreased from ~166 msec to 0, which seriously speeded the driver startup and multi-process tests.
4. improvement: improved mechanism of bitmap searching.
5. improvement: new mechanism for registration of user memory.
6. bugfix: fence bit support in post_send verbs in kernel and userspace.
7. bugfix: restore capabilities of the HCA card during its reset.
8. bugfix: handling of IBAL DEVICE_REMOVE_CANCELLED notification.
9. bugfix: in preventing secondary dereferencing of the PCI BUS interface.
10. potential improvement: added a more fair algorithm of HCA command completion polling, which performs the polling with increasing interval. The algorithm is under USE_FAIR_GO_BIT_POLLING preprocessor variable, which is not defined for now. We need to perform tuning of the parameters of the algorithm before enabling it.

git-svn-id: svn://openib.tc.cornell.edu/gen1@386 ad392aa1-c5ef-ae45-8dd8-e69d62a5ef86