Actually, if your appliction is a .NET app, it is automatically open by TC. So, clicking on any object in your application could potentially have a delay in the object browser as TC populates the information from the open application. Now, each subsequent click AFTER that should be faster until you restart the application.
In other words, if you have access to the developers that built your application, or for that matter are a developer yourself, create an application that is maybe no more than a single form using the component that you feel is causing the problem and post it up here. That way we can try the component and see if it is, in fact, the problem. For that matter, you could investigate that much yourself.
The idea is to isolate the problem and see if we can figure out a fix for it, eliminating other possibilities.