Replacement Handles For Windows Double glazed windows are a common feature. Over time, they may be worn out or rusty. You'll have to know your current handle's spindle length and its fixings in order to replace it. This can be accomplished by looking at the base of the old handle.