I keep mine locked in a desk drawer, in a locked case. Might be slightly overkill though.
Since stamp companies have no responsibility to check your information before supplying you with a stamp, theoretically that means anyone can order a stamp with your name and license information if they...