Men (at least the highly fashionable ones) wore many accessories in the 1920s. Notice the different types of hats (here we see fedoras, straw boaters, and Newsboy hats). Canes were popular accessories as well as small rings, tie pins, and collar pins.
Men's Fashion: Mid 1920s 'Jazz Suits' were trendy because after WWI, people started to live a different lifestyle that led away from the formal three piece suit with shoulder pads. Life became edgier, more party-like and men dressed in simpler clothing, with hats, and fashionable canes to go out dancing and partying.