You need a Stamp Album or a folder to keep your stamps in.

There are many different albums available. The good ones are a loose leaf type where annual supplements are made available by the publisher.

My US Stamp album was the Liberty Album published by H. E. Harris. An excellent album for beginners and intermediate collectors. Annual supplements are available.

An option for collectors is to make their own albums - this is sort of the ultimate hobby activity.

A word or two about mounting your stamps in an album. If you collect used stamps, paper hinges (available at hobby shops and stamp shops) are fine since the gum or glue on the stamp has been soaked off already. If you collect mint stamps, most people mount their stamps in plastic mounts whish sandwich the stamp between layers of plastic and allow you to mount them in an album without disturbing the gum on the stamp.

Many times, especially with rarer stamps, the stamp will be hinged even if a mint copy. This is because nicer copies of a stamp contained in old collections were ofter mounted with paper hinges before plastic mounts were available.

You will soon discover that your collecting will amass a large number of stamps. A couple of ways to store the extra copies you have are stock pages or stock books. These have either heavy paper or plastic slots where you can store the extra stamps. If you specialize in a certain type of stamp these might prove better than an album. For example, I also collected Canadian Revenue stamps, and housed then exclusively in a high quality stock book. One excellent source is Lighthouse Publications, Inc. - they produce excellent coin and stamp supplies.