We propose a new scheme to generate polychromatic holograms by manipulating the Pancharatnam-Berry phase. Using anisotropic transmission characteristics and tuning the resonant wavelengths of nanoslits, multicolor holograms can be produced for arbitrary RGB images.