Typically crab cakes are made with crab meat, a bready filler like bread or cracker crumbs, eggs, and added flavorings. However, these ingredients, while helping the cakes hold together, can mask the sweet crab flavor; to avoid having your crab cakes from tasting like generic patties, an ideal filler option is shrimp.