Bring a large pot of water to a boil.
Pack fiddleheads into a pint-size jar.
Pour vinegar into a small saucepan.
Add sugar, mustard seeds, allspice, and pepper to vinegar and bring to a boil.
Pour vinegar mixture over fiddleheads.
Seal jar and process in boiling water for 10 minutes. Let jar sit until cool.