It's probably fruit, as a seed would have had different shape, and it would seem to have fallen at a time of extremely hot weather becoming quickly dehydrated after being invaded by some form of herbivore. I would discount bivalve activity but a terra based gastropod may have been the perpetrator before the fruit became petrified.
Some times we would find small pieces of underwater plant fossils on the shore also. Sometimes we would find plant fossils in a shale rock cliffs as the shale breaks away.
!