Your plant fossil is a clubmoss or horsetail stem. These plants were common in peat bogs during the Carboniferous period, about 300 million years ago. Clubmoss and horsetail fossils are commonly found in rocks around the Potteries.
Horsetails are common today and are one of our most ancient native plants. However, they are not particularly popular, especially with gardeners, as they can be a persistent weed.