Yes they do erode and a common feature of this type of cliff is the sea arch and stack which forms later when the erosion separates it from the main cliff. Clay cliffs would erode fastest and often chalk is to be found in the same areas as limestone.