That is what we did, 40 years ago now, sheeesh. Mind the stuff that grew..................As I said clay is offten fertile.
40 years???!!! I don't think I'll live that long! Still, at least I'll have made a start.

That was our first house, we are now in our third and the soil here is a sandy, peaty silt and very easy to work, even if it dries out very quickly.