If it's a book you got from Google Play Books, open the app and tap on the pin next to the book. A grey pin shows that the book is removed from the tablet though still available to read again later. Tapping a grey pin will download the book and make it available offline.
If it's any other kind of book, how you delete it depends on what kind of book it is, but probably requires a file manager app.