Answer:
The correct sentence is: "This book lying here is mine."
We use "this" to refer to something that is physically close to us or something that is happening now. So when you're pointing out a book that is lying near you, "this" is the appropriate word to use. On the other hand, "that" is used to refer to something that is farther away or something that is not happening now. I hope this helps!