It’s a loss of time if you cannot learn or remember what you read. Taking notes will help you to remember and if you forgot (because you will forget) you can quickly remember the important takeaways of each book.

Gain of time, gain of productivity.