Where do LLMs actually earn their place in a recommender system? Kim Falk’s new book + 5 ebook giveaway [D]

Hi r/MachineLearning,

Stjepan from Manning here. The mods approved this post, and I appreciate being welcomed back to share another book with you.

We’ve just launched AI Recommender Systems: Transformers, LLMs, agents, and RAG by Kim Falk in MEAP, our early-access program. Kim also wrote Practical Recommender Systems and has spent the past 15 years building recommenders across news, media, and e-commerce.

The question I’d like to put to this community is: where does adding an LLM actually justify the extra complexity in a recommendation pipeline?

There are plausible places for one: extracting useful signals from item descriptions, interpreting a user’s request, or reranking a small candidate set. But those are different jobs, with different failure modes. A convincing explanation of a recommendation doesn’t, by itself, establish that the ranking improved. And a useful reranker can’t rescue an item that candidate generation never retrieved.

That’s what interests me about this book’s scope. It treats recommendation as a pipeline, covering candidate generation, filtering, scoring, and reranking, and examines where LLMs can help within it. It brings content metadata and user behavior into the picture alongside prompts, RAG, and agents, including how to integrate them into existing systems.

It also covers the work that can get lost in a good demo: evaluating against the actual use case, dealing with cold starts, and deploying with production monitoring. The useful question isn’t simply whether the system can produce recommendations. It’s whether the change improves the recommendations enough to justify its cost and operational burden.

This is early access, not a finished book: four chapters are currently available. MEAP includes new chapters as they’re released and the completed ebook, and you can give feedback while the manuscript is still taking shape.

Book details and available preview:
https://www.manning.com/books/ai-recommender-systems

We’re giving away 5 free ebooks of AI Recommender Systems to 5 people whose comments contribute most thoughtfully to the discussion. We’ll choose based on substance, not upvotes. A useful counterexample, a failed experiment, or a well-explained objection is just as welcome as a success story. You don’t need to praise the book to be considered.

Manning is also offering the community 50% off the book with code MLFALK50RE.

If you’ve worked on recommenders, where have transformers or LLMs earned their place, and where has a simpler approach held up better? What evidence convinced you either way?

If you haven’t tried them yet, what experiment would you need to see before changing your current pipeline?

I'll read the comments and try to bring the author here to join the discussion.

Thanks for having us.

Cheers,

Stjepan