Post #1744

Hugging Face (Twitter) RT @ghita__ha: We are very excited to release zerank-2, @ZeroEntropy_AI 's newest reranker model. 🔥 It shows major improvement on the 5 most common RAG failure modes below. Existing rerankers consistently fail on seemingly “simple” tasks: 🔢 Comparing numbers and date: “Biggest deals closed after 04/2024.” 🗄️ Aggregation: “Top 10 objections of customer X?” 🌍 Multilingual: Major pain point, especially non-English to non-English. 🙏 Instruction-Following: “Find the *counterargument* of the claim in the transcript” 🥇 Calibrated scores: You ask "what should I cook for dinner?", and "I am allergic to nuts" scores too low for your threshold. Many rerankers overfit public benchmarks, and don’t generalize to these real issues. zerank-2 outperforms existing rerankers considerably on all of these failure modes, in real production environments. With zerank-2, you get: * 15% improvement vs Cohere rerank 3.5 on Arabic/Hindi (Miraql dataset) * +12% NDCG@10 on... Перейти на оригинальный пост