SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model | #ai #2025 #genai #google

SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model | #ai #2025 #genai #google

Paper: https://arxiv.org/pdf/2501.17161 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbjluM0EybmhlZVZhdFpGalFINlpkZWlLYlc0QXxBQ3Jtc0tsNHBDQXhjVzR6Um5lVDBBNmd0YmJva05yVUpJSjRKVUpVbnpCUHVYQ1psZlZldFRYRHByUHlPWGU5RHdlQ0dxdjZZUGl4ZzhBWlNSRUV2cU1fZWtjLVh4dGtiX1NqN01pY1hvRmU2SnFyaGJqd000NA&q=https%3A%2F%2Farxiv.org%2Fpdf%2F2501.17161&v=QyZ8NzIVhSs] This research paper compares supervised fine-tuning (SFT) and reinforcement learning (RL) for post-training foundation models. Using novel and existing tasks involving arithmetic and spatial reasoning, the study finds that RL promotes better generalization to unseen data, unlike SFT which tends to memorize training data. Further analysis reveals RL enhances visual recognition capabilities in multimodal models, while SFT aids in stabilizing RL training by improving output formatting. The paper also explores the impact of increased inference-time computation on generalization. #ai [https://www.youtube.com/hashtag/ai], #artificialintelligence [https://www.youtube.com/hashtag/artificialintelligence], #arxiv [https://www.youtube.com/hashtag/arxiv], #research [https://www.youtube.com/hashtag/research], #paper [https://www.youtube.com/hashtag/paper], #publication [https://www.youtube.com/hashtag/publication], #llm [https://www.youtube.com/hashtag/llm], #genai [https://www.youtube.com/hashtag/genai], #generativeai [https://www.youtube.com/hashtag/generativeai], #largevisualmodels [https://www.youtube.com/hashtag/largevisualmodels], #largelanguagemodels [https://www.youtube.com/hashtag/largelanguagemodels], #largemultimodalmodels [https://www.youtube.com/hashtag/largemultimodalmodels], #nlp [https://www.youtube.com/hashtag/nlp], #text [https://www.youtube.com/hashtag/text], #machinelearning [https://www.youtube.com/hashtag/machinelearning], #ml [https://www.youtube.com/hashtag/ml], #nvidia [https://www.youtube.com/hashtag/nvidia], #openai [https://www.youtube.com/hashtag/openai], #anthropic [https://www.youtube.com/hashtag/anthropic], #microsoft [https://www.youtube.com/hashtag/microsoft], #google [https://www.youtube.com/hashtag/google], #technology [https://www.youtube.com/hashtag/technology], #cuttingedge [https://www.youtube.com/hashtag/cuttingedge], #meta [https://www.youtube.com/hashtag/meta], #llama [https://www.youtube.com/hashtag/llama], #chatgpt [https://www.youtube.com/hashtag/chatgpt], #gpt [https://www.youtube.com/hashtag/gpt], #elonmusk [https://www.youtube.com/hashtag/elonmusk], #samaltman [https://www.youtube.com/hashtag/samaltman], #deployment [https://www.youtube.com/hashtag/deployment], #engineering [https://www.youtube.com/hashtag/engineering], #scholar [https://www.youtube.com/hashtag/scholar], #science [https://www.youtube.com/hashtag/science], #apple [https://www.youtube.com/hashtag/apple], #samsung [https://www.youtube.com/hashtag/samsung], #turing [https://www.youtube.com/hashtag/turing], #aiethics [https://www.youtube.com/hashtag/aiethics], #innovation [https://www.youtube.com/hashtag/innovation], #futuretech [https://www.youtube.com/hashtag/futuretech], #deeplearning [https://www.youtube.com/hashtag/deeplearning], #datascience [https://www.youtube.com/hashtag/datascience], #computervision [https://www.youtube.com/hashtag/computervision], #autonomoussystems [https://www.youtube.com/hashtag/autonomoussystems], #robotics [https://www.youtube.com/hashtag/robotics], #dataprivacy [https://www.youtube.com/hashtag/dataprivacy], #cybersecurity [https://www.youtube.com/hashtag/cybersecurity], #digitaltransformation [https://www.youtube.com/hashtag/digitaltransformation], #quantumcomputing [https://www.youtube.com/hashtag/quantumcomputing], #aiapplications [https://www.youtube.com/hashtag/aiapplications], #aiethics [https://www.youtube.com/hashtag/aiethics], #techleadership [https://www.youtube.com/hashtag/techleadership], #technews [https://www.youtube.com/hashtag/technews], #aiinsights [https://www.youtube.com/hashtag/aiinsights], #aiindustry [https://www.youtube.com/hashtag/aiindustry], #aiadvancements [https://www.youtube.com/hashtag/aiadvancements], #futureai [https://www.youtube.com/hashtag/futureai], #airesearchers [https://www.youtube.com/hashtag/airesearchers]

Deepseek Janus-Pro: Unified Multimodal Understanding and Generation | #ai #2025 #genai #deepseek

Paper: https://github.com/deepseek-ai/Janus/blob/main/janus_pro_tech_report.pdf Github: https://github.com/deepseek-ai/Janus/tree/main?tab=readme-ov-file The paper introduces Janus-Pro, an improved multimodal model building upon its predecessor, Janus. Janus-Pro boasts enhanced performance in both multimodal understanding and text-to-image generation due to optimized training strategies, expanded datasets (including synthetic aesthetic data), and a larger model size (1B and 7B parameter versions). The architecture uses decoupled visual encoding for improved efficiency and performance across various benchmarks. Results show significant gains over previous state-of-the-art models, although limitations remain in resolution and fine detail. The code and models are publicly available. #ai, #artificialintelligence, #arxiv, #research, #paper, #publication, #llm, #genai, #generativeai, #largevisualmodels, #largelanguagemodels, #largemultimodalmodels, #nlp, #text, #machinelearning, #ml, #nvidia, #openai, #anthropic, #microsoft, #google, #technology, #cuttingedge, #meta, #llama, #chatgpt, #gpt, #elonmusk, #samaltman, #deployment, #engineering, #scholar, #science, #apple, #samsung, #turing, #aiethics, #innovation, #futuretech, #deeplearning, #datascience, #computervision, #autonomoussystems, #robotics, #dataprivacy, #cybersecurity, #digitaltransformation, #quantumcomputing, #aiapplications, #aiethics, #techleadership, #technews, #aiinsights, #aiindustry, #aiadvancements, #futureai, #airesearchers

Memory Layers at Scale | #ai #2024 #genai #meta

Paper: https://arxiv.org/pdf/2412.09764 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa3R6amRKcUtJNWZQTjRRMjVodzU0MFVGaVF0Z3xBQ3Jtc0trMVJaeENIWXA5aU1iakV0b1VTZWxrbU5MemVjTzdZZ1ZpSDNCN2tON2lvR1ZkZERLdlRPeGZPc2s5cV83TFZXVVAwZFB2R0RuMTY5ZTN0Q2tDdDBJajFNQlQ5c1M4emRDMnZoaVJCMHVWSndOeVliNA&q=https%3A%2F%2Farxiv.org%2Fpdf%2F2412.09764&v=2wNF8m0Tdjw] This research paper explores the effectiveness of memory layers in significantly enhancing large language models (LLMs). By incorporating a trainable key-value lookup mechanism, memory layers add parameters without increasing computational cost, improving factual accuracy and overall performance on various tasks. The researchers demonstrate substantial gains, especially on factual tasks, even surpassing models with much larger computational budgets and outperforming mixture-of-experts models. They detail improvements in memory layer implementation, achieving scalability with up to 128 billion memory parameters, and discuss various architectural optimizations. The findings strongly advocate for integrating memory layers into future AI architectures. #ai [https://www.youtube.com/hashtag/ai], #artificialintelligence [https://www.youtube.com/hashtag/artificialintelligence], #arxiv [https://www.youtube.com/hashtag/arxiv], #research [https://www.youtube.com/hashtag/research], #paper [https://www.youtube.com/hashtag/paper], #publication [https://www.youtube.com/hashtag/publication], #llm [https://www.youtube.com/hashtag/llm], #genai [https://www.youtube.com/hashtag/genai], #generativeai [https://www.youtube.com/hashtag/generativeai], #largevisualmodels [https://www.youtube.com/hashtag/largevisualmodels], #largelanguagemodels [https://www.youtube.com/hashtag/largelanguagemodels], #largemultimodalmodels [https://www.youtube.com/hashtag/largemultimodalmodels], #nlp [https://www.youtube.com/hashtag/nlp], #text [https://www.youtube.com/hashtag/text], #machinelearning [https://www.youtube.com/hashtag/machinelearning], #ml [https://www.youtube.com/hashtag/ml], #nvidia [https://www.youtube.com/hashtag/nvidia], #openai [https://www.youtube.com/hashtag/openai], #anthropic [https://www.youtube.com/hashtag/anthropic], #microsoft [https://www.youtube.com/hashtag/microsoft], #google [https://www.youtube.com/hashtag/google], #technology [https://www.youtube.com/hashtag/technology], #cuttingedge [https://www.youtube.com/hashtag/cuttingedge], #meta [https://www.youtube.com/hashtag/meta], #llama [https://www.youtube.com/hashtag/llama], #chatgpt [https://www.youtube.com/hashtag/chatgpt], #gpt [https://www.youtube.com/hashtag/gpt], #elonmusk [https://www.youtube.com/hashtag/elonmusk], #samaltman [https://www.youtube.com/hashtag/samaltman], #deployment [https://www.youtube.com/hashtag/deployment], #engineering [https://www.youtube.com/hashtag/engineering], #scholar [https://www.youtube.com/hashtag/scholar], #science [https://www.youtube.com/hashtag/science], #apple [https://www.youtube.com/hashtag/apple], #samsung [https://www.youtube.com/hashtag/samsung], #turing [https://www.youtube.com/hashtag/turing], #aiethics [https://www.youtube.com/hashtag/aiethics], #innovation [https://www.youtube.com/hashtag/innovation], #futuretech [https://www.youtube.com/hashtag/futuretech], #deeplearning [https://www.youtube.com/hashtag/deeplearning], #datascience [https://www.youtube.com/hashtag/datascience], #computervision [https://www.youtube.com/hashtag/computervision], #autonomoussystems [https://www.youtube.com/hashtag/autonomoussystems], #robotics [https://www.youtube.com/hashtag/robotics], #dataprivacy [https://www.youtube.com/hashtag/dataprivacy], #cybersecurity [https://www.youtube.com/hashtag/cybersecurity], #digitaltransformation [https://www.youtube.com/hashtag/digitaltransformation], #quantumcomputing [https://www.youtube.com/hashtag/quantumcomputing], #aiapplications [https://www.youtube.com/hashtag/aiapplications], #aiethics [https://www.youtube.com/hashtag/aiethics], #techleadership [https://www.youtube.com/hashtag/techleadership], #technews [https://www.youtube.com/hashtag/technews], #aiinsights [https://www.youtube.com/hashtag/aiinsights], #aiindustry [https://www.youtube.com/hashtag/aiindustry], #aiadvancements [https://www.youtube.com/hashtag/aiadvancements], #futureai [https://www.youtube.com/hashtag/futureai], #airesearchers [https://www.youtube.com/hashtag/airesearchers]

Large Concept Models: Language Modeling in a Sentence Representation Space | #ai #2024 #genai

Paper: https://scontent-dfw5-1.xx.fbcdn.net/... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbE02bjRIaXRsZjQ4RENVSjRqNFRIS0tpb3JKd3xBQ3Jtc0trTDAtMm5EdkNvRm81UEFtOE4tZnM3ZkZRZ3VlOVVGWnlVT2J1Q0ZxTWUzXzF5V1RZY01XMG00OGQ3aDcxRzNIbEl3ekRwUkxwMnJWQjY1cTBYX1Q5b1VUVUhxVGJnc2Y1czBBMjRtbFA0VjdHbGtBUQ&q=https%3A%2F%2Fscontent-dfw5-1.xx.fbcdn.net%2Fv%2Ft39.2365-6%2F470149925_936340665123313_5359535905316748287_n.pdf%3F_nc_cat%3D103%26ccb%3D1-7%26_nc_sid%3D3c67a6%26_nc_ohc%3DBtkg02jO2KsQ7kNvgFyzGnm%26_nc_zt%3D14%26_nc_ht%3Dscontent-dfw5-1.xx%26_nc_gid%3DA38CgznlX57U-y2Uz_BVazu%26oh%3D00_AYBxdIAGQE1lIt0dheV7P9MPditL-rNqdt1xjiVdtvJs8w%26oe%3D6781C6D2&v=sgXOToieWz8] This research paper introduces Large Concept Models (LCMs), a novel approach to language modeling that operates on sentence embeddings instead of individual tokens. LCMs aim to mimic human-like abstract reasoning by processing information at a higher semantic level, enabling improved handling of long-form text generation and zero-shot multilingual capabilities. The authors explore various LCM architectures, including MSE regression, diffusion-based generation, and quantized models, evaluating their performance on summarization, summary expansion, and cross-lingual tasks. The study demonstrates that diffusion-based LCMs outperform other methods, exhibiting impressive zero-shot generalization across multiple languages. Finally, the authors propose extending the LCM framework with a high-level planning model to further enhance coherence in long-form text generation. #ai [https://www.youtube.com/hashtag/ai], #artificialintelligence [https://www.youtube.com/hashtag/artificialintelligence], #arxiv [https://www.youtube.com/hashtag/arxiv], #research [https://www.youtube.com/hashtag/research], #paper [https://www.youtube.com/hashtag/paper], #publication [https://www.youtube.com/hashtag/publication], #llm [https://www.youtube.com/hashtag/llm], #genai [https://www.youtube.com/hashtag/genai], #generativeai [https://www.youtube.com/hashtag/generativeai], #largevisualmodels [https://www.youtube.com/hashtag/largevisualmodels], #largelanguagemodels [https://www.youtube.com/hashtag/largelanguagemodels], #largemultimodalmodels [https://www.youtube.com/hashtag/largemultimodalmodels], #nlp [https://www.youtube.com/hashtag/nlp], #text [https://www.youtube.com/hashtag/text], #machinelearning [https://www.youtube.com/hashtag/machinelearning], #ml [https://www.youtube.com/hashtag/ml], #nvidia [https://www.youtube.com/hashtag/nvidia], #openai [https://www.youtube.com/hashtag/openai], #anthropic [https://www.youtube.com/hashtag/anthropic], #microsoft [https://www.youtube.com/hashtag/microsoft], #google [https://www.youtube.com/hashtag/google], #technology [https://www.youtube.com/hashtag/technology], #cuttingedge [https://www.youtube.com/hashtag/cuttingedge], #meta [https://www.youtube.com/hashtag/meta], #llama [https://www.youtube.com/hashtag/llama], #chatgpt [https://www.youtube.com/hashtag/chatgpt], #gpt [https://www.youtube.com/hashtag/gpt], #elonmusk [https://www.youtube.com/hashtag/elonmusk], #samaltman [https://www.youtube.com/hashtag/samaltman], #deployment [https://www.youtube.com/hashtag/deployment], #engineering [https://www.youtube.com/hashtag/engineering], #scholar [https://www.youtube.com/hashtag/scholar], #science [https://www.youtube.com/hashtag/science], #apple [https://www.youtube.com/hashtag/apple], #samsung [https://www.youtube.com/hashtag/samsung], #turing [https://www.youtube.com/hashtag/turing], #aiethics [https://www.youtube.com/hashtag/aiethics], #innovation [https://www.youtube.com/hashtag/innovation], #futuretech [https://www.youtube.com/hashtag/futuretech], #deeplearning [https://www.youtube.com/hashtag/deeplearning], #datascience [https://www.youtube.com/hashtag/datascience], #computervision [https://www.youtube.com/hashtag/computervision], #autonomoussystems [https://www.youtube.com/hashtag/autonomoussystems], #robotics [https://www.youtube.com/hashtag/robotics], #dataprivacy [https://www.youtube.com/hashtag/dataprivacy], #cybersecurity [https://www.youtube.com/hashtag/cybersecurity], #digitaltransformation [https://www.youtube.com/hashtag/digitaltransformation], #quantumcomputing [https://www.youtube.com/hashtag/quantumcomputing], #aiapplications [https://www.youtube.com/hashtag/aiapplications], #aiethics [https://www.youtube.com/hashtag/aiethics], #techleadership [https://www.youtube.com/hashtag/techleadership], #technews [https://www.youtube.com/hashtag/technews], #aiinsights [https://www.youtube.com/hashtag/aiinsights], #aiindustry [https://www.youtube.com/hashtag/aiindustry], #aiadvancements [https://www.youtube.com/hashtag/aiadvancements], #futureai [https://www.youtube.com/hashtag/futureai], #airesearchers [https://www.youtube.com/hashtag/airesearchers]

DeepSeek v3 | #ai #2024 #genai

Technical Report: https://arxiv.org/pdf/2412.19437 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbld4Y05qSG5UeWJ4QzhRMVAxMHVnV3B5X0Q2QXxBQ3Jtc0trb1J3THVyRllSZ1VKaVBEdnVOUWVxbk1PaGxSRlBfNDBVWElWYkIwVndsVnZOMDBSWElxOW1ndGtfdVR2X2JCZlRsR0pTckFCSlJxZVRjeU1iMktlWV9vMVg0NExhbGVhX2Uxc2NfQnVJbWRtYXBUaw&q=https%3A%2F%2Farxiv.org%2Fpdf%2F2412.19437&v=71gYXnxZV6U] Github: https://github.com/deepseek-ai/DeepSe... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbVh6OFd2ejVaS09rakFNci1SOUQtNlZFcEEyd3xBQ3Jtc0ttOUJVQ3FVeUVIZnFyVnhTWjdLR1BmN0JIaFIyMTJuZUlKNzNuS3NXWGtIbE9EbVNaVDBGV2RQUVVmN1pVMklLR09yeXlZeVlyTlg0UmlCd3pJY05DREU4aUduOEVIMWdsNmdUQjQ2amRaSjdlS09mUQ&q=https%3A%2F%2Fgithub.com%2Fdeepseek-ai%2FDeepSeek-V3&v=71gYXnxZV6U] This research paper introduces DeepSeek-V3, a 671-billion parameter Mixture-of-Experts (MoE) large language model. The paper details DeepSeek-V3's architecture, including its innovative auxiliary-loss-free load balancing strategy and Multi-Token Prediction objective, and its efficient training framework utilizing FP8 precision. Extensive evaluations demonstrate DeepSeek-V3's superior performance across various benchmarks compared to other open-source and some closed-source models, particularly in code and math tasks. The paper also discusses post-training methods like supervised fine-tuning and reinforcement learning, along with deployment strategies and hardware design suggestions. Finally, it acknowledges limitations and suggests future research directions #ai [https://www.youtube.com/hashtag/ai], #artificialintelligence [https://www.youtube.com/hashtag/artificialintelligence], #arxiv [https://www.youtube.com/hashtag/arxiv], #research [https://www.youtube.com/hashtag/research], #paper [https://www.youtube.com/hashtag/paper], #publication [https://www.youtube.com/hashtag/publication], #llm [https://www.youtube.com/hashtag/llm], #genai [https://www.youtube.com/hashtag/genai], #generativeai [https://www.youtube.com/hashtag/generativeai], #largevisualmodels [https://www.youtube.com/hashtag/largevisualmodels], #largelanguagemodels [https://www.youtube.com/hashtag/largelanguagemodels], #largemultimodalmodels [https://www.youtube.com/hashtag/largemultimodalmodels], #nlp [https://www.youtube.com/hashtag/nlp], #text [https://www.youtube.com/hashtag/text], #machinelearning [https://www.youtube.com/hashtag/machinelearning], #ml [https://www.youtube.com/hashtag/ml], #nvidia [https://www.youtube.com/hashtag/nvidia], #openai [https://www.youtube.com/hashtag/openai], #anthropic [https://www.youtube.com/hashtag/anthropic], #microsoft [https://www.youtube.com/hashtag/microsoft], #google [https://www.youtube.com/hashtag/google], #technology [https://www.youtube.com/hashtag/technology], #cuttingedge [https://www.youtube.com/hashtag/cuttingedge], #meta [https://www.youtube.com/hashtag/meta], #llama [https://www.youtube.com/hashtag/llama], #chatgpt [https://www.youtube.com/hashtag/chatgpt], #gpt [https://www.youtube.com/hashtag/gpt], #elonmusk [https://www.youtube.com/hashtag/elonmusk], #samaltman [https://www.youtube.com/hashtag/samaltman], #deployment [https://www.youtube.com/hashtag/deployment], #engineering [https://www.youtube.com/hashtag/engineering], #scholar [https://www.youtube.com/hashtag/scholar], #science [https://www.youtube.com/hashtag/science], #apple [https://www.youtube.com/hashtag/apple], #samsung [https://www.youtube.com/hashtag/samsung], #turing [https://www.youtube.com/hashtag/turing], #aiethics [https://www.youtube.com/hashtag/aiethics], #innovation [https://www.youtube.com/hashtag/innovation], #futuretech [https://www.youtube.com/hashtag/futuretech], #deeplearning [https://www.youtube.com/hashtag/deeplearning], #datascience [https://www.youtube.com/hashtag/datascience], #computervision [https://www.youtube.com/hashtag/computervision], #autonomoussystems [https://www.youtube.com/hashtag/autonomoussystems], #robotics [https://www.youtube.com/hashtag/robotics], #dataprivacy [https://www.youtube.com/hashtag/dataprivacy], #cybersecurity [https://www.youtube.com/hashtag/cybersecurity], #digitaltransformation [https://www.youtube.com/hashtag/digitaltransformation], #quantumcomputing [https://www.youtube.com/hashtag/quantumcomputing], #aiapplications [https://www.youtube.com/hashtag/aiapplications], #aiethics [https://www.youtube.com/hashtag/aiethics], #techleadership [https://www.youtube.com/hashtag/techleadership], #technews [https://www.youtube.com/hashtag/technews], #aiinsights [https://www.youtube.com/hashtag/aiinsights], #aiindustry [https://www.youtube.com/hashtag/aiindustry], #aiadvancements [https://www.youtube.com/hashtag/aiadvancements], #futureai [https://www.youtube.com/hashtag/futureai], #airesearchers [https://www.youtube.com/hashtag/airesearchers]