Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies
Paper
•
2407.13623
•
Published
•
36
Fynn Kröger
fynnkroeger
AI & ML interests
None yet
Organizations
None yet
fynnkroeger's activity
upvoted
2
papers
1 day ago
upvoted
a
paper
12 days ago
upvoted
2
papers
18 days ago
upvoted
a
paper
19 days ago
upvoted
a
paper
24 days ago
upvoted
a
paper
30 days ago
upvoted
5
papers
about 1 month ago
Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
Paper
•
2406.08464
•
Published
•
48
Alleviating Distortion in Image Generation via Multi-Resolution Diffusion Models
Paper
•
2406.09416
•
Published
•
28
An Image is Worth More Than 16x16 Patches: Exploring Transformers on Individual Pixels
Paper
•
2406.09415
•
Published
•
48
Depth Anything V2
Paper
•
2406.09414
•
Published
•
88
McEval: Massively Multilingual Code Evaluation
Paper
•
2406.07436
•
Published
•
39
upvoted
an
article
about 1 month ago
Article
Explaining the SDXL latent space
By
•
•
20
upvoted
6
papers
about 1 month ago
An Image is Worth 32 Tokens for Reconstruction and Generation
Paper
•
2406.07550
•
Published
•
54
Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation
Paper
•
2406.06525
•
Published
•
62
Proofread: Fixes All Errors with One Tap
Paper
•
2406.04523
•
Published
•
12
WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
Paper
•
2406.04770
•
Published
•
24
Mixture-of-Agents Enhances Large Language Model Capabilities
Paper
•
2406.04692
•
Published
•
50
BitsFusion: 1.99 bits Weight Quantization of Diffusion Model
Paper
•
2406.04333
•
Published
•
36
upvoted
14
papers
about 2 months ago
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
Paper
•
2406.01574
•
Published
•
42
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper
•
2405.21060
•
Published
•
61
LLMs achieve adult human performance on higher-order theory of mind tasks
Paper
•
2405.18870
•
Published
•
16
Phased Consistency Model
Paper
•
2405.18407
•
Published
•
44
Transformers Can Do Arithmetic with the Right Embeddings
Paper
•
2405.17399
•
Published
•
50
Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
Paper
•
2405.15071
•
Published
•
33
ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models
Paper
•
2405.15738
•
Published
•
43
Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models
Paper
•
2405.15574
•
Published
•
52
The Road Less Scheduled
Paper
•
2405.15682
•
Published
•
17
LiteVAE: Lightweight and Efficient Variational Autoencoders for Latent Diffusion Models
Paper
•
2405.14477
•
Published
•
16
YOLOv10: Real-Time End-to-End Object Detection
Paper
•
2405.14458
•
Published
•
5
Not All Language Model Features Are Linear
Paper
•
2405.14860
•
Published
•
39
FIFO-Diffusion: Generating Infinite Videos from Text without Training
Paper
•
2405.11473
•
Published
•
53
Diffusion for World Modeling: Visual Details Matter in Atari
Paper
•
2405.12399
•
Published
•
25
upvoted
a
paper
2 months ago
upvoted
21
papers
3 months ago
LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report
Paper
•
2405.00732
•
Published
•
116
Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
Paper
•
2405.01535
•
Published
•
109
Iterative Reasoning Preference Optimization
Paper
•
2404.19733
•
Published
•
45
Better & Faster Large Language Models via Multi-token Prediction
Paper
•
2404.19737
•
Published
•
72
KAN: Kolmogorov-Arnold Networks
Paper
•
2404.19756
•
Published
•
102
Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
Paper
•
2404.18796
•
Published
•
67
CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data
Paper
•
2404.15653
•
Published
•
25
Align Your Steps: Optimizing Sampling Schedules in Diffusion Models
Paper
•
2404.14507
•
Published
•
21
SnapKV: LLM Knows What You are Looking for Before Generation
Paper
•
2404.14469
•
Published
•
23
Multi-Head Mixture-of-Experts
Paper
•
2404.15045
•
Published
•
56
OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework
Paper
•
2404.14619
•
Published
•
124
The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions
Paper
•
2404.13208
•
Published
•
38
How Good Are Low-bit Quantized LLaMA3 Models? An Empirical Study
Paper
•
2404.14047
•
Published
•
39
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Paper
•
2404.14219
•
Published
•
243
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing
Paper
•
2404.12253
•
Published
•
52
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Paper
•
2404.08801
•
Published
•
62
Compression Represents Intelligence Linearly
Paper
•
2404.09937
•
Published
•
27
Rho-1: Not All Tokens Are What You Need
Paper
•
2404.07965
•
Published
•
80
UniFL: Improve Stable Diffusion via Unified Feedback Learning
Paper
•
2404.05595
•
Published
•
22
No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance
Paper
•
2404.04125
•
Published
•
27
Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences
Paper
•
2404.03715
•
Published
•
58
upvoted
4
papers
4 months ago
ReFT: Representation Finetuning for Language Models
Paper
•
2404.03592
•
Published
•
77
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
Paper
•
2404.02258
•
Published
•
102
Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models
Paper
•
2404.02575
•
Published
•
46
Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction
Paper
•
2404.02905
•
Published
•
63