James PRO

jtatman

AI & ML interests

improving domain specific models and re-sampling data, refining datasets for use in different modalities, small scale micro-llm clusters using quantized and smoothed models, and all emerging llm stack connecting technologies. Small models rock.

Organizations

jtatman's activity

upvoted a paper 2 days ago

Retrieval-Enhanced Machine Learning: Synthesis and Opportunities

Paper • 2407.12982 • Published 5 days ago • 4

upvoted a paper 30 days ago

Model Merging and Safety Alignment: One Bad Model Spoils the Bunch

Paper • 2406.14563 • Published Jun 20 • 30

upvoted an article about 1 month ago

Article

Welcome Gemma - Google's new open LLM

Feb 21

• 16

upvoted a collection about 1 month ago

abliterated-v3

Collection

Latest gen of the abliterated models I've produced • 17 items • Updated Jun 3 • 74

upvoted an article 3 months ago

Article

SeeMoE: Implementing a MoE Vision Language Model from Scratch

•

29 days ago

• 30

upvoted a paper 5 months ago

ShortGPT: Layers in Large Language Models are More Redundant Than You Expect

Paper • 2403.03853 • Published Mar 6 • 61

upvoted 2 papers 6 months ago

Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffolding

Paper • 2401.12954 • Published Jan 23 • 28

Transformers are Multi-State RNNs

Paper • 2401.06104 • Published Jan 11 • 34

upvoted a paper 7 months ago

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 255

upvoted a paper 8 months ago

Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers

Paper • 2311.10642 • Published Nov 17, 2023 • 23