Vipitis (Jan)

upvoted a paper 2 months ago

A Survey on Language Models for Code

Paper • 2311.07989 • Published Nov 14, 2023 • 21

upvoted a paper 3 months ago

What's the Meaning of Superhuman Performance in Today's NLU?

Paper • 2305.08414 • Published May 15, 2023 • 1

upvoted 2 papers 4 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 126

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Paper • 2310.06770 • Published Oct 10, 2023 • 4

upvoted a paper 6 months ago

DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Paper • 2401.14196 • Published Jan 25 • 45

upvoted a collection 6 months ago

models to evaluate

Collection

collecting models I want to evaluate on shadereval-task2: https://github.com/bigcode-project/bigcode-evaluation-harness/pull/173 at fp16!! • 33 items • Updated 24 days ago • 2

upvoted 2 papers 7 months ago

CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution

Paper • 2401.03065 • Published Jan 5 • 10

TACO: Topics in Algorithmic COde generation dataset

Paper • 2312.14852 • Published Dec 22, 2023 • 4

upvoted a collection 8 months ago

Interpretability

Collection

Select papers on language model interpretability with notes • 5 items • Updated Nov 27, 2023 • 4

upvoted 2 papers 8 months ago

Analyzing Transformers in Embedding Space

Paper • 2209.02535 • Published Sep 6, 2022 • 3

Code Execution with Pre-trained Language Models

Paper • 2305.05383 • Published May 8, 2023 • 2

upvoted 6 papers 9 months ago

CodeFusion: A Pre-trained Diffusion Model for Code Generation

Paper • 2310.17680 • Published Oct 26, 2023 • 68

Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements

Paper • 2210.01970 • Published Sep 30, 2022 • 11

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Paper • 2102.04664 • Published Feb 9, 2021 • 1

Program Synthesis with Large Language Models

Paper • 2108.07732 • Published Aug 16, 2021 • 4

MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation

Paper • 2208.08227 • Published Aug 17, 2022 • 1

Measuring Coding Challenge Competence With APPS

Paper • 2105.09938 • Published May 20, 2021 • 1

upvoted a collection 9 months ago

Code Evaluation

Collection

Collection of Papers on Code Evaluation (from code generation language models) • 35 items • Updated 5 days ago • 8

upvoted 2 papers 9 months ago

Evaluating Large Language Models Trained on Code

Paper • 2107.03374 • Published Jul 7, 2021 • 6

CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion

Paper • 2310.11248 • Published Oct 17, 2023 • 3

upvoted 6 papers 10 months ago

upvoted 7 papers 11 months ago

ReCode: Robustness Evaluation of Code Generation Models

Paper • 2212.10264 • Published Dec 20, 2022 • 1

WizardCoder: Empowering Code Large Language Models with Evol-Instruct

Paper • 2306.08568 • Published Jun 14, 2023 • 28

The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code

Paper • 2305.19213 • Published May 30, 2023 • 1

Textbooks Are All You Need

Paper • 2306.11644 • Published Jun 20, 2023 • 141

Code Llama: Open Foundation Models for Code

Paper • 2308.12950 • Published Aug 24, 2023 • 22

A Static Evaluation of Code Completion by Large Language Models

Paper • 2306.03203 • Published Jun 5, 2023 • 3

Procedural Image Programs for Representation Learning

Paper • 2211.16412 • Published Nov 29, 2022 • 1

upvoted 7 papers about 1 year ago

Out of the BLEU: how should we assess quality of the Code Generation models?

Paper • 2208.03133 • Published Aug 5, 2022 • 2

Large Language Models Are State-of-the-Art Evaluators of Code Generation

Paper • 2304.14317 • Published Apr 27, 2023 • 2

CodeT5+: Open Code Large Language Models for Code Understanding and Generation

Paper • 2305.07922 • Published May 13, 2023 • 4

CodeGen2: Lessons for Training LLMs on Programming and Natural Languages

Paper • 2305.02309 • Published May 3, 2023 • 1

Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors

Paper • 2306.17156 • Published Jun 29, 2023 • 21

Stay on topic with Classifier-Free Guidance

Paper • 2306.17806 • Published Jun 30, 2023 • 27

A Survey on Evaluation of Large Language Models

Paper • 2307.03109 • Published Jul 6, 2023 • 38

Jan

AI & ML interests

Organizations

Vipitis's activity