research
∙
08/21/2023
Can Language Models Learn to Listen?
We present a framework for generating appropriate facial responses from ...
share
research
∙
07/31/2023
Learning to Model the World with Language
To interact with humans in the world, agents need to understand the dive...
research
∙
07/24/2023
RLCD: Reinforcement Learning from Contrast Distillation for Language Model Alignment
We propose Reinforcement Learning from Contrast Distillation (RLCD), a m...
research
∙
07/06/2023
PREADD: Prefix-Adaptive Decoding for Controlled Text Generation
We propose Prefix-Adaptive Decoding (PREADD), a flexible method for cont...
research
∙
06/08/2023
Modular Visual Question Answering via Code Generation
We present a framework that formulates visual question answering as modu...
research
∙
05/24/2023
Decomposing Complex Queries for Tip-of-the-tongue Retrieval
When re-finding items, users who forget or are uncertain about identifyi...
research
∙
05/24/2023
Ghostbuster: Detecting Text Ghostwritten by Large Language Models
We introduce Ghostbuster, a state-of-the-art system for detecting AI-gen...
research
∙
05/24/2023
Centering the Margins: Outlier-Based Identification of Harmed Populations in Toxicity Detection
A standard method for measuring the impacts of AI on marginalized commun...
research
∙
05/20/2023
Revisiting Entropy Rate Constancy in Text
The uniform information density (UID) hypothesis states that humans tend...
research
∙
05/11/2023
When the Majority is Wrong: Leveraging Annotator Disagreement for Subjective Tasks
Though majority vote among annotators is typically used for ground truth...
research
∙
05/01/2023
Poisoning Language Models During Instruction Tuning
Instruction-tuned LMs such as ChatGPT, FLAN, and InstructGPT are finetun...
research
∙
02/28/2023
Goal Driven Discovery of Distributional Differences via Language Descriptions
Mining large corpora can generate useful discoveries but is time-consumi...
research
∙
12/22/2022
Towards an Ontology-Driven Approach for Process-Aware Risk Propagation
The rapid development of cyber-physical systems creates an increasing de...
research
∙
12/20/2022
DOC: Improving Long Story Coherence With Detailed Outline Control
We propose the Detailed Outline Control (DOC) framework for improving lo...
research
∙
12/07/2022
Discovering Latent Knowledge in Language Models Without Supervision
Existing techniques for training language models can be misaligned with ...
research
∙
11/16/2022
Neural Unsupervised Reconstruction of Protolanguage Word Forms
We present a state-of-the-art neural approach to the unsupervised recons...
research
∙
10/13/2022
Re3: Generating Longer Stories With Recursive Reprompting and Revision
We consider the problem of automatically generating longer stories of ov...
research
∙
09/30/2022
Learning by Distilling Context
Language models significantly benefit from context tokens, such as promp...
research
∙
09/16/2022
The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction and Constrained Decoding
In a real-world dialogue system, generated responses must satisfy severa...
research
∙
05/25/2022
Active Programming by Example with a Natural Language Prior
We introduce APEL, a new framework that enables non-programmers to indir...
research
∙
05/19/2022
Voxel-informed Language Grounding
Natural language applied to natural 2D images describes a fundamentally ...
research
∙
05/19/2022
Automated Crossword Solving
We present the Berkeley Crossword Solver, a state-of-the-art approach fo...
research
∙
04/15/2022
Understanding Game-Playing Agents with Natural Language Annotations
We present a new dataset containing 10K human-annotated games of Go and ...
research
∙
04/05/2022
Inferring Rewards from Language in Context
In classic instruction following, language like "I'd like the JetBlue fl...
research
∙
01/28/2022
Summarizing Differences between Text Distributions with Natural Language
How do two distributions of texts differ? Humans are slow at answering t...
research
∙
09/10/2021
Reference-Centric Models for Grounded Collaborative Dialogue
We present a grounded neural dialogue model that successfully collaborat...
research
∙
06/19/2021
Learning Space Partitions for Path Planning
Path planning, the problem of efficiently discovering high-reward trajec...
research
∙
06/03/2021
An Improved Model for Voicing Silent Speech
In this paper, we present an improved model for voicing silent speech, w...
research
∙
05/13/2021
Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level
Larger language models have higher accuracy on average, but are they bet...
research
∙
04/18/2021
Constrained Language Models Yield Few-Shot Semantic Parsers
We explore the use of large pretrained language models as few-shot seman...
research
∙
04/13/2021
Detoxifying Language Models Risks Marginalizing Minority Voices
Language models (LMs) must be both safe and equitable to be responsibly ...
research
∙
04/12/2021
FUDGE: Controlled Text Generation With Future Discriminators
We propose Future Discriminators for Generation (FUDGE), a flexible and ...
research
∙
04/10/2021
Meta-tuning Language Models to Answer Prompts Better
Large pretrained language models like GPT-3 have acquired a surprising a...
research
∙
03/13/2021
Approximating How Single Head Attention Learns
Why do models often attend to salient words, and how does this evolve th...
research
∙
02/19/2021
Calibrate Before Use: Improving Few-Shot Performance of Language Models
GPT-3 can perform numerous tasks when provided a natural language prompt...
research
∙
10/24/2020
Modularity Improves Out-of-Domain Instruction Following
We propose a modular architecture for following natural language instruc...
research
∙
10/07/2020
Unsupervised Parsing via Constituency Tests
We propose a method for unsupervised parsing based on the linguistic not...
research
∙
10/06/2020
Digital Voicing of Silent Speech
In this paper, we consider the task of digitally voicing silent speech, ...
research
∙
10/06/2020
Semantic Evaluation for Text-to-SQL with Distilled Test Suites
We propose test suite accuracy to approximate semantic accuracy for Text...
research
∙
10/05/2020
A Streaming Approach For Efficient Batched Beam Search
We propose an efficient batching strategy for variable-length decoding o...
research
∙
09/24/2020
Task-Oriented Dialogue as Dataflow Synthesis
We describe an approach to task-oriented dialogue in which dialogue stat...
research
∙
05/12/2020
Semantic Scaffolds for Pseudocode-to-Code Generation
We propose a method for program generation based on semantic scaffolds, ...
research
∙
02/26/2020
Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers
Since hardware resources are limited, the objective of training deep lea...
research
∙
02/10/2020
Multilingual Alignment of Contextual Word Representations
We propose procedures for evaluating and strengthening contextual embedd...
research
∙
10/02/2019
A Deep Factorization of Style and Structure in Fonts
We propose a deep factorization model for typographic analysis that dise...
research
∙
07/23/2019
Pre-Learning Environment Representations for Data-Efficient Neural Instruction Following
We consider the problem of learning to map from natural language instruc...
research
∙
07/09/2019
Cross-Domain Generalization of Neural Constituency Parsers
Neural parsers obtain state-of-the-art results on benchmark treebanks fo...
research
∙
06/02/2019
Are You Looking? Grounding to Multiple Modalities in Vision-and-Language Navigation
Vision-and-Language Navigation (VLN) requires grounding instructions, su...
research
∙
04/22/2019
Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inference
We present a constituency parsing algorithm that maps from word-aligned ...
research
∙
04/02/2019
