research
∙
09/18/2023
Multimodal Foundation Models: From Specialists to General-Purpose Assistants
This paper presents a comprehensive survey of the taxonomy and evolution...
share
research
∙
09/18/2023
MindAgent: Emergent Gaming Interaction
Large Language Models (LLMs) have the capacity of performing complex sch...
research
∙
09/18/2023
An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models
Visual instruction tuning has recently shown encouraging progress with o...
research
∙
06/16/2023
Demystifying GPT Self-Repair for Code Generation
Large Language Models (LLMs) have shown remarkable aptitude in code gene...
research
∙
06/12/2023
Augmenting Language Models with Long-Term Memory
Existing large language models (LLMs) can only afford fix-sized inputs d...
research
∙
06/01/2023
LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day
Conversational generative AI has demonstrated remarkable promise for emp...
research
∙
06/01/2023
Differentiable Tree Operations Promote Compositional Generalization
In the context of structure-to-structure transformation tasks, learning ...
research
∙
05/23/2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding
Scientific literature understanding tasks have gained significant attent...
research
∙
05/21/2023
Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers
This paper explores the effectiveness of model-generated signals in impr...
research
∙
05/04/2023
Chain-of-Skills: A Configurable Model for Open-domain Question Answering
The retrieval model is an indispensable component for real-world knowled...
research
∙
04/17/2023
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Backpropagation, the cornerstone of deep learning, is limited to computi...
research
∙
04/06/2023
Instruction Tuning with GPT-4
Prior work has shown that finetuning large language models (LLMs) using ...
research
∙
03/28/2023
Pre-training Transformers for Knowledge Graph Completion
Learning transferable representation of knowledge graphs (KGs) is challe...
research
∙
03/02/2023
Interactive Text Generation
Users interact with text, image, code, or other editors on a daily basis...
research
∙
02/24/2023
Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback
Large language models (LLMs), such as ChatGPT, are able to generate huma...
research
∙
02/22/2023
Guiding Large Language Models via Directional Stimulus Prompting
We introduce a new framework, Directional Stimulus Prompting, that uses ...
research
∙
01/17/2023
Learning Customized Visual Models with Retrieval-Augmented Knowledge
Image-text contrastive learning models such as CLIP have demonstrated st...
research
∙
01/17/2023
GLIGEN: Open-Set Grounded Text-to-Image Generation
Large-scale text-to-image diffusion models have made amazing advances. H...
research
∙
12/21/2022
Generalized Decoding for Pixel, Image, and Language
We present X-Decoder, a generalized decoding model that can predict pixe...
research
∙
12/21/2022
Language Models as Inductive Reasoners
Inductive reasoning is a core component of human intelligence. In the pa...
research
∙
12/20/2022
DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization
Dialogue summarization has recently garnered significant attention due t...
research
∙
12/20/2022
Enhancing Task Bot Engagement with Synthesized Open-Domain Dialog
Many efforts have been made to construct dialog systems for different ty...
research
∙
12/15/2022
Efficient Long Sequence Modeling via State Space Augmented Transformer
Transformer models have achieved superior performance in various natural...
research
∙
12/04/2022
Grounded Keys-to-Text Generation: Towards Factual Open-Ended Generation
Large pre-trained language models have recently enabled open-ended gener...
research
∙
11/30/2022
ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format
Diverse data formats and ontologies of task-oriented dialogue (TOD) data...
research
∙
11/25/2022
CodeExp: Explanatory Code Document Generation
Developing models that can automatically generate detailed code explanat...
research
∙
11/17/2022
Execution-based Evaluation for Data Science Code Generation Models
Code generation models can benefit data scientists' productivity by auto...
research
∙
10/31/2022
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Standard fine-tuning of large pre-trained language models (PLMs) for dow...
research
∙
10/25/2022
Lafite2: Few-shot Text-to-Image Generation
Text-to-image generation models have progressed considerably in recent y...
research
∙
10/22/2022
Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge
We propose a novel open-domain question answering (ODQA) framework for a...
research
∙
10/17/2022
Vision-Language Pre-training: Basics, Recent Advances, and Future Trends
This paper surveys vision-language pre-training (VLP) methods for multim...
research
∙
10/14/2022
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Neural architecture search (NAS) has demonstrated promising results on i...
research
∙
10/11/2022
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Given its effectiveness on knowledge-intensive natural language processi...
research
∙
09/07/2022
K-VIL: Keypoints-based Visual Imitation Learning
Visual imitation learning provides efficient and intuitive solutions for...
research
∙
08/30/2022
Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning
We present an efficient bi-encoder framework for named entity recognitio...
research
∙
08/11/2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Machine translation has seen rapid progress with the advent of Transform...
research
∙
08/11/2022
Interactive Code Generation via Test-Driven User-Intent Formalization
Pre-trained large language models (LLMs) such as OpenAI Codex have shown...
research
∙
06/24/2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Existing studies in conversational AI mostly treat task-oriented dialog ...
research
∙
06/22/2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
We introduce GODEL (Grounded Open Dialogue Language Model), a large pre-...
research
∙
06/15/2022
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
Vision-language (VL) pre-training has recently received considerable att...
research
∙
06/12/2022
GLIPv2: Unifying Localization and Vision-Language Understanding
We present GLIPv2, a grounded VL understanding model, that serves both l...
research
∙
06/04/2022
Fault-Aware Neural Code Rankers
Large language models (LLMs) have demonstrated an impressive ability to ...
research
∙
05/28/2022
Learning from Self-Sampled Correct and Partially-Correct Programs
Program synthesis aims to generate executable programs that are consiste...
research
∙
05/24/2022
AdaMix: Mixture-of-Adapter for Parameter-efficient Tuning of Large Language Models
Fine-tuning large-scale pre-trained language models to downstream tasks ...
research
∙
05/20/2022
Visually-Augmented Language Modeling
Human language is grounded on multimodal knowledge including visual know...
research
∙
05/19/2022
Training Vision-Language Transformers from Captions Alone
We show that Vision-Language Transformers can be learned without human l...
research
∙
05/02/2022
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
What explains the dramatic progress from 20th-century to 21st-century AI...
research
∙
04/20/2022
K-LITE: Learning Transferable Visual Models with External Knowledge
Recent state-of-the-art computer vision systems are trained from natural...
research
∙
04/19/2022
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Learning visual representations from natural language supervision has re...
research
∙
04/16/2022
