In the past year, large vision language models (LVLMs) have become a prominent focus in artificial intelligence research. When prompted differently, these models show promising performance across various downstream tasks. However, there’s still significant potential for improvement in LVLMs’ image perception capabilities.  Enhanced perceptual abilities for visual concepts are crucial for advancing model development and…

Artificial Intelligence (AI), particularly through deep learning, has revolutionized many fields, including machine translation, natural language understanding, and computer vision. The field of medical imaging, specifically chest X-ray (CXR) interpretation, is no exception. CXRs, the most frequently performed diagnostic imaging tests, hold immense clinical significance. The advent of vision-language foundation models (FMs) has opened new…

A team of researchers associated with Peking University, Pika, and Stanford University has introduced RPG (Recaption, Plan, and Generate). The proposed RPG framework is the new state-of-the-art in the context of text-to-image conversion, especially in handling complex text prompts involving multiple objects with various attributes and relationships. The existing models which have shown exceptional results…

Vision-language models (VLMs) are increasingly prevalent, offering substantial advancements in AI-driven tasks. However, one of the most significant limitations of these advanced models, including prominent ones like GPT-4V, is their constrained spatial reasoning capabilities. Spatial reasoning involves understanding objects’ positions in three-dimensional space and their spatial relationships with one another. This limitation is particularly pronounced…

Recent advancements in generative models for text-to-image (T2I) tasks have led to impressive results in producing high-resolution, realistic images from textual prompts. However, extending this capability to text-to-video (T2V) models poses challenges due to the complexities introduced by motion. Current T2V models face limitations in video duration, visual quality, and realistic motion generation, primarily due…

In AI image generation, text-to-image diffusion models have become a focal point due to their ability to create photorealistic images from textual descriptions. These models use complex algorithms to interpret text and translate it into visual content, simulating creativity and understanding previously thought unique to humans. This technology holds immense potential across various domains, from…

Mathematical reasoning, part of our advanced thinking, reveals the complexities of human intelligence. It involves logical thinking and specialized knowledge, not just in words but also in pictures, crucial for understanding abilities. This has practical uses in AI. However, current AI datasets often focus narrowly, missing a full exploration of combining visual language understanding with…

In image generation, diffusion models have significantly advanced, leading to the widespread availability of top-tier models on open-source platforms. Despite these strides, challenges in text-to-image systems persist, particularly in managing diverse inputs and being confined to single-model outcomes. Unified efforts commonly address two distinct facets: first, the parsing of various prompts during the input stage,…

Contrastive pre-training using large, noisy image-text datasets has become popular for building general vision representations. These models align global image and text features in a shared space through similar and dissimilar pairs, excelling in tasks like image classification and retrieval. However, they need help with fine-grained tasks such as localization and spatial relationships. Recent efforts…

In the challenging fight against illegal poaching and human trafficking, researchers from Washington University in St. Louis’s McKelvey School of Engineering have devised a smart solution to enhance geospatial exploration. The problem at hand is how to efficiently search large areas to find and stop such activities. The current methods for local searches are limited…