LobeHub
LobeHub
Back to Home
Changelog

Visual Recognition: Chat With Images, Not Just Text

LobeHub now supports multimodal models including GPT-4 Vision, Google Gemini Pro Vision, and GLM-4 Vision. Upload or drag images into conversations and your Agent will understand and respond to visual content.

Visual Recognition: Chat With Images, Not Just Text

Conversations in LobeHub are no longer limited to text. We now support several large language models with visual recognition capabilities, including OpenAI's gpt-4-vision, Google Gemini Pro Vision, and Zhiyuan GLM-4 Vision.

Share images naturally

Upload an image or drag it directly into the chat window, and your Agent can understand the visual content and continue the discussion in context. This works for screenshots, photos, diagrams, or any visual reference you need to share.

This brings a more natural multimodal experience to both everyday and professional scenarios:

  • Share photos from your day and discuss them
  • Upload UI screenshots for design feedback
  • Share diagrams and get explanations
  • Reference visual content without describing it in words

Context-aware visual understanding

The assistant doesn't just see the image—it understands it within the ongoing conversation. Ask follow-up questions about specific details, compare multiple images, or use visuals as reference material for complex discussions.

For specialized fields, this means clearer context and more practical responses. Medical imaging discussions, architectural reviews, or technical diagram analysis all become more natural when both parties can see the same visual reference.

Voice options for personalized interaction

To better serve users across regions and preferences, we've also added quality voice options from OpenAI Audio and Microsoft Edge Speech. Choose a voice that fits your style or scenario for more personalized interactions.

Version details

Features

  • v0.101.0Support upload images to chat with gpt4-vision model.
  • v0.100.0Platform check utils.
  • v0.99.0Add Environment Variable for custom model name when deploying.
  • v0.98.0Support latest openai model.
  • v0.97.0Add open new topic when open a topic.
  • v0.96.0Improve pin mode about session group.
  • v0.95.0Support function call at message end, support plugin settings modal, support plugin state and settings.
  • v0.94.0Add agent share.
  • v0.93.0Support multi-language translate.
  • v0.92.0Support translate message to current language.
  • v0.91.0Add hotkeys.
  • v0.90.0Add Lazyload.

What's improved

  • v0.100.5Refactor the input area to suit the files upload feature.
  • v0.99.1Add max height to model menu in chat input area.
  • v0.98.2Refactor antd locale file to useSWR.
  • v0.98.1Update welcome assetes.
  • v0.96.9Update topic list header.
  • v0.96.3Fix SessionList on mobile.
  • v0.96.2Fix some styles and make updates to various files.
  • v0.96.1Add guide to market page.
  • v0.95.1Improve plugin message ui.
  • v0.95.0优化 plugin 文件夹命名以支持 standalone 类型的插件.
  • v0.94.1Update ShareAgentButton.
  • v0.93.0Refactor chain.
  • v0.90.2Refactor OpenAIStreamPayload with chat name.
  • v0.90.1Fix lazyload height.

What's fixed

  • v0.100.4Hotkey disabled in form tags.
  • v0.100.3Fix market error.
  • v0.100.2Upgrade viewport for nextjs 14.
  • v0.98.3Fix redirect to welcome problem when there are topics in inbox.
  • v0.97.1Use pnpm to fix docker release.
  • v0.97.0Fix toggle back to default topic when clearing topic.
  • v0.96.8Fix a bug that weather plugin is not work correctly, template remove sharp deps.
  • v0.96.7Fix a bug when click inbox not switch back to chat page.
  • v0.96.6Improve plausible analytics ENV.
  • v0.96.5Fix docker image optimization error log.
  • v0.96.4Fix agents market locale fallback to english.
  • v0.94.5Fallback agent market index to en when not find correct locale.
  • v0.94.4Fix break cn chars in stream mode.
  • v0.94.3Fix agent share format.
  • v0.94.2Fix agent market with other locales.
  • v0.90.3Fix ActionBar props and regenerate btn with error message.
LobeHub

Super-Agents on Your Team

Bring Super-Agents onto your team, starting today.