An Alibaba Group signal is seen on the World Synthetic Intelligence Convention in Shanghai, July 6, 2023.
Aly Tune | Reuters
Alibaba on Friday launched a brand new synthetic intelligence mannequin that the corporate says can perceive photos and perform extra advanced conversations than the corporate’s earlier merchandise, as the worldwide race for management within the expertise heats up.
The Chinese language expertise large mentioned that its two new fashions, Qwen-VL and Qwen-VL-Chat, might be open supply — which means that researchers, teachers and corporations worldwide can use them to create their very own AI apps without having to coach their very own methods, due to this fact saving time and expense.
Alibaba mentioned that Qwen-VL can reply to open-ended queries associated to completely different photos and generate image captions.
Qwen-VL-Chat in the meantime caters to extra “advanced interplay,” in line with Alibaba, similar to evaluating a number of picture inputs and answering a number of rounds of questions. Some duties that Alibaba says Qwen-VL-Chat can carry out embody writing tales and creating photos based mostly on images {that a} consumer inputs, in addition to fixing mathematical equations proven in an image.
One instance Alibaba gave is of an enter that includes a hospital signal within the Chinese language language. The AI can reply questions in regards to the areas of sure hospital departments by decoding the picture of the signal.
Up to now, a lot of generative AI — the place the expertise generates responses based mostly on human inputs — has targeted on responding to textual content. The newest model of OpenAI’s ChatGPT additionally has the flexibility to grasp photos and reply in textual content, very like Qwen-VL-Chat.
Alibaba’s two newest fashions are constructed upon the corporate’s giant language mannequin referred to as Tongyi Qianwen, launched earlier this 12 months. An LLM is an AI mannequin educated on large quantities of knowledge and underpins chatbot functions.
The Hangzhou-headquartered firm this month open sourced two different AI fashions. Whereas not incomes Alibaba any licensing charges, the open-source distribution will assist the corporate get extra customers for its AI mannequin — at a time when the agency’s cloud division is trying to reignite development, because it prepares to go public.