com.alibaba.dashscope.multimodal

类 MultiModalDialog

java.lang.Object

com.alibaba.dashscope.multimodal.MultiModalDialog

public class MultiModalDialog
extends Object

Multimodal Dialog class responsible for handling various operations in multimodal conversations.

author songsong.shao date 2025/4/24

构造器概要

构造器

构造器和说明
MultiModalDialog(MultiModalRequestParam param, MultiModalDialogCallback callback) Constructor initializes service options and creates a duplex communication API instance.
MultiModalDialog(MultiModalRequestParam param, MultiModalDialogCallback callback, ApiServiceOption serviceOption) Constructor allows custom service options.
MultiModalDialog(MultiModalRequestParam param, MultiModalDialogCallback callback, ConnectionOptions connectionOptions) Constructor initializes service options and creates a duplex communication API instance.

方法概要

限定符和类型	方法和说明
State.DialogState	getDialogState() Gets current dialogue state.
void	interrupt() Interrupts current operation.
void	localRespondingEnded() Local player broadcast tts end
void	localRespondingStarted() Local player start broadcast tts
void	requestToRespond(String type, String text, MultiModalRequestParam.UpdateParams updateParams) Requests response.
void	sendAudioData(ByteBuffer audioFrame) Sends audio frame.
void	sendHeartBeat() send heart beat request ,will respond heart beat
void	start() Starts the dialog session.
void	startSpeech() Starts upload speech.
void	stop() Stops the MultiModalDialog.
void	stopSpeech() Stops upload speech.
void	updateInfo(MultiModalRequestParam.UpdateParams updateParams) Updates information.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

MultiModalDialog

public MultiModalDialog(MultiModalRequestParam param,
                        MultiModalDialogCallback callback)

Constructor initializes service options and creates a duplex communication API instance.

param: param Request parameter param: callback Callback interface

MultiModalDialog

public MultiModalDialog(MultiModalRequestParam param,
                        MultiModalDialogCallback callback,
                        ConnectionOptions connectionOptions)

Constructor initializes service options and creates a duplex communication API instance.

param: param Request parameter param: callback Callback interface param: connectionOptions Connection options

MultiModalDialog

public MultiModalDialog(MultiModalRequestParam param,
                        MultiModalDialogCallback callback,
                        ApiServiceOption serviceOption)

Constructor allows custom service options.

param: param Request parameter param: callback Callback interface param: serviceOption Custom service options

方法详细资料

start

public void start()

Starts the dialog session.

startSpeech

public void startSpeech()

Starts upload speech.

stopSpeech

public void stopSpeech()

Stops upload speech.

interrupt

public void interrupt()

Interrupts current operation.

localRespondingStarted

public void localRespondingStarted()

Local player start broadcast tts

localRespondingEnded

public void localRespondingEnded()

Local player broadcast tts end

sendHeartBeat

public void sendHeartBeat()

send heart beat request ,will respond heart beat

requestToRespond

public void requestToRespond(String type,
                             String text,
                             MultiModalRequestParam.UpdateParams updateParams)

Requests response.

param: type Response type param: text Response text param: updateParams Update parameters

updateInfo

public void updateInfo(MultiModalRequestParam.UpdateParams updateParams)

Updates information.

param: updateParams Update parameters

stop

public void stop()

Stops the MultiModalDialog.

getDialogState

public State.DialogState getDialogState()

Gets current dialogue state.

return: Current dialogue state

sendAudioData

public void sendAudioData(ByteBuffer audioFrame)

Sends audio frame.

param: audioFrame Audio frame data