SJTU Cross Media Language Intelligence Lab

All

36 repositories

SLAM-LLM
Public
Speech, Language, Audio, Music Processing with Large Language Model
speech-processing audio-processing peft music-processing large-language-model multimodal-large-language-models
Python
•
MIT License
•55•612•12•0•Updated Dec 12, 2024Dec 12, 2024
VQTalker
Public
[AAAI 2025] VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
Apache License 2.0
•0•13•0•0•Updated Dec 12, 2024Dec 12, 2024
Elearning-paper-reading
Public
0•0•0•0•Updated Dec 10, 2024Dec 10, 2024
kaiyu
Public
Kaiyu, Shanghai Jiao Tong University
HTML
•0•0•0•0•Updated Dec 8, 2024Dec 8, 2024
UniCATS-CTX-txt2vec
Public
[AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS
text-to-speech tts speech-synthesis acoustic-model unicats vq-diffusion ctx-txt2vec
Python
•8•63•5•0•Updated Nov 18, 2024Nov 18, 2024
Mobile-Env
Public
A Universal Platform for Training and Evaluation of Mobile Interaction
nlp decision-making rl-environments interaction-platform rl-platform infoui information-ui
Python
•
Apache License 2.0
•4•39•0•0•Updated Nov 14, 2024Nov 14, 2024
Xmart
Public
Xmart学生论坛
Apache License 2.0
•0•2•0•0•Updated Nov 13, 2024Nov 13, 2024
LinguaFranca
Public
Codes for paper "Converging to a Lingua Franca: Evolution of Linguistic Regions and Semantics Alignment in Multilingual Large Language Models"
Python
•0•2•0•0•Updated Oct 29, 2024Oct 29, 2024
MBS
Public
[COLING 2024] Multilingual Brain Surgeon: Large Language Models Can be Compressed Leaving No Language Behind
Python
•1•3•0•0•Updated Oct 12, 2024Oct 12, 2024
x-lance.github.io
Public template
【🛠️🛠️🛠️This Page is Under Construction!!!】Welcome to X-LANCE! Cross Media Language Intelligence Lab in Shanghai Jiao Tong University.
HTML
•
MIT License
•11k•0•0•0•Updated Oct 7, 2024Oct 7, 2024
VoiceFlow-TTS
Public
[ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"
text-to-speech tts speech-synthesis probabilistic-models generative-models conditional-flow-matching rectified-flow-matching
Python
•21•320•7•0•Updated Sep 3, 2024Sep 3, 2024
AniTalker
Public
[ACM MM 2024] This is the official code for "AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding"
Jupyter Notebook
•
Apache License 2.0
•137•1.5k•8•0•Updated Aug 15, 2024Aug 15, 2024
META-GUI-Leaderboard
Public
[EMNLP 2022] Leaderboard of META-GUI
CSS
•0•0•0•0•Updated Jul 9, 2024Jul 9, 2024
META-GUI-baseline
Public
[EMNLP 2022] The baseline code for META-GUI dataset
Python
•
MIT License
•3•12•3•0•Updated Jul 9, 2024Jul 9, 2024
AttrEnhZsAc
Public
Python
•
Apache License 2.0
•0•4•0•0•Updated Jun 21, 2024Jun 21, 2024
UniCATS-CTX-vec2wav
Public
[AAAI 2024] Code for CTX-vec2wav in UniCATS
speech-synthesis vocoder semantic-token unicats vocoding self-supervised-speech
Python
•16•123•6•0•Updated Jun 11, 2024Jun 11, 2024
text2sql-multiturn-GPT
Public
[NAACL 2024] CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions
Python
•0•8•1•0•Updated May 7, 2024May 7, 2024
StoryTTS
Public
[ICASSP 2024] StoryTTS: A Highly Expressive Text-to-Speech Dataset with Rich Textual Expressiveness Annotations
HTML
•
Other
•4•137•2•0•Updated Apr 27, 2024Apr 27, 2024
weblm
Public
[WSDM 2024] Hierarchical Multimodal Pre-training for Visually Rich Webpage Understanding
0•13•2•0•Updated Mar 6, 2024Mar 6, 2024
WebSRC
Public
[EMNLP 2021] WebSRC: A dataset for web based structural machine reading comprehension.
CSS
•0•4•0•0•Updated Feb 13, 2024Feb 13, 2024
MSDWILD
Public
[INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
HTML
•
Other
•1•43•1•0•Updated Jan 24, 2024Jan 24, 2024
text2sql-GPT
Public
[EMNLP 2023 Findings] ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-Thought
Python
•4•18•3•1•Updated Jan 11, 2024Jan 11, 2024
PsyAgents
Public
An Open-Source Psychotherapy Simulation Platform with Interactive Agents
0•0•0•0•Updated Jan 4, 2024Jan 4, 2024
PaperReading
Public
整理各研究方向经典论文
0•10•0•0•Updated Dec 4, 2023Dec 4, 2023
MIVS_BIRGAT
Public
[ICASSP 2024] A BiRGAT Model for Multi-intent Spoken Language Understanding with Hierarchical Semantic Frames
Python
•
MIT License
•0•5•1•0•Updated Nov 27, 2023Nov 27, 2023
medical-dataset
Public
[ACL 2023 Findings] CSS: A Large-scale Cross-schema Chinese Text-to-SQL Medical Dataset
Python
•
Apache License 2.0
•0•5•1•0•Updated May 26, 2023May 26, 2023
D4
Public
[EMNLP 2022] D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chat
CSS
•0•1•0•0•Updated Mar 13, 2023Mar 13, 2023
BER
Public
Balanced Error Rate for Speaker Diarization
Python
•3•28•0•0•Updated Feb 28, 2023Feb 28, 2023
public_talks
Public
Materials of public talks given By SJTU X-LANCE members
0•14•0•0•Updated Dec 3, 2022Dec 3, 2022
WebSRC-Baseline
Public
[EMNLP 2021] The baseline code for WebSRC dataset.
HTML
•
MIT License
•9•47•2•0•Updated Aug 27, 2022Aug 27, 2022