Tianjin University Multimedia Group

About Me

Hi, I am now an Associate Professor with Multimedi Institute of Tianjin University. I received the B.E and Ph.D. degree from Shanghai Jiao Tong Univeristy under the supervision of Prof. Xiaokang Yang and Prof. Guangtao Zhai. I am also supervised by Prof. Chang Wen Chen when visiting at SUNY@Buffalo from 2014-2015. My research interest includes: image/video processing and cross-modal video content analysis.

I have contributed to deep learning methods for solving artificial intelligence challenges in real-world applications, including image enhancement, anomaly detection, recommendation systems, and cross modal retrieval. My research has been published in top conferences and journals, including TIP, TCSVT, TMM, DSP, CVPR, and IFTC .Our group is supported by the National Natural Science Foundation of China in 2023、the Tianjin Natural Science Foundation, and the National Natural Science Foundation 2021 .

天津大学多媒体实验室(TJUMMG)中文简介

Laboratory Introduction

Tianjin University Multimedia Group was founded by Dr. Liu Jing and is affiliated to the School of Electrical Automation and Information Engineering of Tianjin University. The main goal is to enhance the understanding of multimedia through computer training. The laboratory is equipped with large models such as deep learning to improve the perceptual quality of digital multimedia content, so as to accurately identify and classify objects of interest to users and respond to the observed content. This laboratory belongs to the Institute of Television and Image Information, Ministry of Education, Tianjin University.Students who apply for my laboratory are free to choose their preferred research direction. At each stage of study, tutors will have in-depth discussions with students on recent scientific research progress, future direction planning, project promotion problems, etc., to help students tackle difficulties on the road to scientific research. Overcome difficulties.

Research Direction

In recent years, the laboratory has hosted or participated in projects such as the National Natural Science Foundation, the Ministry of Science and Technology’s key R&D plans, and enterprise cooperation. Each research direction is supported by provincial, ministerial or national projects. To view the specific research directions of the laboratory, please click here.

Master’s Student Recruitment

The master’s students to be recruited this year mainly participate in the Natural Science Foundation and general projects. Their main work is writing algorithms, building platforms, software simulation, etc., which requires students to have high software design capabilities and hands-on skills. Applicants are generally required to master the relevant knowledge of data structures and algorithms, and have the ability to select appropriate algorithms to solve problems according to specific problem characteristics; at the same time, they have relevant experience in software programming during the undergraduate study stage, and can be relatively proficient in programming languages such as: C, Python ,Matlab etc. Applicants who have participated in the Robotics Competition, the National College Student Electronic Design Competition, the College Student Software Design Competition, and the Big Data Challenge at the undergraduate level and won awards will be given priority. Interested students please contact the person in charge of the laboratory.

Openings

We are looking for self-motivated graduate students working with me. For prospective students, please send your resume and transcript to my email.

课题组招收2024年秋季入学硕士研究生,欢迎保研或考研同学邮件联系!

Interests

  • Image/Video Processing (Enhancement, Quality Assessment, etc.)
  • Video Content Analysis (Segmentation, Tracking, Cross-modal Retrieval, etc.)
  • Recommendation Systems (Cross-domain Recommender, Interactive Recommender)
  • Deep Learning
  • Machine Learning

Education

  • PhD in Computer Science, 2011-2017

    Shanghai Jiao Tong University, China

  • Visiting Scholar in Computer Science, 2014-2015

    State University of New York, U.S

  • BSc in Computer Science and Technology, 2007-2011

    Shanghai Jiao Tong University, China

News

  • [11/2023] Our work GDCCDR is accepted by AAAI2024.
  • [09/2023] I am promoted to advanced membership of CCF.
  • [09/2023] our work SiamDMU is accepted by IEEE TETCI with code available at GitHub.
  • [09/2023] we have successfully host the 3rd CSIG Excellent Doctoral Forum in Tianjin Univeristy!
  • [08/2023] our proposal is granted by National Science and Foundation of China.
  • [07/2023] one work is accepted by ACM MM with code coming song.
  • [07/2023] our work MSTFN is accepted by IEEE TMM with code available at GitHub.
  • [04/2023] our work KCLR is accepted by IEEE TMM.
  • [04/2023] our work MALN is accepted by IEEE TCSVT.
  • [03/2023] our work MRFT is accepted by IEEE TCSVT.
  • [01/2023] our work SAW is accepted by IEEE TIP with code available at GitHub.
  • [12/2022] our work TGSR is accepted by IEEE TCSVT with code available at GitHub.
  • [12/2022] our work BE-DS won the Best Poster Award of IFTC2022.
  • [08/2022] I am enrolled in the MM Committee of CSIG and CCF.
  • [–/2022] our work QA-PRI won the 2021 Prize Paper Award Runner-up ofIEEE TMM.
  • [09/2021] our work TANET is accepted by IEEE TMM with code available at GitHub.
  • [06/2021] our work RMFNet is accepted by IEEE TCSVT.
  • [12/2020] I am enrolled in Editoral Board of Displays (Springer).
  • [06/2020] our work LRML is published in IEEE TMM.
  • [12/2019] I am enrolled in Beiyang Scholar Program-Young Teacher.
  • [10/2019] our work BE-CALF is published in IEEE TIP with code available at GitHub.
  • [10/2019] two of my students Wanning Sun and Pingping Liu was granted National Scholarship.
  • [09/2019] our work SSCNN is published in IEEE TMM.
  • [11/2018] I receive an honer for CSIG candidate excellent doctoral dissertation.
  • [10/2018] our work IPAD is published in IEEE TIP with code available at GitHub.

Recent Publications

Quickly discover relevant content by filtering publications.

SEE ALL PUBLICATIONS >

(2024). Inter- and Intra-Domain Potential User Preferences for Cross-Domain Recommendation. IEEE Transactions on Multimedia.

PDF

(2023). BAND-2k: Banding Artifact Noticeable Database for Banding Detection and Quality Assessment. IEEE Transactions on Circuits and Systems for Video Technology.

PDF CODE

(2023). Multi-stage Spatio-Temporal Fusion Network for Fast and Accurate Video Bit-depth Enhancement. IEEE Transactions on Multimedia.

PDF CODE

(2023). Knowledge-Enhanced Causal Reinforcement Learning Model for Interactive Recommendation. IEEE Transactions on Multimedia.

PDF

(2023). MALN: Multimodal Adversarial Learning Network for Conversational Emotion Recognition. IEEE Transactions on Circuits and Systems for Video Technology.

PDF

(2023). MRFT: Multiscale Recurrent Fusion Transformer Based Prior Knowledge for Bit-Depth Enhancement. IEEE Transactions on Circuits and Systems for Video Technology.

PDF CODE

(2023). Sequence as A Whole: A Unified Framework for Video Action Localization with Long-Range Text Query. IEEE Transactions on Image Processing.

PDF CODE

(2023). Trajectory Guided Robust Visual Object Tracking With Selective Remedy. IEEE Transactions on Circuits and Systems for Video Technology.

PDF CODE

Featured Publication

*

Efficient Spatio-Temporal Video Grounding with Semantic-Guided Feature Decomposition

patio-temporal video grounding (STVG) aims to localize the spatiotemporal object tube in a video according to a given text query…..

Multi-stage Spatio-Temporal Fusion Network for Fast and Accurate Video Bit-depth Enhancement

For video bit-depth enhancement (VBDE) tasks, inter-frame information is critical for removing false contours and recovering the details in low bit-depth (LBD) video, …..

Knowledge-Enhanced Causal Reinforcement Learning Model for Interactive Recommendation

Owing to its inherently dynamic nature and economical training cost, offline reinforcement learning (RL) is typically employed to implement an interactive recommender system (IRS)……

Sequence as a Whole: A Unified Framework for Video Action Localization With Long-Range Text Query

Comprehensive understanding of video content requires both spatial and temporal localization. However, …..

BE-CALF: Bit-Depth Enhancement by Concatenating All Level Features of DNN

There is a growing demand for monitors to provide high-quality visualization with more bits representing each rendered pixel. However, since most existing images and videos are of low bit-depth …..

Our Team Member

Team Leader

Avatar

Jing Liu

Associate Professor

PhD Students

Avatar

Minjie Ren

PhD Student@Tianjin University

Avatar

Weikang Wang

PhD Student@Tianjin University

Avatar

Xin Wen

PhD Student@Tianjin University

Master Students

Avatar

Chengzhi Wang

Master Student@Tianjin University

Avatar

Hao Jiang

Master Student@Tianjin University

Avatar

Jiaxiang Wang

Master Student@Tianjin University

Avatar

Jingjun Mao

Master Student@Tianjin University

Avatar

Jingrui Liu

Master Student@Tianjin University

Avatar

Lele Sun

Master Student@Tianjin University

Avatar

Litao Shang

Master Student@Tianjin University

Avatar

Qingying Li

Master Student@Tianjin University

Avatar

Xin Li

Master Student@Tianjin University

Avatar

Xinyue Huang

Master Student@Tianjin University

Avatar

Yangbo Feng

Master Student@Tianjin University

Avatar

Yujie Fu

Master Student@Tianjin University

Avatar

Zhiwei Fan

Master Student@Tianjin University

Avatar

Zhuo He

Master Student@Tianjin University

Avatar

Zijian Huang

Master Student@Tianjin University

Avatar

Zongbing Zhang

Master Student@Tianjin University

Alumni

Avatar

Han Wang

Master Student@Tianjin University

Avatar

Jiaqi Zhang

Master Student@Tianjin University

Avatar

Min Yuan

Master Student@Tianjin University

Avatar

Qianqian Dou

Master Student@Tianjin University

Avatar

Rui Ma

Master Student@Tianjin University

Avatar

Xiaofeng Mi

Master Student@Tianjin University

Avatar

Xinyu Ji

Master Student@Tianjin University

Avatar

Yuxin Gang

Master Student@Tianjin University

Avatar

Ziwen Yang

Master Student@Tianjin University

Teaching

Undergraduate Course

📙Scientific Computing Language

  • Opening semester: 18192, 21221, 22231, 23241
  • Targeting Majors: Electronic Information Engineering, Internet of Things Engineering

📘Big Data Analysis (in English)

  • Opening semester: 19201,20211,21222,22232
  • Targeting Majors: Communication Engineering, Electronic Information Engineering, Internet of Things Engineering, Smart Grid Information Engineering

📕Big Data Analysis

  • Opening semester: 22231,23241
  • Targeting Majors: Communication Engineering

Master Courses

📓Advanced Course in Big Data Analysis (in English)

📗Multimedia Intelligent Analysis and Computing

Academic Services

🏢Academic Organizations

  • Advanced Member of China Computer Federation
  • Member of the Multimedia Committee of the China Society of Image and Graphics

📑International Journals

  • Associate Editor in Chief of Elservier Journal Display (IF: 4.3, JCR Q1)
  • Guest Editor of Springer Multimedia Tools and Applications (IF: 3.6) Special Issue

💻International Conference

  • Co-Chair——IEEE Conference on Computer Vision and Pattern Recognition 2016 Workshop on Computer Vision for Microscopy Image Analysis
  • Organizational Committee——National Academic Conference on Information Hiding and Multimedia Information Security(CIHW) 2022
  • Program Committee Member——ACM International Conference on Multimedia 2019-2023

📖Journal Reviewer

  • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
  • IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Multimedia (TMM)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • European Conference on Computer Vision (ECCV)
  • ACM International Conference on Multimedia (ACM MM)

Awards

  • [2021] Tianjin Science and Technology Progress Special Award
  • [2018] Nomination Award for Excellent Doctoral Dissertation by the Chinese Society of Image and Graphics
  • [2020] Tianjin Graduate Research and Innovation Project Guidance Teacher
  • [2019] “Beiyang Scholars - Young Backbone Teachers” Talent Plan
  • [2019] Outstanding Guidance Professor for Undergraduate Graduation Design

Research

💻Research Projects

  • National key research and development program, “collaborative dissemination of mainstream values and recommended technologies”, contact person and overall executor
  • Tianjin Natural Science Foundation Project, “Research on Video Image Bit Depth Up-conversion”, leader
  • Project of Key Laboratory of Artificial Intelligence, Ministry of Education, “Research on Micro-expression Recognition Technology for Multi-source Data”, leader
  • National Natural Science Foundation of China, “Research on key technologies of bit depth up-conversion based on natural image characteristics”, leader
  • Special postdoctoral support project, “Research on key technologies for bit depth up-conversion based on generative adversarial networks”, leader
  • Postdoctoral project, “Research on bit depth up-conversion based on encoder-decoder network”, leader

📄Patent

  • A cross-domain micro-expression classification method based on feature subspace separation
  • Image saliency prediction method based on aesthetic analysis in multi-task deep network
  • Image scanning path control method based on coarse-to-fine LSTM model
  • A target tracking method based on enriching target shape changes to update templates
  • A real-time multi-tonal bit enhancement method based on content and continuity guidance
  • Image bit enhancement method and device based on semantic fusion generation adversarial network
  • A video bit enhancement method based on attention mechanism
  • An image bit enhancement method based on multi-layer features of a series neural network
  • A method for restoration and recognition based on cylindrical two-dimensional code
  • A target tracking method based on dynamic memory library template update
  • Significance detection method based on structural and scale adaptive receptive field
  • A video bit enhancement method based on efficient spatial-temporal information fusion
  • A target tracking method based on segmenting target mask to update template
  • A method for generating bit depth enhancement of adversarial networks based on residual image conditions
  • A twin network target tracking method and device based on dual mask template update

Resources

📁Resources Tips

✒️Writing Tips

Contact

  • jliu_tju@tju.edu.cn
  • Tianjin University, Nankai, Tianjin 300072
  • Room 413, #26D Building, Tianjin University
  • WeekDay 8:30 am to 12:00 am and 13:30 pm to 17:30 pm