Inicio  /  Future Internet  /  Vol: 15 Par: 5 (2023)  /  Artículo
ARTÍCULO
TITULO

Deep Reinforcement Learning-Based Video Offloading and Resource Allocation in NOMA-Enabled Networks

Siyu Gao    
Yuchen Wang    
Nan Feng    
Zhongcheng Wei and Jijun Zhao    

Resumen

With the proliferation of video surveillance system deployment and related applications, real-time video analysis is very critical to achieving intelligent monitoring, autonomous driving, etc. Analyzing video stream with high accuracy and low latency through the traditional cloud computing represents a non-trivial problem. In this paper, we propose a non-orthogonal multiple access (NOMA)-based edge real-time video analysis framework with one edge server (ES) and multiple user equipments (UEs). A cost minimization problem composed of delay, energy and accuracy is formulated to improve the quality of experience (QoE) of the UEs. In order to efficiently solve this problem, we propose the joint video frame resolution scaling, task offloading, and resource allocation algorithm based on the Deep Q-Learning Network (JVFRS-TO-RA-DQN), which effectively overcomes the sparsity of the single-layer reward function and accelerates the training convergence speed. JVFRS-TO-RA-DQN consists of two DQN networks to reduce the curse of dimensionality, which, respectively, select the offloading and resource allocation action, as well as the resolution scaling action. The experimental results show that JVFRS-TO-RA-DQN can effectively reduce the cost of edge computing and has better performance in terms of convergence compared to other baseline schemes.

 Artículos similares

       
 
Eyad K. Sayhood, Nisreen S. Mohammed, Salam J. Hilo and Salih S. Salih    
This paper presents comprehensive empirical equations to predict the shear strength capacity of reinforced concrete deep beams, with a focus on improving the accuracy of existing codes. Analyzing 198 deep beams imported from 15 existing investigations, t... ver más
Revista: Infrastructures

 
Chenglong Li, Wenyong Gu, Yuan Zheng, Longyang Huang and Xuejun Zhang    
Air logistics transportation has become one of the most promising markets for the civil drone industry. However, the large flow, high density, and complex environmental characteristics of urban scenes make tactical conflict resolution very challenging. E... ver más
Revista: Drones

 
Jiacheng Hou, Tianhao Tao, Haoye Lu and Amiya Nayak    
Information-centric networking (ICN) has gained significant attention due to its in-network caching and named-based routing capabilities. Caching plays a crucial role in managing the increasing network traffic and improving the content delivery efficienc... ver más
Revista: Future Internet

 
Tongyang Xu, Yuan Liu, Zhaotai Ma, Yiqiang Huang and Peng Liu    
As a new distributed machine learning (ML) approach, federated learning (FL) shows great potential to preserve data privacy by enabling distributed data owners to collaboratively build a global model without sharing their raw data. However, the heterogen... ver más
Revista: Future Internet

 
Qianqian Wu, Qiang Liu, Zefan Wu and Jiye Zhang    
In the field of ocean data monitoring, collaborative control and path planning of unmanned aerial vehicles (UAVs) are essential for improving data collection efficiency and quality. In this study, we focus on how to utilize multiple UAVs to efficiently c... ver más
Revista: Future Internet